Jul 29 16:48:46.811145 ip-10-0-142-232 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 16:48:46.811156 ip-10-0-142-232 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 16:48:46.811163 ip-10-0-142-232 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 16:48:46.811433 ip-10-0-142-232 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 16:48:57.029323 ip-10-0-142-232 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 16:48:57.029341 ip-10-0-142-232 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3adcc22b235544548a33c3c85c8941b5 -- Jul 29 16:50:48.194983 ip-10-0-142-232 systemd[1]: Starting Kubernetes Kubelet... Jul 29 16:50:48.549081 ip-10-0-142-232 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:50:48.549081 ip-10-0-142-232 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 16:50:48.549081 ip-10-0-142-232 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:50:48.549081 ip-10-0-142-232 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 16:50:48.549081 ip-10-0-142-232 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 16:50:48.551233 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.551088 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 16:50:48.555181 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555164 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:48.555181 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555180 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555184 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555188 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555191 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555193 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555196 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555199 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555202 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555206 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555208 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555211 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555214 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555217 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555219 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555223 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555226 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555228 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555232 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555234 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555237 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:48.555252 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555240 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555243 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555246 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555249 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555251 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555254 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555257 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555260 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555263 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555266 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555269 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555271 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555274 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555276 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555278 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555283 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555288 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555290 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555293 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:48.555813 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555296 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555298 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555301 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555303 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555308 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555311 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555314 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555316 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555319 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555322 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555325 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555328 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555331 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555334 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555337 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555340 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555343 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555347 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555349 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:48.556514 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555352 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555354 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555358 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555362 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555365 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555368 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555370 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555373 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555375 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555378 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555380 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555383 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555386 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555388 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555391 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555394 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555396 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555399 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555401 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555404 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:48.557039 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555406 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555409 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555411 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555414 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555416 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555419 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555422 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555425 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555428 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555431 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555433 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555436 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555438 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555441 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555443 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555446 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555448 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555451 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555453 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:48.557522 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.555456 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557791 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557804 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557808 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557811 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557814 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557818 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557821 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557823 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557826 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557828 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557831 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557834 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557836 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557839 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557842 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557845 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557847 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557850 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557852 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:48.558009 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557855 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557858 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557860 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557863 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557865 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557868 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557871 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557874 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557877 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557879 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557882 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557884 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557896 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557899 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557902 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557905 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557907 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557910 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557913 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557915 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:48.558503 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557918 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557920 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557923 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557925 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557928 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557931 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557933 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557937 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557940 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557943 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557945 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557949 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557951 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557954 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557956 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557959 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557961 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557963 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557966 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:48.559012 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557969 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557971 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557974 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557976 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557979 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557981 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557984 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557988 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557991 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557994 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557996 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.557999 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558002 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558004 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558007 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558009 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558012 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558015 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558017 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558021 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:48.559474 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558023 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558026 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558028 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558032 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558036 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558039 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558042 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558044 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558051 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558054 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558057 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558061 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558064 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558066 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558070 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558075 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558078 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558081 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558085 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:48.559979 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558088 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558090 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558525 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558531 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558534 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558539 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558543 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558546 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558549 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558552 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558554 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558557 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558560 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558563 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558565 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558568 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558570 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558573 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558576 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:48.560438 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558578 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558581 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558584 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558586 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558589 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558592 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558595 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558598 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558602 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558606 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558610 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558613 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558616 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558619 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558621 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558624 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558627 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558630 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558633 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:48.560918 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558635 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558638 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558640 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558643 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558645 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558648 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558651 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558670 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558675 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558679 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558682 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558684 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558687 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558691 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558693 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558696 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558698 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558702 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558704 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558707 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:48.561442 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558710 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558712 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558715 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558718 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558720 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558723 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558726 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558729 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558731 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558734 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558736 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558739 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558742 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558744 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558747 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558749 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558752 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558754 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558757 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558759 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:48.561988 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558762 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558765 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558767 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558770 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558772 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558775 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558778 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558780 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558783 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558786 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558788 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558791 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558794 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558796 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558799 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558801 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558804 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558807 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558810 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558812 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:48.562478 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558815 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558817 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.558819 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558897 2584 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558905 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558912 2584 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558916 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558921 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558925 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558929 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558933 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558936 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558939 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558943 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558946 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558949 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558952 2584 flags.go:64] FLAG: --cgroup-root="" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558955 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558958 2584 flags.go:64] FLAG: --client-ca-file="" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558962 2584 flags.go:64] FLAG: --cloud-provider="external" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558965 2584 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558969 2584 flags.go:64] FLAG: --cluster-domain="" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558971 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558974 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 16:50:48.562975 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558977 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558981 2584 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558984 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558987 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558990 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558994 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.558997 2584 flags.go:64] FLAG: --contention-profiling="false" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559000 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559003 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559006 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559009 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559013 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559016 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559019 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559022 2584 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559025 2584 flags.go:64] FLAG: --enable-server="true" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559028 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559033 2584 flags.go:64] FLAG: --event-burst="100" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559036 2584 flags.go:64] FLAG: --event-qps="50" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559039 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559042 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559045 2584 flags.go:64] FLAG: --eviction-hard="" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559049 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559052 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559055 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 16:50:48.563553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559058 2584 flags.go:64] FLAG: --eviction-soft="" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559061 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559064 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559067 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559070 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559073 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559076 2584 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559079 2584 flags.go:64] FLAG: --feature-gates="" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559082 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559085 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559088 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559091 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559094 2584 flags.go:64] FLAG: --healthz-port="10248" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559097 2584 flags.go:64] FLAG: --help="false" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559100 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-142-232.ec2.internal" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559103 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559106 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559108 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559111 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559115 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559118 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559120 2584 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559123 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 16:50:48.564171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559126 2584 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559129 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559132 2584 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559134 2584 flags.go:64] FLAG: --kube-reserved="" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559140 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559143 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559146 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559148 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559151 2584 flags.go:64] FLAG: --lock-file="" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559154 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559157 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559160 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559166 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559169 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559172 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559175 2584 flags.go:64] FLAG: --logging-format="text" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559177 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559181 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559183 2584 flags.go:64] FLAG: --manifest-url="" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559186 2584 flags.go:64] FLAG: --manifest-url-header="" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559191 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559194 2584 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559198 2584 flags.go:64] FLAG: --max-pods="110" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559201 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559204 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 16:50:48.564783 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559207 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559210 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559213 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559215 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559218 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559225 2584 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559228 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559231 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559234 2584 flags.go:64] FLAG: --pod-cidr="" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559237 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559242 2584 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559246 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559249 2584 flags.go:64] FLAG: --pods-per-core="0" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559252 2584 flags.go:64] FLAG: --port="10250" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559255 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559258 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f3fedba56a565e0d" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559261 2584 flags.go:64] FLAG: --qos-reserved="" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559264 2584 flags.go:64] FLAG: --read-only-port="10255" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559267 2584 flags.go:64] FLAG: --register-node="true" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559270 2584 flags.go:64] FLAG: --register-with-taints="" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559273 2584 flags.go:64] FLAG: --registry-burst="10" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559276 2584 flags.go:64] FLAG: --registry-qps="5" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559279 2584 flags.go:64] FLAG: --reserved-cpus="" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559282 2584 flags.go:64] FLAG: --reserved-memory="" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559285 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 16:50:48.565572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559288 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559291 2584 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559295 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559298 2584 flags.go:64] FLAG: --runonce="false" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559301 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559304 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559307 2584 flags.go:64] FLAG: --seccomp-default="false" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559310 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559313 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559316 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559319 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559322 2584 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559325 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559328 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559330 2584 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559333 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559336 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559339 2584 flags.go:64] FLAG: --system-cgroups="" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559343 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559348 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559351 2584 flags.go:64] FLAG: --tls-cert-file="" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559354 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559358 2584 flags.go:64] FLAG: --tls-min-version="" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559360 2584 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559363 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 16:50:48.566764 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559366 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559369 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559372 2584 flags.go:64] FLAG: --v="2" Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559376 2584 flags.go:64] FLAG: --version="false" Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559383 2584 flags.go:64] FLAG: --vmodule="" Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559386 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.559390 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559505 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559508 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559514 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559518 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559522 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559525 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559527 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559530 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559533 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559535 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559538 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559540 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559543 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559545 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:48.567824 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559548 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559551 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559554 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559556 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559560 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559563 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559565 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559568 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559570 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559573 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559576 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559578 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559581 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559583 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559586 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559588 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559591 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559594 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559597 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559599 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:48.568773 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559603 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559605 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559608 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559611 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559613 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559615 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559618 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559620 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559623 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559625 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559628 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559630 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559633 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559636 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559638 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559641 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559646 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559648 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559651 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559667 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:48.569431 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559670 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559672 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559675 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559679 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559683 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559686 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559689 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559692 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559694 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559697 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559701 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559705 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559709 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559712 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559715 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559718 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559721 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559724 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559727 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:48.570172 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559729 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559732 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559734 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559737 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559739 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559742 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559744 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559747 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559750 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559754 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559757 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559760 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559762 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559765 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559767 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559770 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559773 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559775 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559778 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:48.570990 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559780 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559783 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559785 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559788 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559792 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559794 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.559798 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.560339 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.567550 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.567569 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.567594 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.567603 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567708 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567716 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567721 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:48.571513 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567727 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567731 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567736 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567740 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567745 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567750 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567755 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567762 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567767 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567773 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567777 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567783 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567787 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567793 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567797 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567801 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567805 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567810 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567814 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:48.572097 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567818 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567822 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567827 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567831 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567835 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567839 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567844 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567848 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567852 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567857 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567862 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567866 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567871 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567875 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567879 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567883 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567888 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567892 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567896 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567900 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:48.572589 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567905 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567909 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567913 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567917 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567921 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567925 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567929 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567934 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567938 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567942 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567946 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567950 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567955 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567959 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567964 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567969 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567973 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567977 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567982 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567986 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:48.573167 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567993 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.567999 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568003 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568007 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568012 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568016 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568020 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568024 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568028 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568032 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568037 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568041 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568045 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568050 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568054 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568058 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568062 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568066 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568070 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568074 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:48.573738 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568078 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568082 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568086 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568091 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568095 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568099 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568103 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568108 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568113 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568117 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568123 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568129 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568134 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568139 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568144 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568148 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:48.574240 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568153 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.568161 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568397 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568405 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568410 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568415 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568419 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568423 2584 feature_gate.go:328] unrecognized feature gate: Example Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568428 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568432 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568436 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568440 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568444 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568449 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568453 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 16:50:48.574670 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568458 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568462 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568466 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568471 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568477 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568483 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568489 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568494 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568498 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568503 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568508 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568513 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568517 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568522 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568526 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568530 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568534 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568538 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568543 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568549 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 16:50:48.575265 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568554 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568559 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568564 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568568 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568573 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568578 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568583 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568587 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568593 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568597 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568602 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568606 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568610 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568614 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568619 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568623 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568627 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568632 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568636 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568642 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 16:50:48.576072 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568648 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568671 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568677 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568683 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568687 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568691 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568696 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568700 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568705 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568709 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568713 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568718 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568722 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568726 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568730 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568734 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568738 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568743 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568747 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 16:50:48.576691 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568751 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568755 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568759 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568763 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568768 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568772 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568776 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568780 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568784 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568788 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568792 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568796 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568800 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568804 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568808 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568813 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568817 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568822 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568827 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568831 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 16:50:48.577194 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568835 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568839 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568843 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568848 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568853 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568857 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:48.568861 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.568869 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.569028 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.571704 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.572918 2584 server.go:1019] "Starting client certificate rotation" Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.573029 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.573070 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 16:50:48.577745 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.575391 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 16:50:48.580125 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.580106 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 16:50:48.589031 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.589011 2584 log.go:25] "Validated CRI v1 runtime API" Jul 29 16:50:48.591033 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.591015 2584 log.go:25] "Validated CRI v1 image API" Jul 29 16:50:48.592524 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.592509 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 16:50:48.596765 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.596744 2584 fs.go:135] Filesystem UUIDs: map[70ea4e3c-e1da-4133-9438-3817daad37b8:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ebb7c1d7-84cb-41fe-a063-cda58e86d568:/dev/nvme0n1p4] Jul 29 16:50:48.596834 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.596764 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 16:50:48.602690 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.602571 2584 manager.go:216] Machine: {Timestamp:2026-07-29 16:50:48.601508121 +0000 UTC m=+0.297176656 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124892 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e7534d8dea45dbed4d8de71a5a76 SystemUUID:ec26e753-4d8d-ea45-dbed-4d8de71a5a76 BootID:3adcc22b-2355-4454-8a33-c3c85c8941b5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:64:5a:db:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:64:5a:db:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:fd:94:9d:e4:65 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 16:50:48.602690 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.602688 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 16:50:48.602795 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.602771 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 16:50:48.603613 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.603592 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 16:50:48.603761 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.603616 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 16:50:48.604097 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.604082 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 16:50:48.604408 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.604397 2584 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 16:50:48.604445 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.604410 2584 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 16:50:48.604445 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.604417 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 16:50:48.604966 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.604956 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 16:50:48.605725 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.605715 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 16:50:48.607379 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607367 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 29 16:50:48.607487 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607478 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 16:50:48.607532 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607512 2584 kubelet.go:486] "Attempting to sync node with API server" Jul 29 16:50:48.607532 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607522 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 16:50:48.607617 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607539 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 16:50:48.607617 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607548 2584 kubelet.go:398] "Adding apiserver pod source" Jul 29 16:50:48.607617 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607557 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 16:50:48.607929 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607916 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 16:50:48.607984 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.607934 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 16:50:48.610974 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.610952 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 16:50:48.612321 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.612307 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 16:50:48.612376 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.612337 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 16:50:48.613781 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613761 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 16:50:48.613848 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613795 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 16:50:48.613848 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613811 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 16:50:48.613848 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613823 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 16:50:48.613848 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613839 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 16:50:48.613848 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613850 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 16:50:48.614008 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613866 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 16:50:48.614008 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613878 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 16:50:48.614008 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613892 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 16:50:48.614008 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613903 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 16:50:48.614008 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613919 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 16:50:48.614008 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.613930 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 16:50:48.614446 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.614435 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 16:50:48.614484 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.614447 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 16:50:48.617651 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.617635 2584 server.go:1268] "Started kubelet" Jul 29 16:50:48.617757 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.617708 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 16:50:48.617816 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.617729 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 16:50:48.617816 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.617803 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 16:50:48.618534 ip-10-0-142-232 systemd[1]: Started Kubernetes Kubelet. Jul 29 16:50:48.619062 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.619021 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 16:50:48.619062 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.619027 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 16:50:48.619240 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.619133 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 16:50:48.619462 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.619408 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 16:50:48.620384 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.620366 2584 server.go:310] "Adding debug handlers to kubelet server" Jul 29 16:50:48.624295 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.624273 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 16:50:48.625193 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.622748 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-232.ec2.internal.18c6d0c56ac7eedc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-232.ec2.internal,UID:ip-10-0-142-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-232.ec2.internal,},FirstTimestamp:2026-07-29 16:50:48.61760278 +0000 UTC m=+0.313271313,LastTimestamp:2026-07-29 16:50:48.61760278 +0000 UTC m=+0.313271313,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-232.ec2.internal,}" Jul 29 16:50:48.628613 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.628589 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gvgp7" Jul 29 16:50:48.628989 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.628971 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 16:50:48.629079 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.628989 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 16:50:48.629139 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.629087 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:48.629741 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.629725 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 16:50:48.629869 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.629853 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 16:50:48.629970 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.629877 2584 factory.go:55] Registering systemd factory Jul 29 16:50:48.629970 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.629894 2584 factory.go:223] Registration of the systemd container factory successfully Jul 29 16:50:48.629970 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.629728 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 16:50:48.630105 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.629992 2584 reconstruct.go:97] "Volume reconstruction finished" Jul 29 16:50:48.630105 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.630003 2584 reconciler.go:29] "Reconciler: start to sync state" Jul 29 16:50:48.630187 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.630128 2584 factory.go:153] Registering CRI-O factory Jul 29 16:50:48.630187 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.630142 2584 factory.go:223] Registration of the crio container factory successfully Jul 29 16:50:48.630272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.630199 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 16:50:48.630272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.630223 2584 factory.go:103] Registering Raw factory Jul 29 16:50:48.630272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.630237 2584 manager.go:1196] Started watching for new ooms in manager Jul 29 16:50:48.630871 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.630857 2584 manager.go:349] Starting recovery of all containers Jul 29 16:50:48.631098 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.631064 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 16:50:48.631193 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.631170 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 16:50:48.637251 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.637232 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gvgp7" Jul 29 16:50:48.640513 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.640484 2584 manager.go:354] Recovery completed Jul 29 16:50:48.645015 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.644894 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:48.646906 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.646891 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:48.646962 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.646920 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:48.646962 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.646938 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:48.647428 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.647412 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 16:50:48.647478 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.647428 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 16:50:48.647478 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.647449 2584 state_mem.go:36] "Initialized new in-memory state store" Jul 29 16:50:48.647478 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.647413 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:48.648206 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.648189 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:48.648276 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.648212 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:48.648276 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.648223 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:48.648947 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.648936 2584 policy_none.go:49] "None policy: Start" Jul 29 16:50:48.649019 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.648950 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 16:50:48.649019 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.648961 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 16:50:48.649896 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.649886 2584 policy_none.go:47] "Start" Jul 29 16:50:48.688235 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.688217 2584 manager.go:337] "Starting Device Plugin manager" Jul 29 16:50:48.688361 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.688261 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 16:50:48.688361 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.688274 2584 server.go:87] "Starting device plugin registration server" Jul 29 16:50:48.688572 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.688558 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 16:50:48.688632 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.688573 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 16:50:48.688721 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.688651 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 16:50:48.688834 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.688746 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 16:50:48.688834 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.688755 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 16:50:48.689324 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.689307 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 16:50:48.689410 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.689359 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:48.747292 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.747259 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 16:50:48.748492 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.748476 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 16:50:48.748579 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.748512 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 16:50:48.748579 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.748534 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 16:50:48.748579 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:48.748570 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 16:50:48.751000 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:48.750982 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:49.952760 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:49.952724 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:49.953707 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:49.953693 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:49.953780 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:49.953722 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:49.953780 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:49.953732 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:49.953780 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:49.953756 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-232.ec2.internal" Jul 29 16:50:49.962843 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:49.962269 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-232.ec2.internal" Jul 29 16:50:49.962843 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:49.962300 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-232.ec2.internal\": node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:49.975519 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:49.975461 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.013997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.013418 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal"] Jul 29 16:50:50.014094 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.014045 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:50.014973 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.014956 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:50.015055 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.014985 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:50.015055 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.015001 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:50.016122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016109 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:50.016233 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016217 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.016286 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016248 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:50.016858 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016846 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:50.016922 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016873 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:50.016922 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016884 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:50.016990 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016846 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:50.016990 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016950 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:50.016990 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.016963 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:50.018082 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.018066 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.018148 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.018093 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 16:50:50.018770 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.018754 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientMemory" Jul 29 16:50:50.018827 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.018786 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 16:50:50.018827 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.018800 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeHasSufficientPID" Jul 29 16:50:50.035040 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.035018 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-232.ec2.internal\" not found" node="ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.038303 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.038286 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-232.ec2.internal\" not found" node="ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.075619 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.075590 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.094862 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.094832 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50392cdfc81e62409afa6293f6fa968-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"c50392cdfc81e62409afa6293f6fa968\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.094862 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.094860 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0ddd5c5c7644f7a04469a88243a8d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-232.ec2.internal\" (UID: \"d0ddd5c5c7644f7a04469a88243a8d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.095058 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.094879 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c50392cdfc81e62409afa6293f6fa968-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"c50392cdfc81e62409afa6293f6fa968\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.175900 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.175865 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.195170 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.195144 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c50392cdfc81e62409afa6293f6fa968-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"c50392cdfc81e62409afa6293f6fa968\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.195253 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.195173 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50392cdfc81e62409afa6293f6fa968-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"c50392cdfc81e62409afa6293f6fa968\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.195253 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.195190 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0ddd5c5c7644f7a04469a88243a8d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-232.ec2.internal\" (UID: \"d0ddd5c5c7644f7a04469a88243a8d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.195253 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.195230 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d0ddd5c5c7644f7a04469a88243a8d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-142-232.ec2.internal\" (UID: \"d0ddd5c5c7644f7a04469a88243a8d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.195349 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.195250 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c50392cdfc81e62409afa6293f6fa968-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"c50392cdfc81e62409afa6293f6fa968\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.195349 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.195255 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c50392cdfc81e62409afa6293f6fa968-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal\" (UID: \"c50392cdfc81e62409afa6293f6fa968\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.276276 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.276199 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.337721 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.337692 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.341587 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.341432 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 29 16:50:50.376319 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.376294 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.476833 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.476778 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.577346 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.577260 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.677972 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.677919 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.736515 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.736485 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 16:50:50.737099 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.736616 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 16:50:50.779028 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.778993 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.804554 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.804517 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 16:45:49 +0000 UTC" deadline="2028-04-23 05:31:26.751594212 +0000 UTC" Jul 29 16:50:50.804554 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.804546 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15204h40m35.947052788s" Jul 29 16:50:50.879510 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.879478 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.933011 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:50.932987 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ddd5c5c7644f7a04469a88243a8d6a.slice/crio-7dbf5a40f2bb0f4e96da0d1adb00f061f21aa7d0b9899e5f7e36c3be050f05f9 WatchSource:0}: Error finding container 7dbf5a40f2bb0f4e96da0d1adb00f061f21aa7d0b9899e5f7e36c3be050f05f9: Status 404 returned error can't find the container with id 7dbf5a40f2bb0f4e96da0d1adb00f061f21aa7d0b9899e5f7e36c3be050f05f9 Jul 29 16:50:50.933393 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:50.933380 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc50392cdfc81e62409afa6293f6fa968.slice/crio-10d3c04790d3e9351cc2ef118971b187f5a21d40bebef852fcda7b301c1b80a9 WatchSource:0}: Error finding container 10d3c04790d3e9351cc2ef118971b187f5a21d40bebef852fcda7b301c1b80a9: Status 404 returned error can't find the container with id 10d3c04790d3e9351cc2ef118971b187f5a21d40bebef852fcda7b301c1b80a9 Jul 29 16:50:50.938171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.938156 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 16:50:50.980406 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:50.980374 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-232.ec2.internal\" not found" Jul 29 16:50:50.984703 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:50.984683 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:51.034997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.034965 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:51.094049 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.093986 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" Jul 29 16:50:51.106581 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.106562 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 16:50:51.108355 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.108343 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" Jul 29 16:50:51.120573 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.120554 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 16:50:51.352199 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.352118 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:51.772103 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.772021 2584 apiserver.go:52] "Watching apiserver" Jul 29 16:50:51.780622 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.780596 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 16:50:51.781740 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.781711 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-x5b5q","kube-system/global-pull-secret-syncer-fv4xz","kube-system/konnectivity-agent-cdt7n","kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg","openshift-dns/node-resolver-74k8g","openshift-image-registry/node-ca-mkttr","openshift-multus/multus-additional-cni-plugins-tbbxd","openshift-ovn-kubernetes/ovnkube-node-rt4hb","openshift-cluster-node-tuning-operator/tuned-9dl77","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal","openshift-multus/multus-kxlmz","openshift-multus/network-metrics-daemon-kr8b2","openshift-network-diagnostics/network-check-target-47n92"] Jul 29 16:50:51.783356 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.783330 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.784812 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.784755 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:51.784924 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:51.784855 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:50:51.785827 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.785804 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:50:51.786737 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.786711 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 16:50:51.786737 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.786724 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 16:50:51.786897 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.786765 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6q69v\"" Jul 29 16:50:51.786897 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.786825 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 16:50:51.786981 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.786912 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 16:50:51.786981 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.786929 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 16:50:51.787251 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.787234 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.789429 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.788261 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 16:50:51.789429 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.789097 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rj6vz\"" Jul 29 16:50:51.789429 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.789214 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 16:50:51.789642 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.789484 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 16:50:51.790240 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.790112 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:50:51.790936 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.790916 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.792989 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.792971 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 16:50:51.793119 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.793100 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pxvbt\"" Jul 29 16:50:51.793271 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.793254 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.793465 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.793257 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 16:50:51.793630 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.793612 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 16:50:51.793699 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.793646 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 16:50:51.793806 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.793789 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 16:50:51.794102 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.794083 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h2xk6\"" Jul 29 16:50:51.794849 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.794828 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.795918 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.795899 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sznzq\"" Jul 29 16:50:51.796238 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.796221 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.796317 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.796238 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 16:50:51.796435 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.796417 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 16:50:51.797495 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.797474 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:50:51.797684 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.797671 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7c2wh\"" Jul 29 16:50:51.798052 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.797890 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 16:50:51.798052 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.797929 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 16:50:51.798052 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.798031 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:51.798961 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.798944 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.799434 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.799419 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 16:50:51.799434 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.799429 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rkfz2\"" Jul 29 16:50:51.800854 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.800832 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 16:50:51.801124 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.801105 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 16:50:51.801424 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.801407 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 16:50:51.801755 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.801734 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 16:50:51.801946 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.801927 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8bkh5\"" Jul 29 16:50:51.802042 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.802020 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:51.802154 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:51.802111 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:50:51.802225 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.802210 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 16:50:51.802225 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.802220 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:51.802309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.802233 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 16:50:51.802309 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:51.802281 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:50:51.802411 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.802342 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 16:50:51.802474 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.802420 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 16:50:51.802650 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.802627 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9b96j\"" Jul 29 16:50:51.804779 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804758 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-modprobe-d\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.804883 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804798 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysconfig\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.804883 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804824 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysctl-d\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.804883 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804845 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05bec12f-b245-492a-ba61-5c7622ae97d9-hosts-file\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.804883 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804870 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0bfffac-dd64-4bca-b80f-96d637553acd-iptables-alerter-script\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.805020 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-slash\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805020 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804904 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-run-netns\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805020 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804955 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-systemd\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805020 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804970 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-sys\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805020 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.804990 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ead991e-a967-4953-8763-c5b779208e97-serviceca\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.805020 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805013 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-systemd-units\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805185 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805035 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-node-log\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805185 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805053 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-log-socket\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805185 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805067 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-cni-bin\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805185 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805088 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-cni-netd\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805185 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805128 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-run\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805185 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805162 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-lib-modules\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805186 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-host\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805209 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805239 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmszd\" (UniqueName: \"kubernetes.io/projected/7799e27e-e7b7-49c5-ab70-219172fcc3f6-kube-api-access-dmszd\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805272 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bec12f-b245-492a-ba61-5c7622ae97d9-tmp-dir\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805302 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x26l\" (UniqueName: \"kubernetes.io/projected/c47dc45f-db50-4216-923a-4ef2c5d1e856-kube-api-access-7x26l\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805318 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovnkube-script-lib\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805338 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16de1a4e-c081-4a68-9d60-011c7049df50-agent-certs\") pod \"konnectivity-agent-cdt7n\" (UID: \"16de1a4e-c081-4a68-9d60-011c7049df50\") " pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805361 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h85b\" (UniqueName: \"kubernetes.io/projected/05bec12f-b245-492a-ba61-5c7622ae97d9-kube-api-access-2h85b\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805385 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28j6g\" (UniqueName: \"kubernetes.io/projected/4ead991e-a967-4953-8763-c5b779208e97-kube-api-access-28j6g\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.805427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805418 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0bfffac-dd64-4bca-b80f-96d637553acd-host-slash\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805456 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805479 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-env-overrides\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805503 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4skx\" (UniqueName: \"kubernetes.io/projected/f0bfffac-dd64-4bca-b80f-96d637553acd-kube-api-access-w4skx\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805526 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-kubernetes\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805546 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-var-lib-kubelet\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805567 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-tuned\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805589 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ead991e-a967-4953-8763-c5b779208e97-host\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805614 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-systemd\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805636 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-ovn\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805657 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6nqx\" (UniqueName: \"kubernetes.io/projected/425ce19e-afd9-4f87-960d-5ac72c5c025d-kube-api-access-d6nqx\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805680 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805703 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805751 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovnkube-config\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805780 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysctl-conf\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805801 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7799e27e-e7b7-49c5-ab70-219172fcc3f6-tmp\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.805845 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805824 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-kubelet\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.806517 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805847 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-var-lib-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.806517 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805870 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-etc-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.806517 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805892 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovn-node-metrics-cert\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.806517 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.805915 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16de1a4e-c081-4a68-9d60-011c7049df50-konnectivity-ca\") pod \"konnectivity-agent-cdt7n\" (UID: \"16de1a4e-c081-4a68-9d60-011c7049df50\") " pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:50:51.806709 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.806663 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 16:50:51.835392 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.835370 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-88jxz" Jul 29 16:50:51.857003 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.856830 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-88jxz" Jul 29 16:50:51.895009 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.894984 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 16:50:51.906341 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906308 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-node-log\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906347 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-cni-bin\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906390 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-cni-bin\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906404 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-node-log\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906483 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-cni-netd\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906514 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-cnibin\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.906541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906532 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-lib-modules\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906548 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906575 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-netns\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906599 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906605 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-cni-netd\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-system-cni-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906648 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906660 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28j6g\" (UniqueName: \"kubernetes.io/projected/4ead991e-a967-4953-8763-c5b779208e97-kube-api-access-28j6g\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906688 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-lib-modules\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906710 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0bfffac-dd64-4bca-b80f-96d637553acd-host-slash\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906741 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-env-overrides\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906769 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fad74b0-68e8-431e-b017-89885b72b831-kubelet-config\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906795 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-kubernetes\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906793 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0bfffac-dd64-4bca-b80f-96d637553acd-host-slash\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.906830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906820 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-tuned\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906848 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906873 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-cni-multus\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906890 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-kubernetes\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906897 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-conf-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906953 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.906983 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907012 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-system-cni-dir\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907080 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-daemon-config\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:51.907054 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907109 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-etc-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907136 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907154 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-os-release\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:51.907195 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs podName:c47dc45f-db50-4216-923a-4ef2c5d1e856 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:52.407170846 +0000 UTC m=+2.939051933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs") pod "network-metrics-daemon-kr8b2" (UID: "c47dc45f-db50-4216-923a-4ef2c5d1e856") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907214 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-etc-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907235 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907267 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:51.907522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907316 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-modprobe-d\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907346 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysconfig\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907302 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-env-overrides\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907369 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysctl-d\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907407 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-modprobe-d\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907435 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysconfig\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907489 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05bec12f-b245-492a-ba61-5c7622ae97d9-hosts-file\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907517 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysctl-d\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907518 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0bfffac-dd64-4bca-b80f-96d637553acd-iptables-alerter-script\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907561 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-slash\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907583 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05bec12f-b245-492a-ba61-5c7622ae97d9-hosts-file\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907590 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907617 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-systemd\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907627 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-slash\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-systemd-units\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907667 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-log-socket\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907691 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fad74b0-68e8-431e-b017-89885b72b831-dbus\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:51.908309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907694 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-systemd\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-kubelet\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907749 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-systemd-units\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907760 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-multus-certs\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907786 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-etc-kubernetes\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907791 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-log-socket\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907811 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-run\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907836 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-host\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907862 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-227nh\" (UniqueName: \"kubernetes.io/projected/49db7fbb-4cff-41a5-901d-951954ce4d32-kube-api-access-227nh\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-cni-binary-copy\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907912 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-hostroot\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907924 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-host\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907937 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmszd\" (UniqueName: \"kubernetes.io/projected/7799e27e-e7b7-49c5-ab70-219172fcc3f6-kube-api-access-dmszd\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907963 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bec12f-b245-492a-ba61-5c7622ae97d9-tmp-dir\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907966 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-run\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907986 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0bfffac-dd64-4bca-b80f-96d637553acd-iptables-alerter-script\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.907999 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x26l\" (UniqueName: \"kubernetes.io/projected/c47dc45f-db50-4216-923a-4ef2c5d1e856-kube-api-access-7x26l\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:51.909064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908027 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovnkube-script-lib\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908054 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-socket-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908077 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-device-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908098 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-cnibin\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908118 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-os-release\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908141 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h85b\" (UniqueName: \"kubernetes.io/projected/05bec12f-b245-492a-ba61-5c7622ae97d9-kube-api-access-2h85b\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908166 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908197 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908218 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-run-ovn-kubernetes\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908230 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4skx\" (UniqueName: \"kubernetes.io/projected/f0bfffac-dd64-4bca-b80f-96d637553acd-kube-api-access-w4skx\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908262 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05bec12f-b245-492a-ba61-5c7622ae97d9-tmp-dir\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908267 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-var-lib-kubelet\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908291 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ead991e-a967-4953-8763-c5b779208e97-host\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908334 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ead991e-a967-4953-8763-c5b779208e97-host\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908336 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-var-lib-kubelet\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908462 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-systemd\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908490 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-ovn\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.909923 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908524 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-systemd\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908552 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6nqx\" (UniqueName: \"kubernetes.io/projected/425ce19e-afd9-4f87-960d-5ac72c5c025d-kube-api-access-d6nqx\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908568 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-ovn\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908591 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovnkube-script-lib\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908616 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-sys-fs\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908745 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-cni-bin\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908803 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908834 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovnkube-config\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908870 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-run-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.908916 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-registration-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909020 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-k8s-cni-cncf-io\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909042 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvlfk\" (UniqueName: \"kubernetes.io/projected/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-kube-api-access-kvlfk\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909060 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysctl-conf\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909081 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7799e27e-e7b7-49c5-ab70-219172fcc3f6-tmp\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909099 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-kubelet\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909135 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-kubelet\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909188 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-sysctl-conf\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.910566 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-var-lib-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909249 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovn-node-metrics-cert\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909271 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16de1a4e-c081-4a68-9d60-011c7049df50-konnectivity-ca\") pod \"konnectivity-agent-cdt7n\" (UID: \"16de1a4e-c081-4a68-9d60-011c7049df50\") " pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909308 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-var-lib-openvswitch\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909303 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909353 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-run-netns\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909378 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16de1a4e-c081-4a68-9d60-011c7049df50-agent-certs\") pod \"konnectivity-agent-cdt7n\" (UID: \"16de1a4e-c081-4a68-9d60-011c7049df50\") " pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909402 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgmjn\" (UniqueName: \"kubernetes.io/projected/dd634103-5fbd-47d0-8ac9-01b8972e0888-kube-api-access-wgmjn\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909422 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovnkube-config\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909426 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-cni-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909489 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/425ce19e-afd9-4f87-960d-5ac72c5c025d-host-run-netns\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909495 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-socket-dir-parent\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909523 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-sys\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ead991e-a967-4953-8763-c5b779208e97-serviceca\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909707 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7799e27e-e7b7-49c5-ab70-219172fcc3f6-sys\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.909864 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16de1a4e-c081-4a68-9d60-011c7049df50-konnectivity-ca\") pod \"konnectivity-agent-cdt7n\" (UID: \"16de1a4e-c081-4a68-9d60-011c7049df50\") " pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.910021 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4ead991e-a967-4953-8763-c5b779208e97-serviceca\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.911256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.910857 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7799e27e-e7b7-49c5-ab70-219172fcc3f6-etc-tuned\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.911983 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.911958 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/425ce19e-afd9-4f87-960d-5ac72c5c025d-ovn-node-metrics-cert\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.912218 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.912196 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16de1a4e-c081-4a68-9d60-011c7049df50-agent-certs\") pod \"konnectivity-agent-cdt7n\" (UID: \"16de1a4e-c081-4a68-9d60-011c7049df50\") " pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:50:51.912316 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.912256 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7799e27e-e7b7-49c5-ab70-219172fcc3f6-tmp\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.916092 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.915974 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28j6g\" (UniqueName: \"kubernetes.io/projected/4ead991e-a967-4953-8763-c5b779208e97-kube-api-access-28j6g\") pod \"node-ca-mkttr\" (UID: \"4ead991e-a967-4953-8763-c5b779208e97\") " pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:51.917248 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.917220 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h85b\" (UniqueName: \"kubernetes.io/projected/05bec12f-b245-492a-ba61-5c7622ae97d9-kube-api-access-2h85b\") pod \"node-resolver-74k8g\" (UID: \"05bec12f-b245-492a-ba61-5c7622ae97d9\") " pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:51.917684 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.917662 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmszd\" (UniqueName: \"kubernetes.io/projected/7799e27e-e7b7-49c5-ab70-219172fcc3f6-kube-api-access-dmszd\") pod \"tuned-9dl77\" (UID: \"7799e27e-e7b7-49c5-ab70-219172fcc3f6\") " pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:51.918140 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.918096 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" event={"ID":"d0ddd5c5c7644f7a04469a88243a8d6a","Type":"ContainerStarted","Data":"7dbf5a40f2bb0f4e96da0d1adb00f061f21aa7d0b9899e5f7e36c3be050f05f9"} Jul 29 16:50:51.918312 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.918290 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6nqx\" (UniqueName: \"kubernetes.io/projected/425ce19e-afd9-4f87-960d-5ac72c5c025d-kube-api-access-d6nqx\") pod \"ovnkube-node-rt4hb\" (UID: \"425ce19e-afd9-4f87-960d-5ac72c5c025d\") " pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:51.918633 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.918597 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4skx\" (UniqueName: \"kubernetes.io/projected/f0bfffac-dd64-4bca-b80f-96d637553acd-kube-api-access-w4skx\") pod \"iptables-alerter-x5b5q\" (UID: \"f0bfffac-dd64-4bca-b80f-96d637553acd\") " pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:51.918825 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.918807 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x26l\" (UniqueName: \"kubernetes.io/projected/c47dc45f-db50-4216-923a-4ef2c5d1e856-kube-api-access-7x26l\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:51.919561 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.919535 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" event={"ID":"c50392cdfc81e62409afa6293f6fa968","Type":"ContainerStarted","Data":"10d3c04790d3e9351cc2ef118971b187f5a21d40bebef852fcda7b301c1b80a9"} Jul 29 16:50:51.941771 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:51.941743 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 16:50:52.010693 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010660 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.010693 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010705 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-system-cni-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.010937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010734 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fad74b0-68e8-431e-b017-89885b72b831-kubelet-config\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:52.010937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.010937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010782 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-cni-multus\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.010937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010811 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-system-cni-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.010937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010819 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-cni-multus\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.010937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010874 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4fad74b0-68e8-431e-b017-89885b72b831-kubelet-config\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:52.010937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010877 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-conf-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.010937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010922 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-conf-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010944 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010972 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.010979 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-system-cni-dir\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011009 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-daemon-config\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.011025 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011029 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-system-cni-dir\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011035 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-os-release\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.011093 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret podName:4fad74b0-68e8-431e-b017-89885b72b831 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:52.511073144 +0000 UTC m=+3.042954232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret") pod "global-pull-secret-syncer-fv4xz" (UID: "4fad74b0-68e8-431e-b017-89885b72b831") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011094 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-os-release\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011107 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011126 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011153 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011182 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fad74b0-68e8-431e-b017-89885b72b831-dbus\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011206 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-kubelet\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011220 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.011343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011229 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-multus-certs\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011252 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-etc-kubernetes\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-227nh\" (UniqueName: \"kubernetes.io/projected/49db7fbb-4cff-41a5-901d-951954ce4d32-kube-api-access-227nh\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011295 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-cni-binary-copy\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011314 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-hostroot\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011322 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-multus-certs\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011338 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-socket-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011364 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-device-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011369 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-kubelet\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011382 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-cnibin\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011402 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-os-release\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011427 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011432 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4fad74b0-68e8-431e-b017-89885b72b831-dbus\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011473 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-sys-fs\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011497 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-cni-bin\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011499 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-etc-kubernetes\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011522 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-registration-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011548 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-k8s-cni-cncf-io\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011570 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvlfk\" (UniqueName: \"kubernetes.io/projected/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-kube-api-access-kvlfk\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011601 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011626 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgmjn\" (UniqueName: \"kubernetes.io/projected/dd634103-5fbd-47d0-8ac9-01b8972e0888-kube-api-access-wgmjn\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011651 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-cni-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011681 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-socket-dir-parent\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011689 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-daemon-config\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011711 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-cnibin\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011739 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-netns\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011748 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-var-lib-cni-bin\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011772 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-registration-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011812 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-k8s-cni-cncf-io\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011836 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-hostroot\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011871 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-cni-dir\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011902 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-multus-socket-dir-parent\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011931 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-cni-binary-copy\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011947 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/49db7fbb-4cff-41a5-901d-951954ce4d32-cnibin\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011986 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-cni-binary-copy\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.012824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011989 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-socket-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.013522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.011992 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-device-dir\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.013522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.012016 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-host-run-netns\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.013522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.012039 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-os-release\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.013522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.012060 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-sys-fs\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.013522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.012065 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-cnibin\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.013522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.012087 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd634103-5fbd-47d0-8ac9-01b8972e0888-etc-selinux\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.013522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.012479 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.013522 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.012499 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/49db7fbb-4cff-41a5-901d-951954ce4d32-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.021988 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.021963 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:50:52.021988 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.021988 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:50:52.022197 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.022001 2584 projected.go:196] Error preparing data for projected volume kube-api-access-2xqk8 for pod openshift-network-diagnostics/network-check-target-47n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:52.022197 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.022125 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8 podName:9cacb46e-18e1-43ad-abe7-da9839a9f635 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:52.522111016 +0000 UTC m=+3.053992122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2xqk8" (UniqueName: "kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8") pod "network-check-target-47n92" (UID: "9cacb46e-18e1-43ad-abe7-da9839a9f635") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:52.024647 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.024626 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-227nh\" (UniqueName: \"kubernetes.io/projected/49db7fbb-4cff-41a5-901d-951954ce4d32-kube-api-access-227nh\") pod \"multus-additional-cni-plugins-tbbxd\" (UID: \"49db7fbb-4cff-41a5-901d-951954ce4d32\") " pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.024647 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.024638 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgmjn\" (UniqueName: \"kubernetes.io/projected/dd634103-5fbd-47d0-8ac9-01b8972e0888-kube-api-access-wgmjn\") pod \"aws-ebs-csi-driver-node-zb7qg\" (UID: \"dd634103-5fbd-47d0-8ac9-01b8972e0888\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.024803 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.024699 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvlfk\" (UniqueName: \"kubernetes.io/projected/3c69035b-a871-4e7c-b9ed-0ad59e5fd54b-kube-api-access-kvlfk\") pod \"multus-kxlmz\" (UID: \"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b\") " pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.099731 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.099699 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:50:52.107631 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.107604 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:50:52.117526 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.117499 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9dl77" Jul 29 16:50:52.123675 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.123648 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mkttr" Jul 29 16:50:52.138510 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.138480 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-74k8g" Jul 29 16:50:52.146555 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.146527 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x5b5q" Jul 29 16:50:52.156213 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.156185 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" Jul 29 16:50:52.163781 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.163756 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" Jul 29 16:50:52.169456 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.169417 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kxlmz" Jul 29 16:50:52.414942 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.414849 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:52.415097 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.415013 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:52.415097 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.415077 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs podName:c47dc45f-db50-4216-923a-4ef2c5d1e856 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:53.415056659 +0000 UTC m=+3.946937759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs") pod "network-metrics-daemon-kr8b2" (UID: "c47dc45f-db50-4216-923a-4ef2c5d1e856") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:52.515607 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.515574 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:52.515772 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.515720 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:52.515812 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.515778 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret podName:4fad74b0-68e8-431e-b017-89885b72b831 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:53.515764903 +0000 UTC m=+4.047645985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret") pod "global-pull-secret-syncer-fv4xz" (UID: "4fad74b0-68e8-431e-b017-89885b72b831") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:52.616531 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.616496 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:52.616706 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.616658 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:50:52.616706 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.616676 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:50:52.616706 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.616688 2584 projected.go:196] Error preparing data for projected volume kube-api-access-2xqk8 for pod openshift-network-diagnostics/network-check-target-47n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:52.616852 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.616741 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8 podName:9cacb46e-18e1-43ad-abe7-da9839a9f635 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:53.616723353 +0000 UTC m=+4.148604434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xqk8" (UniqueName: "kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8") pod "network-check-target-47n92" (UID: "9cacb46e-18e1-43ad-abe7-da9839a9f635") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:52.805299 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:52.805266 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16de1a4e_c081_4a68_9d60_011c7049df50.slice/crio-ff02322080db6b82c324383f296f5dee9f96fc67ce43bf641ebb88c8281ea47d WatchSource:0}: Error finding container ff02322080db6b82c324383f296f5dee9f96fc67ce43bf641ebb88c8281ea47d: Status 404 returned error can't find the container with id ff02322080db6b82c324383f296f5dee9f96fc67ce43bf641ebb88c8281ea47d Jul 29 16:50:52.821864 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:52.821471 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0bfffac_dd64_4bca_b80f_96d637553acd.slice/crio-760af0206154bc4b17f8c7bd679153183ec6d456e001a0ff83473c884257d609 WatchSource:0}: Error finding container 760af0206154bc4b17f8c7bd679153183ec6d456e001a0ff83473c884257d609: Status 404 returned error can't find the container with id 760af0206154bc4b17f8c7bd679153183ec6d456e001a0ff83473c884257d609 Jul 29 16:50:52.823033 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:52.822961 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49db7fbb_4cff_41a5_901d_951954ce4d32.slice/crio-3d2d81bb857658782ca10c5838dd5f77edc05e67ad569fe83dc8d92cf9405da9 WatchSource:0}: Error finding container 3d2d81bb857658782ca10c5838dd5f77edc05e67ad569fe83dc8d92cf9405da9: Status 404 returned error can't find the container with id 3d2d81bb857658782ca10c5838dd5f77edc05e67ad569fe83dc8d92cf9405da9 Jul 29 16:50:52.823318 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:52.823293 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7799e27e_e7b7_49c5_ab70_219172fcc3f6.slice/crio-b5ada01acc1333836211c167a812dd882edf6539f03a7e193e3458fcb0caaf65 WatchSource:0}: Error finding container b5ada01acc1333836211c167a812dd882edf6539f03a7e193e3458fcb0caaf65: Status 404 returned error can't find the container with id b5ada01acc1333836211c167a812dd882edf6539f03a7e193e3458fcb0caaf65 Jul 29 16:50:52.824127 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:52.824102 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425ce19e_afd9_4f87_960d_5ac72c5c025d.slice/crio-0c5b308647c2c29a91049fe49b5c83c441d66a99eb5913caba3788f6f3adb1f3 WatchSource:0}: Error finding container 0c5b308647c2c29a91049fe49b5c83c441d66a99eb5913caba3788f6f3adb1f3: Status 404 returned error can't find the container with id 0c5b308647c2c29a91049fe49b5c83c441d66a99eb5913caba3788f6f3adb1f3 Jul 29 16:50:52.824906 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:52.824864 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05bec12f_b245_492a_ba61_5c7622ae97d9.slice/crio-3c9ea5c251e9d31ff9d606e7684b4e3a1af33108adb594ef030600a9c321d2a7 WatchSource:0}: Error finding container 3c9ea5c251e9d31ff9d606e7684b4e3a1af33108adb594ef030600a9c321d2a7: Status 404 returned error can't find the container with id 3c9ea5c251e9d31ff9d606e7684b4e3a1af33108adb594ef030600a9c321d2a7 Jul 29 16:50:52.827341 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:52.827168 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ead991e_a967_4953_8763_c5b779208e97.slice/crio-1c5535c5f8f33545fca049069385655a892b8ba1091254dec77fcb48d97b644f WatchSource:0}: Error finding container 1c5535c5f8f33545fca049069385655a892b8ba1091254dec77fcb48d97b644f: Status 404 returned error can't find the container with id 1c5535c5f8f33545fca049069385655a892b8ba1091254dec77fcb48d97b644f Jul 29 16:50:52.828561 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:50:52.828492 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd634103_5fbd_47d0_8ac9_01b8972e0888.slice/crio-301b7fa6e477f390a047b1bc290490652cc4f44821dd57e20015904eb7a3a371 WatchSource:0}: Error finding container 301b7fa6e477f390a047b1bc290490652cc4f44821dd57e20015904eb7a3a371: Status 404 returned error can't find the container with id 301b7fa6e477f390a047b1bc290490652cc4f44821dd57e20015904eb7a3a371 Jul 29 16:50:52.859049 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.859023 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 16:45:51 +0000 UTC" deadline="2028-01-21 02:36:49.100640176 +0000 UTC" Jul 29 16:50:52.859049 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.859048 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12969h45m56.241595218s" Jul 29 16:50:52.912711 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.912542 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:52.912843 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.912542 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:52.912843 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.912802 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:50:52.912958 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:52.912896 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:50:52.923180 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.923154 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" event={"ID":"d0ddd5c5c7644f7a04469a88243a8d6a","Type":"ContainerStarted","Data":"48902d0a9e1a60603684b7c9cbc9107eaa54be3c6d2456090f2fed41b799d34d"} Jul 29 16:50:52.924595 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.924569 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kxlmz" event={"ID":"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b","Type":"ContainerStarted","Data":"62dcf3b5886a3aa80ffb9715b1c0029425e620a84ef5b7219039d16b6794ff64"} Jul 29 16:50:52.925679 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.925656 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mkttr" event={"ID":"4ead991e-a967-4953-8763-c5b779208e97","Type":"ContainerStarted","Data":"1c5535c5f8f33545fca049069385655a892b8ba1091254dec77fcb48d97b644f"} Jul 29 16:50:52.926850 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.926812 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9dl77" event={"ID":"7799e27e-e7b7-49c5-ab70-219172fcc3f6","Type":"ContainerStarted","Data":"b5ada01acc1333836211c167a812dd882edf6539f03a7e193e3458fcb0caaf65"} Jul 29 16:50:52.928091 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.928049 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5b5q" event={"ID":"f0bfffac-dd64-4bca-b80f-96d637553acd","Type":"ContainerStarted","Data":"760af0206154bc4b17f8c7bd679153183ec6d456e001a0ff83473c884257d609"} Jul 29 16:50:52.929213 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.929193 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdt7n" event={"ID":"16de1a4e-c081-4a68-9d60-011c7049df50","Type":"ContainerStarted","Data":"ff02322080db6b82c324383f296f5dee9f96fc67ce43bf641ebb88c8281ea47d"} Jul 29 16:50:52.930315 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.930291 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" event={"ID":"dd634103-5fbd-47d0-8ac9-01b8972e0888","Type":"ContainerStarted","Data":"301b7fa6e477f390a047b1bc290490652cc4f44821dd57e20015904eb7a3a371"} Jul 29 16:50:52.931249 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.931230 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-74k8g" event={"ID":"05bec12f-b245-492a-ba61-5c7622ae97d9","Type":"ContainerStarted","Data":"3c9ea5c251e9d31ff9d606e7684b4e3a1af33108adb594ef030600a9c321d2a7"} Jul 29 16:50:52.932380 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.932362 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"0c5b308647c2c29a91049fe49b5c83c441d66a99eb5913caba3788f6f3adb1f3"} Jul 29 16:50:52.933359 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:52.933340 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" event={"ID":"49db7fbb-4cff-41a5-901d-951954ce4d32","Type":"ContainerStarted","Data":"3d2d81bb857658782ca10c5838dd5f77edc05e67ad569fe83dc8d92cf9405da9"} Jul 29 16:50:53.422823 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.422132 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:53.422823 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.422321 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:53.422823 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.422383 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs podName:c47dc45f-db50-4216-923a-4ef2c5d1e856 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:55.42236385 +0000 UTC m=+5.954244937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs") pod "network-metrics-daemon-kr8b2" (UID: "c47dc45f-db50-4216-923a-4ef2c5d1e856") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:53.523074 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.523033 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:53.523667 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.523236 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:53.523667 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.523312 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret podName:4fad74b0-68e8-431e-b017-89885b72b831 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:55.523293061 +0000 UTC m=+6.055174165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret") pod "global-pull-secret-syncer-fv4xz" (UID: "4fad74b0-68e8-431e-b017-89885b72b831") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:53.625001 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.624263 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:53.625001 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.624529 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:50:53.625001 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.624550 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:50:53.625001 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.624564 2584 projected.go:196] Error preparing data for projected volume kube-api-access-2xqk8 for pod openshift-network-diagnostics/network-check-target-47n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:53.625001 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.624637 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8 podName:9cacb46e-18e1-43ad-abe7-da9839a9f635 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:55.62461736 +0000 UTC m=+6.156498464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xqk8" (UniqueName: "kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8") pod "network-check-target-47n92" (UID: "9cacb46e-18e1-43ad-abe7-da9839a9f635") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:53.860072 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.859885 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 16:45:51 +0000 UTC" deadline="2028-02-20 00:41:35.704910194 +0000 UTC" Jul 29 16:50:53.860072 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.859944 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13687h50m41.844969833s" Jul 29 16:50:53.914717 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.914210 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:53.914717 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:53.914349 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:50:53.946972 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.946938 2584 generic.go:356] "Generic (PLEG): container finished" podID="c50392cdfc81e62409afa6293f6fa968" containerID="23f24c0280e44c9247b284c4c37ea567e59b1018c8465c993e9098eefa985c42" exitCode=0 Jul 29 16:50:53.947155 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.947047 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" event={"ID":"c50392cdfc81e62409afa6293f6fa968","Type":"ContainerDied","Data":"23f24c0280e44c9247b284c4c37ea567e59b1018c8465c993e9098eefa985c42"} Jul 29 16:50:53.961192 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:53.961145 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-232.ec2.internal" podStartSLOduration=2.961126654 podStartE2EDuration="2.961126654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:50:52.936108885 +0000 UTC m=+3.467989995" watchObservedRunningTime="2026-07-29 16:50:53.961126654 +0000 UTC m=+4.493007762" Jul 29 16:50:54.913032 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:54.912998 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:54.913659 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:54.913128 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:50:54.913659 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:54.913208 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:54.913659 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:54.913280 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:50:54.961218 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:54.961183 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" event={"ID":"c50392cdfc81e62409afa6293f6fa968","Type":"ContainerStarted","Data":"47e221e5d0951ca7334c05d54c11956a57fae6912aa2887cbb24f60f086c15c5"} Jul 29 16:50:54.978868 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:54.978814 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-232.ec2.internal" podStartSLOduration=3.978791169 podStartE2EDuration="3.978791169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:50:54.977959992 +0000 UTC m=+5.509841097" watchObservedRunningTime="2026-07-29 16:50:54.978791169 +0000 UTC m=+5.510672275" Jul 29 16:50:55.440352 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:55.440319 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:55.440630 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.440538 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:55.440630 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.440595 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs podName:c47dc45f-db50-4216-923a-4ef2c5d1e856 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:59.440576902 +0000 UTC m=+9.972457983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs") pod "network-metrics-daemon-kr8b2" (UID: "c47dc45f-db50-4216-923a-4ef2c5d1e856") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:55.541556 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:55.541520 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:55.541730 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.541674 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:55.541795 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.541745 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret podName:4fad74b0-68e8-431e-b017-89885b72b831 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:59.541723687 +0000 UTC m=+10.073604774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret") pod "global-pull-secret-syncer-fv4xz" (UID: "4fad74b0-68e8-431e-b017-89885b72b831") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:55.642947 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:55.642908 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:55.643149 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.643099 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:50:55.643149 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.643123 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:50:55.643149 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.643135 2584 projected.go:196] Error preparing data for projected volume kube-api-access-2xqk8 for pod openshift-network-diagnostics/network-check-target-47n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:55.643326 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.643192 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8 podName:9cacb46e-18e1-43ad-abe7-da9839a9f635 nodeName:}" failed. No retries permitted until 2026-07-29 16:50:59.643173834 +0000 UTC m=+10.175054923 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xqk8" (UniqueName: "kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8") pod "network-check-target-47n92" (UID: "9cacb46e-18e1-43ad-abe7-da9839a9f635") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:55.914910 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:55.914823 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:55.915333 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:55.914966 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:50:56.913627 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:56.913573 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:56.913802 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:56.913701 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:50:56.914136 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:56.914100 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:56.914225 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:56.914192 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:50:57.915026 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:57.914998 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:57.915478 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:57.915131 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:50:58.913113 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:58.913074 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:58.913285 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:58.913211 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:50:58.913610 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:58.913589 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:58.913726 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:58.913687 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:50:59.478460 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:59.478410 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:59.478893 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.478597 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:59.478893 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.478666 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs podName:c47dc45f-db50-4216-923a-4ef2c5d1e856 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:07.478645471 +0000 UTC m=+18.010526576 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs") pod "network-metrics-daemon-kr8b2" (UID: "c47dc45f-db50-4216-923a-4ef2c5d1e856") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:50:59.579061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:59.579024 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:50:59.579223 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.579168 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:59.579273 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.579238 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret podName:4fad74b0-68e8-431e-b017-89885b72b831 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:07.579218554 +0000 UTC m=+18.111099638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret") pod "global-pull-secret-syncer-fv4xz" (UID: "4fad74b0-68e8-431e-b017-89885b72b831") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:50:59.680264 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:59.680167 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:50:59.680426 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.680329 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:50:59.680426 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.680351 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:50:59.680426 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.680364 2584 projected.go:196] Error preparing data for projected volume kube-api-access-2xqk8 for pod openshift-network-diagnostics/network-check-target-47n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:59.680611 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.680429 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8 podName:9cacb46e-18e1-43ad-abe7-da9839a9f635 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:07.680411982 +0000 UTC m=+18.212293064 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xqk8" (UniqueName: "kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8") pod "network-check-target-47n92" (UID: "9cacb46e-18e1-43ad-abe7-da9839a9f635") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:50:59.914017 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:50:59.913623 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:50:59.914017 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:50:59.913780 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:00.913323 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:00.913287 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:00.913323 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:00.913322 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:00.913862 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:00.913421 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:00.913862 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:00.913530 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:01.913612 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:01.913578 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:01.914070 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:01.913730 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:02.913023 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:02.912990 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:02.913185 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:02.912989 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:02.913185 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:02.913122 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:02.913292 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:02.913206 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:03.912605 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:03.912532 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:03.913040 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:03.912668 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:04.913097 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:04.913059 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:04.913543 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:04.913060 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:04.913543 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:04.913196 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:04.913543 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:04.913291 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:05.912976 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:05.912945 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:05.913140 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:05.913080 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:06.912871 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:06.912823 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:06.913097 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:06.912888 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:06.913097 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:06.913007 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:06.913430 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:06.913137 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:07.540323 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:07.540281 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:07.540621 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.540465 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:07.540621 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.540539 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs podName:c47dc45f-db50-4216-923a-4ef2c5d1e856 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:23.540517948 +0000 UTC m=+34.072399053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs") pod "network-metrics-daemon-kr8b2" (UID: "c47dc45f-db50-4216-923a-4ef2c5d1e856") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:07.641321 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:07.641278 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:07.641517 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.641411 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:07.641517 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.641515 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret podName:4fad74b0-68e8-431e-b017-89885b72b831 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:23.641497272 +0000 UTC m=+34.173378371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret") pod "global-pull-secret-syncer-fv4xz" (UID: "4fad74b0-68e8-431e-b017-89885b72b831") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:07.742533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:07.742495 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:07.742710 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.742650 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:51:07.742710 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.742669 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:51:07.742710 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.742678 2584 projected.go:196] Error preparing data for projected volume kube-api-access-2xqk8 for pod openshift-network-diagnostics/network-check-target-47n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:07.742850 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.742733 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8 podName:9cacb46e-18e1-43ad-abe7-da9839a9f635 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:23.742716474 +0000 UTC m=+34.274597569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xqk8" (UniqueName: "kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8") pod "network-check-target-47n92" (UID: "9cacb46e-18e1-43ad-abe7-da9839a9f635") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:07.913159 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:07.913079 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:07.913585 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:07.913228 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:08.913366 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:08.913334 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:08.913791 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:08.913472 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:08.913791 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:08.913535 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:08.913791 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:08.913619 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:09.917628 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:09.917598 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:09.918062 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:09.917711 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:10.912831 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:10.912786 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:10.913021 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:10.912784 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:10.913021 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:10.912915 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:10.913021 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:10.912985 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:11.917609 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:11.917229 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:11.918394 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:11.917728 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:11.997317 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:11.997280 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-74k8g" event={"ID":"05bec12f-b245-492a-ba61-5c7622ae97d9","Type":"ContainerStarted","Data":"c691bbec31993c596fef61b62162d8ad3bf6144870cfe9737efac03e819f6c35"} Jul 29 16:51:12.000130 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.000096 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"bcf9f666f9f057dbfac05eeb0915c4a055ce4a26d8766c048b5d60d437e97aab"} Jul 29 16:51:12.000253 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.000155 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"9b6495bdc97a61c9e26fbc0fe42e43f04211bdb2f909e1619b1fb9e8eadcdda7"} Jul 29 16:51:12.000253 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.000192 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"8d839329ddcd8588d03f91d36c1b8d0837e1e6e383a5fd5cc2f39178581c24fe"} Jul 29 16:51:12.000253 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.000230 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"bf1ac0b03ad41effd2476fa52dff5490214968e7c9e5d8f7175b8409ad6b15d4"} Jul 29 16:51:12.000388 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.000262 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"2087d82e3158f66ed23879aaa640df685f4bef110e43914a3a0a6e5bbef72f70"} Jul 29 16:51:12.000388 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.000294 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"a7ff612840521e6306ae7fbf1e966da9a647719a1b563360b10105f265b78ba3"} Jul 29 16:51:12.001651 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.001628 2584 generic.go:356] "Generic (PLEG): container finished" podID="49db7fbb-4cff-41a5-901d-951954ce4d32" containerID="e8cd8737aef3ce5965830198f4ef8218ef925307368e520b4de09bebd4219845" exitCode=0 Jul 29 16:51:12.001748 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.001711 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" event={"ID":"49db7fbb-4cff-41a5-901d-951954ce4d32","Type":"ContainerDied","Data":"e8cd8737aef3ce5965830198f4ef8218ef925307368e520b4de09bebd4219845"} Jul 29 16:51:12.003272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.003173 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kxlmz" event={"ID":"3c69035b-a871-4e7c-b9ed-0ad59e5fd54b","Type":"ContainerStarted","Data":"5dcb7eac040e00299020b83799b0ed737ccaf4cf7f6cd045b782e47220e86ba7"} Jul 29 16:51:12.004643 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.004623 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mkttr" event={"ID":"4ead991e-a967-4953-8763-c5b779208e97","Type":"ContainerStarted","Data":"34a90e549dcdde6d63921ef9b384234d132bd286ddae154b88a675ac51576e95"} Jul 29 16:51:12.005952 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.005931 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9dl77" event={"ID":"7799e27e-e7b7-49c5-ab70-219172fcc3f6","Type":"ContainerStarted","Data":"45d95a7b5474c447cdc72333bf8bbccf2552a91360279f548fa8499961cf605a"} Jul 29 16:51:12.007215 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.007193 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cdt7n" event={"ID":"16de1a4e-c081-4a68-9d60-011c7049df50","Type":"ContainerStarted","Data":"a9335ab4d896b78dabda6c596c047d2edebed202e509fb9a6d22b922255e6399"} Jul 29 16:51:12.008538 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.008508 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" event={"ID":"dd634103-5fbd-47d0-8ac9-01b8972e0888","Type":"ContainerStarted","Data":"3e328772d6d055794ef9dae9070ccd9ba06c9c14a4fd19d0dfaa299b7934cb44"} Jul 29 16:51:12.017154 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.017116 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-74k8g" podStartSLOduration=3.636885246 podStartE2EDuration="22.017104941s" totalImagesPullingTime="18.380219695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:12.016815211 +0000 UTC m=+22.548696311" watchObservedRunningTime="2026-07-29 16:51:12.017104941 +0000 UTC m=+22.548986043" Jul 29 16:51:12.041840 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.041794 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kxlmz" podStartSLOduration=3.613287336 podStartE2EDuration="22.04177757s" totalImagesPullingTime="18.428490234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:12.041302928 +0000 UTC m=+22.573184031" watchObservedRunningTime="2026-07-29 16:51:12.04177757 +0000 UTC m=+22.573658673" Jul 29 16:51:12.060755 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.060704 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cdt7n" podStartSLOduration=4.677226416 podStartE2EDuration="23.060688427s" totalImagesPullingTime="18.383462011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:12.060551181 +0000 UTC m=+22.592432286" watchObservedRunningTime="2026-07-29 16:51:12.060688427 +0000 UTC m=+22.592569529" Jul 29 16:51:12.078500 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.078435 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9dl77" podStartSLOduration=4.705001301 podStartE2EDuration="23.078417126s" totalImagesPullingTime="18.373415825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:12.07802532 +0000 UTC m=+22.609906425" watchObservedRunningTime="2026-07-29 16:51:12.078417126 +0000 UTC m=+22.610298243" Jul 29 16:51:12.124226 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.124169 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mkttr" podStartSLOduration=3.750611448 podStartE2EDuration="22.124146408s" totalImagesPullingTime="18.37353496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:12.123551479 +0000 UTC m=+22.655432582" watchObservedRunningTime="2026-07-29 16:51:12.124146408 +0000 UTC m=+22.656027538" Jul 29 16:51:12.588909 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.588883 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 16:51:12.871022 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.870856 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T16:51:12.588903087Z","UUID":"44e81f29-2f29-41ef-b3fd-182b9e042c51","Handler":null,"Name":"","Endpoint":""} Jul 29 16:51:12.884016 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.883976 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 16:51:12.884194 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.884050 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 16:51:12.913141 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.913108 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:12.913327 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:12.913232 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:12.913327 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:12.913287 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:12.913424 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:12.913396 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:13.013367 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:13.013321 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x5b5q" event={"ID":"f0bfffac-dd64-4bca-b80f-96d637553acd","Type":"ContainerStarted","Data":"05eebc5ca1c058ac315a355de76232c12d0293aee9a3c30a4eb1714ad7d64b20"} Jul 29 16:51:13.017181 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:13.017155 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" event={"ID":"dd634103-5fbd-47d0-8ac9-01b8972e0888","Type":"ContainerStarted","Data":"ae53bf7b3104025b2b240827ca26bfc4eb266fd01a425fb197c3517189d4955a"} Jul 29 16:51:13.030438 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:13.030382 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x5b5q" podStartSLOduration=4.654307434 podStartE2EDuration="23.030362014s" totalImagesPullingTime="18.37605458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:13.029950859 +0000 UTC m=+23.561831972" watchObservedRunningTime="2026-07-29 16:51:13.030362014 +0000 UTC m=+23.562243118" Jul 29 16:51:13.912815 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:13.912728 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:13.912978 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:13.912867 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:14.021882 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:14.021842 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" event={"ID":"dd634103-5fbd-47d0-8ac9-01b8972e0888","Type":"ContainerStarted","Data":"5e988461c40f0a76c83b4891a873678d14766a645178d784388157982def8558"} Jul 29 16:51:14.026992 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:14.026966 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"9e6ef48ebe3702a135ff7442395b7e87e8b377f696586ee142d730f9c469c3eb"} Jul 29 16:51:14.042468 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:14.042410 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zb7qg" podStartSLOduration=3.623375777 podStartE2EDuration="24.04238946s" totalImagesPullingTime="20.419013683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:14.042240976 +0000 UTC m=+24.574122079" watchObservedRunningTime="2026-07-29 16:51:14.04238946 +0000 UTC m=+24.574270560" Jul 29 16:51:14.598249 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:14.598209 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:51:14.598821 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:14.598803 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:51:14.913462 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:14.913366 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:14.913633 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:14.913365 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:14.913633 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:14.913503 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:14.913633 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:14.913558 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:15.913431 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:15.913180 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:15.913881 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:15.913564 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:16.913524 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:16.913271 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:16.913524 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:16.913271 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:16.914206 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:16.913538 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:16.914206 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:16.913603 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:17.035906 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:17.035864 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" event={"ID":"425ce19e-afd9-4f87-960d-5ac72c5c025d","Type":"ContainerStarted","Data":"246621fda35e8ae0eaa09935a2ff1669dc6c713643952f68cc79fe1ea87c2dee"} Jul 29 16:51:17.036210 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:17.036190 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:51:17.037626 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:17.037598 2584 generic.go:356] "Generic (PLEG): container finished" podID="49db7fbb-4cff-41a5-901d-951954ce4d32" containerID="d8611a227d2e3989fb24f9fe9dc3ad6999c8b4780865f2b23585f7048653f787" exitCode=0 Jul 29 16:51:17.037726 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:17.037638 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" event={"ID":"49db7fbb-4cff-41a5-901d-951954ce4d32","Type":"ContainerDied","Data":"d8611a227d2e3989fb24f9fe9dc3ad6999c8b4780865f2b23585f7048653f787"} Jul 29 16:51:17.052594 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:17.052557 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:51:17.062121 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:17.062076 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" podStartSLOduration=9.621332772 podStartE2EDuration="28.06206276s" totalImagesPullingTime="18.440729988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:17.061596372 +0000 UTC m=+27.593477475" watchObservedRunningTime="2026-07-29 16:51:17.06206276 +0000 UTC m=+27.593943897" Jul 29 16:51:17.912927 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:17.912890 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:17.913102 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:17.913008 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:18.039654 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.039629 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:51:18.040004 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.039695 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:51:18.060773 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.060744 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:51:18.446043 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.445960 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fv4xz"] Jul 29 16:51:18.446176 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.446076 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:18.446176 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:18.446162 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:18.449204 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.449166 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-47n92"] Jul 29 16:51:18.449346 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.449276 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:18.449404 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:18.449371 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:18.449840 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.449806 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kr8b2"] Jul 29 16:51:18.449949 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:18.449913 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:18.450035 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:18.450014 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:19.043527 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:19.043490 2584 generic.go:356] "Generic (PLEG): container finished" podID="49db7fbb-4cff-41a5-901d-951954ce4d32" containerID="019e452fce7f247965720fa959ca5e44fa4370276873e6a0e4c35bebc06e0c28" exitCode=0 Jul 29 16:51:19.043996 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:19.043568 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" event={"ID":"49db7fbb-4cff-41a5-901d-951954ce4d32","Type":"ContainerDied","Data":"019e452fce7f247965720fa959ca5e44fa4370276873e6a0e4c35bebc06e0c28"} Jul 29 16:51:19.656864 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:19.656822 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:51:19.657059 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:19.656967 2584 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 16:51:19.657521 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:19.657502 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cdt7n" Jul 29 16:51:19.914328 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:19.914246 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:19.914491 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:19.914337 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:19.914491 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:19.914354 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:19.914491 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:19.914379 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:19.914597 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:19.914521 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:19.914597 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:19.914576 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:21.050270 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:21.050088 2584 generic.go:356] "Generic (PLEG): container finished" podID="49db7fbb-4cff-41a5-901d-951954ce4d32" containerID="09dfe5ce1f11f271bbae1a845e4088af4716f1c5e0ecf6b5ff8f5a8c86b8755c" exitCode=0 Jul 29 16:51:21.050814 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:21.050174 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" event={"ID":"49db7fbb-4cff-41a5-901d-951954ce4d32","Type":"ContainerDied","Data":"09dfe5ce1f11f271bbae1a845e4088af4716f1c5e0ecf6b5ff8f5a8c86b8755c"} Jul 29 16:51:21.913432 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:21.913360 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:21.913432 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:21.913383 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:21.913686 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:21.913366 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:21.913686 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:21.913546 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-47n92" podUID="9cacb46e-18e1-43ad-abe7-da9839a9f635" Jul 29 16:51:21.913686 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:21.913629 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fv4xz" podUID="4fad74b0-68e8-431e-b017-89885b72b831" Jul 29 16:51:21.913824 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:21.913724 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kr8b2" podUID="c47dc45f-db50-4216-923a-4ef2c5d1e856" Jul 29 16:51:23.563087 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.563046 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:23.563730 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:23.563230 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:23.563730 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:23.563297 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs podName:c47dc45f-db50-4216-923a-4ef2c5d1e856 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:55.563278767 +0000 UTC m=+66.095159856 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs") pod "network-metrics-daemon-kr8b2" (UID: "c47dc45f-db50-4216-923a-4ef2c5d1e856") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 16:51:23.663866 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.663832 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:23.664028 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:23.664010 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:23.664139 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:23.664119 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret podName:4fad74b0-68e8-431e-b017-89885b72b831 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:55.664071724 +0000 UTC m=+66.195952808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret") pod "global-pull-secret-syncer-fv4xz" (UID: "4fad74b0-68e8-431e-b017-89885b72b831") : object "kube-system"/"original-pull-secret" not registered Jul 29 16:51:23.764865 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.764824 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:23.765043 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:23.764987 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 16:51:23.765043 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:23.765009 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 16:51:23.765043 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:23.765019 2584 projected.go:196] Error preparing data for projected volume kube-api-access-2xqk8 for pod openshift-network-diagnostics/network-check-target-47n92: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:23.765211 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:23.765085 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8 podName:9cacb46e-18e1-43ad-abe7-da9839a9f635 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:55.765071509 +0000 UTC m=+66.296952591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2xqk8" (UniqueName: "kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8") pod "network-check-target-47n92" (UID: "9cacb46e-18e1-43ad-abe7-da9839a9f635") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 16:51:23.829130 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.829053 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-232.ec2.internal" event="NodeReady" Jul 29 16:51:23.829274 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.829194 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 16:51:23.895014 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.894977 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2svw7"] Jul 29 16:51:23.897159 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.897132 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:23.898084 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.898062 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-24v95"] Jul 29 16:51:23.899761 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.899743 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24v95" Jul 29 16:51:23.901073 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.901052 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 16:51:23.901073 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.901063 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 16:51:23.901229 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.901161 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t2pv4\"" Jul 29 16:51:23.906670 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.906609 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 16:51:23.906670 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.906654 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 16:51:23.906827 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.906609 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 16:51:23.906880 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.906831 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qnbt2\"" Jul 29 16:51:23.912855 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.912595 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:23.913240 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.913221 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:23.913675 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.913651 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:23.915226 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.915208 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 16:51:23.917151 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.917132 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2svw7"] Jul 29 16:51:23.917965 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.917928 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 16:51:23.918769 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.918747 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 16:51:23.918911 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.918769 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4k2w7\"" Jul 29 16:51:23.918911 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.918823 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 16:51:23.919045 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.919027 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skp6v\"" Jul 29 16:51:23.919615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:23.919583 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24v95"] Jul 29 16:51:24.067119 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.067089 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gft7\" (UniqueName: \"kubernetes.io/projected/402d5528-ce3f-43cf-96ee-b86c48acfbf8-kube-api-access-5gft7\") pod \"ingress-canary-24v95\" (UID: \"402d5528-ce3f-43cf-96ee-b86c48acfbf8\") " pod="openshift-ingress-canary/ingress-canary-24v95" Jul 29 16:51:24.067307 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.067126 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.067307 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.067220 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/402d5528-ce3f-43cf-96ee-b86c48acfbf8-cert\") pod \"ingress-canary-24v95\" (UID: \"402d5528-ce3f-43cf-96ee-b86c48acfbf8\") " pod="openshift-ingress-canary/ingress-canary-24v95" Jul 29 16:51:24.067307 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.067263 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ee6848e-fdb6-480e-88db-5d44a713a3e5-config-volume\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.067307 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.067287 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee6848e-fdb6-480e-88db-5d44a713a3e5-tmp-dir\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.067520 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.067361 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv4r4\" (UniqueName: \"kubernetes.io/projected/6ee6848e-fdb6-480e-88db-5d44a713a3e5-kube-api-access-dv4r4\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.168157 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.168074 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv4r4\" (UniqueName: \"kubernetes.io/projected/6ee6848e-fdb6-480e-88db-5d44a713a3e5-kube-api-access-dv4r4\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.168328 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.168166 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gft7\" (UniqueName: \"kubernetes.io/projected/402d5528-ce3f-43cf-96ee-b86c48acfbf8-kube-api-access-5gft7\") pod \"ingress-canary-24v95\" (UID: \"402d5528-ce3f-43cf-96ee-b86c48acfbf8\") " pod="openshift-ingress-canary/ingress-canary-24v95" Jul 29 16:51:24.168328 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.168182 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.168328 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.168227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/402d5528-ce3f-43cf-96ee-b86c48acfbf8-cert\") pod \"ingress-canary-24v95\" (UID: \"402d5528-ce3f-43cf-96ee-b86c48acfbf8\") " pod="openshift-ingress-canary/ingress-canary-24v95" Jul 29 16:51:24.168328 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.168252 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ee6848e-fdb6-480e-88db-5d44a713a3e5-config-volume\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.168328 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.168272 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee6848e-fdb6-480e-88db-5d44a713a3e5-tmp-dir\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.168563 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:24.168354 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:24.168563 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:24.168437 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls podName:6ee6848e-fdb6-480e-88db-5d44a713a3e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:24.668412633 +0000 UTC m=+35.200293730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls") pod "dns-default-2svw7" (UID: "6ee6848e-fdb6-480e-88db-5d44a713a3e5") : secret "dns-default-metrics-tls" not found Jul 29 16:51:24.168704 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.168685 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ee6848e-fdb6-480e-88db-5d44a713a3e5-tmp-dir\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.169020 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.168988 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6ee6848e-fdb6-480e-88db-5d44a713a3e5-config-volume\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.172946 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.172911 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/402d5528-ce3f-43cf-96ee-b86c48acfbf8-cert\") pod \"ingress-canary-24v95\" (UID: \"402d5528-ce3f-43cf-96ee-b86c48acfbf8\") " pod="openshift-ingress-canary/ingress-canary-24v95" Jul 29 16:51:24.177747 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.177716 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv4r4\" (UniqueName: \"kubernetes.io/projected/6ee6848e-fdb6-480e-88db-5d44a713a3e5-kube-api-access-dv4r4\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.178004 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.177978 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gft7\" (UniqueName: \"kubernetes.io/projected/402d5528-ce3f-43cf-96ee-b86c48acfbf8-kube-api-access-5gft7\") pod \"ingress-canary-24v95\" (UID: \"402d5528-ce3f-43cf-96ee-b86c48acfbf8\") " pod="openshift-ingress-canary/ingress-canary-24v95" Jul 29 16:51:24.215997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.215962 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24v95" Jul 29 16:51:24.671910 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:24.671876 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:24.672574 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:24.672050 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:24.672574 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:24.672128 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls podName:6ee6848e-fdb6-480e-88db-5d44a713a3e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:25.672110505 +0000 UTC m=+36.203991587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls") pod "dns-default-2svw7" (UID: "6ee6848e-fdb6-480e-88db-5d44a713a3e5") : secret "dns-default-metrics-tls" not found Jul 29 16:51:25.389792 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:25.389623 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24v95"] Jul 29 16:51:25.393133 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:51:25.393102 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402d5528_ce3f_43cf_96ee_b86c48acfbf8.slice/crio-eefafb0a44bc44f918ca75df328bc0c7ed4b8246e4e241e50d0c6c3385ce7ec2 WatchSource:0}: Error finding container eefafb0a44bc44f918ca75df328bc0c7ed4b8246e4e241e50d0c6c3385ce7ec2: Status 404 returned error can't find the container with id eefafb0a44bc44f918ca75df328bc0c7ed4b8246e4e241e50d0c6c3385ce7ec2 Jul 29 16:51:25.680263 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:25.680135 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:25.680656 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:25.680297 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:25.680656 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:25.680363 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls podName:6ee6848e-fdb6-480e-88db-5d44a713a3e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:27.680348933 +0000 UTC m=+38.212230014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls") pod "dns-default-2svw7" (UID: "6ee6848e-fdb6-480e-88db-5d44a713a3e5") : secret "dns-default-metrics-tls" not found Jul 29 16:51:26.065492 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:26.065439 2584 generic.go:356] "Generic (PLEG): container finished" podID="49db7fbb-4cff-41a5-901d-951954ce4d32" containerID="0de4d7e26e1090ac0609850969880f6dd62377b5b40235212cadf9ec6338ade6" exitCode=0 Jul 29 16:51:26.065492 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:26.065473 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" event={"ID":"49db7fbb-4cff-41a5-901d-951954ce4d32","Type":"ContainerDied","Data":"0de4d7e26e1090ac0609850969880f6dd62377b5b40235212cadf9ec6338ade6"} Jul 29 16:51:26.066561 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:26.066540 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24v95" event={"ID":"402d5528-ce3f-43cf-96ee-b86c48acfbf8","Type":"ContainerStarted","Data":"eefafb0a44bc44f918ca75df328bc0c7ed4b8246e4e241e50d0c6c3385ce7ec2"} Jul 29 16:51:27.072821 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:27.072789 2584 generic.go:356] "Generic (PLEG): container finished" podID="49db7fbb-4cff-41a5-901d-951954ce4d32" containerID="a0a77477549071c528adbac0e5de404c4320b912c398f150e0279af343b0b31f" exitCode=0 Jul 29 16:51:27.073328 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:27.072835 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" event={"ID":"49db7fbb-4cff-41a5-901d-951954ce4d32","Type":"ContainerDied","Data":"a0a77477549071c528adbac0e5de404c4320b912c398f150e0279af343b0b31f"} Jul 29 16:51:27.696990 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:27.696953 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:27.697173 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:27.697103 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:27.697173 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:27.697166 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls podName:6ee6848e-fdb6-480e-88db-5d44a713a3e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:31.697151004 +0000 UTC m=+42.229032085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls") pod "dns-default-2svw7" (UID: "6ee6848e-fdb6-480e-88db-5d44a713a3e5") : secret "dns-default-metrics-tls" not found Jul 29 16:51:28.079781 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:28.079570 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" event={"ID":"49db7fbb-4cff-41a5-901d-951954ce4d32","Type":"ContainerStarted","Data":"4ecf63aba41efe92263c5f225171f1c5e86e7697ba9bdc0cdd16402077182706"} Jul 29 16:51:28.105130 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:28.105084 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tbbxd" podStartSLOduration=9.041574265 podStartE2EDuration="38.10507019s" totalImagesPullingTime="29.063495925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:28.10412343 +0000 UTC m=+38.636004533" watchObservedRunningTime="2026-07-29 16:51:28.10507019 +0000 UTC m=+38.636951293" Jul 29 16:51:30.085210 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:30.085175 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24v95" event={"ID":"402d5528-ce3f-43cf-96ee-b86c48acfbf8","Type":"ContainerStarted","Data":"575c7819c031636d56785709fd522870b48923ab3cdd2cf1e75a774aa6c9075c"} Jul 29 16:51:30.101004 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:30.100949 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-24v95" podStartSLOduration=3.422508419 podStartE2EDuration="7.10093335s" totalImagesPullingTime="3.678424931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:30.100356583 +0000 UTC m=+40.632237686" watchObservedRunningTime="2026-07-29 16:51:30.10093335 +0000 UTC m=+40.632814452" Jul 29 16:51:31.725915 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:31.725873 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:31.726378 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:31.726058 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:31.726378 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:31.726140 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls podName:6ee6848e-fdb6-480e-88db-5d44a713a3e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:39.726120352 +0000 UTC m=+50.258001432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls") pod "dns-default-2svw7" (UID: "6ee6848e-fdb6-480e-88db-5d44a713a3e5") : secret "dns-default-metrics-tls" not found Jul 29 16:51:32.294614 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.294581 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz"] Jul 29 16:51:32.325941 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.325909 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz"] Jul 29 16:51:32.326090 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.326002 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.328597 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.328569 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 16:51:32.328597 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.328594 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 16:51:32.328812 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.328594 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:51:32.328812 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.328649 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 16:51:32.329584 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.329565 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-vtl68\"" Jul 29 16:51:32.329740 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.329719 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbtcj\" (UniqueName: \"kubernetes.io/projected/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-kube-api-access-bbtcj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.329841 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.329826 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.329905 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.329860 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.391120 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.391091 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg"] Jul 29 16:51:32.411919 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.411885 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5879bddfbc-j8vzs"] Jul 29 16:51:32.412066 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.412012 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.414139 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.414021 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 29 16:51:32.414501 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.414480 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 29 16:51:32.414592 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.414528 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 29 16:51:32.414830 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.414799 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 29 16:51:32.414932 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.414882 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5lm9f\"" Jul 29 16:51:32.429847 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.429825 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-gvw5p"] Jul 29 16:51:32.429967 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.429943 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.430343 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.430320 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szv62\" (UniqueName: \"kubernetes.io/projected/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-kube-api-access-szv62\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.430436 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.430386 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.430494 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.430478 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.430541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.430506 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.430541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.430531 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-config\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.430689 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.430670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbtcj\" (UniqueName: \"kubernetes.io/projected/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-kube-api-access-bbtcj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.432703 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.432671 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 16:51:32.432842 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.432818 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 16:51:32.433660 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.433124 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 16:51:32.433660 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.433323 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 16:51:32.433660 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.433618 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 16:51:32.433851 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.433732 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7995t\"" Jul 29 16:51:32.433851 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.433750 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 16:51:32.442746 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.442715 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.442852 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.442762 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.442899 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.442880 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbtcj\" (UniqueName: \"kubernetes.io/projected/e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025-kube-api-access-bbtcj\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-698fz\" (UID: \"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.446945 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.446929 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg"] Jul 29 16:51:32.447033 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.446952 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.447033 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.446972 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-gvw5p"] Jul 29 16:51:32.447033 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.446994 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5879bddfbc-j8vzs"] Jul 29 16:51:32.449148 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.449130 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 16:51:32.449252 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.449225 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 16:51:32.449252 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.449274 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 16:51:32.449525 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.449491 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 16:51:32.449646 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.449607 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q9hz4\"" Jul 29 16:51:32.454286 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.454265 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 16:51:32.494865 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.492801 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54fc6564d6-k9mst"] Jul 29 16:51:32.503055 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.503026 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.505457 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.505407 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 29 16:51:32.505691 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.505496 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 29 16:51:32.505691 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.505584 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 29 16:51:32.505828 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.505742 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c57j4\"" Jul 29 16:51:32.510087 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.510065 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54fc6564d6-k9mst"] Jul 29 16:51:32.510916 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.510894 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 29 16:51:32.531424 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531396 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-snapshots\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.531424 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531427 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531465 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwt28\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-kube-api-access-jwt28\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531507 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531545 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-tmp\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531579 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-service-ca-bundle\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531598 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-registry-certificates\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531612 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-bound-sa-token\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531629 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-image-registry-private-configuration\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531648 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-config\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.531667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531667 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-stats-auth\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531689 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-serving-cert\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531724 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-installation-pull-secrets\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531754 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531779 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv7ch\" (UniqueName: \"kubernetes.io/projected/17603800-dff1-4f82-95a7-743a7f2d5498-kube-api-access-pv7ch\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531806 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98e5f968-3a68-42e3-84dd-37301106e2db-ca-trust-extracted\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531835 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szv62\" (UniqueName: \"kubernetes.io/projected/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-kube-api-access-szv62\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531862 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531941 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-default-certificate\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.531986 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-trusted-ca\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.532035 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.532012 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z8sp\" (UniqueName: \"kubernetes.io/projected/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-kube-api-access-4z8sp\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.532431 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.532197 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-config\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.533821 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.533803 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-serving-cert\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.556508 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.555901 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szv62\" (UniqueName: \"kubernetes.io/projected/9faedbd4-51a4-4538-bdb9-d6a8c044ffd5-kube-api-access-szv62\") pod \"service-ca-operator-5d6c75f84f-4n5sg\" (UID: \"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.633159 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633124 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-stats-auth\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.633159 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633159 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-serving-cert\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.633361 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633191 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-installation-pull-secrets\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.633361 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633211 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.633361 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:32.633285 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 16:51:32.633361 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7ch\" (UniqueName: \"kubernetes.io/projected/17603800-dff1-4f82-95a7-743a7f2d5498-kube-api-access-pv7ch\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.633361 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:32.633345 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:33.133326063 +0000 UTC m=+43.665207163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : secret "router-metrics-certs-default" not found Jul 29 16:51:32.633615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633377 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98e5f968-3a68-42e3-84dd-37301106e2db-ca-trust-extracted\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.633615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633410 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.633615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633433 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.633615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-default-certificate\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.633615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633514 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-trusted-ca\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.633615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633538 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z8sp\" (UniqueName: \"kubernetes.io/projected/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-kube-api-access-4z8sp\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.633615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633574 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-snapshots\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.633615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633602 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.633997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633631 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwt28\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-kube-api-access-jwt28\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.633997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633685 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-tmp\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.633997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633722 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-service-ca-bundle\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.633997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633749 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-registry-certificates\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.633997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633772 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-bound-sa-token\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.633997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633769 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98e5f968-3a68-42e3-84dd-37301106e2db-ca-trust-extracted\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.633997 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.633826 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-image-registry-private-configuration\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.634322 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:32.633603 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:32.634322 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:32.634080 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fc6564d6-k9mst: secret "image-registry-tls" not found Jul 29 16:51:32.634430 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.634356 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-snapshots\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.635420 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.634535 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-tmp\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.635420 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.634655 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.635420 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.635047 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-registry-certificates\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.635420 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:32.634059 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:33.134044002 +0000 UTC m=+43.665925084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : configmap references non-existent config key: service-ca.crt Jul 29 16:51:32.635420 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.635095 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-trusted-ca\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.635420 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:32.635111 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls podName:98e5f968-3a68-42e3-84dd-37301106e2db nodeName:}" failed. No retries permitted until 2026-07-29 16:51:33.135082967 +0000 UTC m=+43.666964058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls") pod "image-registry-54fc6564d6-k9mst" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db") : secret "image-registry-tls" not found Jul 29 16:51:32.635420 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.635183 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" Jul 29 16:51:32.635420 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.635383 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-service-ca-bundle\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.636240 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.636221 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-serving-cert\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.636353 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.636321 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-installation-pull-secrets\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.636409 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.636394 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-stats-auth\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.636716 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.636694 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-image-registry-private-configuration\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.636964 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.636948 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-default-certificate\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.645297 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.645276 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv7ch\" (UniqueName: \"kubernetes.io/projected/17603800-dff1-4f82-95a7-743a7f2d5498-kube-api-access-pv7ch\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:32.645729 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.645711 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-bound-sa-token\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.645871 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.645847 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwt28\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-kube-api-access-jwt28\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:32.646247 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.646232 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z8sp\" (UniqueName: \"kubernetes.io/projected/7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d-kube-api-access-4z8sp\") pod \"insights-operator-5885fdb759-gvw5p\" (UID: \"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d\") " pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.722459 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.722411 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" Jul 29 16:51:32.755984 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.755945 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-gvw5p" Jul 29 16:51:32.800559 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.800506 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz"] Jul 29 16:51:32.804115 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:51:32.804081 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c18a3e_efc5_4a0d_9a72_3b3fd35d9025.slice/crio-b5ce93015243afb26dfe534b407e5a5ff8644c708ad8050a986091a8ff106796 WatchSource:0}: Error finding container b5ce93015243afb26dfe534b407e5a5ff8644c708ad8050a986091a8ff106796: Status 404 returned error can't find the container with id b5ce93015243afb26dfe534b407e5a5ff8644c708ad8050a986091a8ff106796 Jul 29 16:51:32.869352 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.869316 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg"] Jul 29 16:51:32.873125 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:51:32.873095 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9faedbd4_51a4_4538_bdb9_d6a8c044ffd5.slice/crio-c1f254235af9e73cd612868a7ac6c77828bb1436cc96b679d3119311af11d83f WatchSource:0}: Error finding container c1f254235af9e73cd612868a7ac6c77828bb1436cc96b679d3119311af11d83f: Status 404 returned error can't find the container with id c1f254235af9e73cd612868a7ac6c77828bb1436cc96b679d3119311af11d83f Jul 29 16:51:32.908868 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:32.908796 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-gvw5p"] Jul 29 16:51:32.912188 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:51:32.912163 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1bcd0b_c46f_4bbb_b308_0f11628b6c9d.slice/crio-2e22f532f770d710da081cf3458ac86852985f122795050d35ae6190793ed0cf WatchSource:0}: Error finding container 2e22f532f770d710da081cf3458ac86852985f122795050d35ae6190793ed0cf: Status 404 returned error can't find the container with id 2e22f532f770d710da081cf3458ac86852985f122795050d35ae6190793ed0cf Jul 29 16:51:33.092615 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:33.092528 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-gvw5p" event={"ID":"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d","Type":"ContainerStarted","Data":"2e22f532f770d710da081cf3458ac86852985f122795050d35ae6190793ed0cf"} Jul 29 16:51:33.093619 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:33.093594 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" event={"ID":"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5","Type":"ContainerStarted","Data":"c1f254235af9e73cd612868a7ac6c77828bb1436cc96b679d3119311af11d83f"} Jul 29 16:51:33.094640 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:33.094614 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" event={"ID":"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025","Type":"ContainerStarted","Data":"b5ce93015243afb26dfe534b407e5a5ff8644c708ad8050a986091a8ff106796"} Jul 29 16:51:33.138191 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:33.138164 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:33.138318 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:33.138220 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:33.138318 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:33.138278 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:33.138420 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:33.138323 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:33.138420 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:33.138344 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fc6564d6-k9mst: secret "image-registry-tls" not found Jul 29 16:51:33.138420 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:33.138361 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 16:51:33.138420 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:33.138399 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls podName:98e5f968-3a68-42e3-84dd-37301106e2db nodeName:}" failed. No retries permitted until 2026-07-29 16:51:34.138382838 +0000 UTC m=+44.670263923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls") pod "image-registry-54fc6564d6-k9mst" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db") : secret "image-registry-tls" not found Jul 29 16:51:33.138420 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:33.138420 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:34.13841501 +0000 UTC m=+44.670296091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : secret "router-metrics-certs-default" not found Jul 29 16:51:33.138617 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:33.138432 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:34.138426199 +0000 UTC m=+44.670307280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : configmap references non-existent config key: service-ca.crt Jul 29 16:51:34.146416 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:34.146382 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:34.146936 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:34.146572 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:36.146555272 +0000 UTC m=+46.678436353 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : configmap references non-existent config key: service-ca.crt Jul 29 16:51:34.146936 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:34.146866 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:34.146936 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:34.146902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:34.147117 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:34.147027 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:34.147117 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:34.147042 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fc6564d6-k9mst: secret "image-registry-tls" not found Jul 29 16:51:34.147117 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:34.147085 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls podName:98e5f968-3a68-42e3-84dd-37301106e2db nodeName:}" failed. No retries permitted until 2026-07-29 16:51:36.147070472 +0000 UTC m=+46.678951566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls") pod "image-registry-54fc6564d6-k9mst" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db") : secret "image-registry-tls" not found Jul 29 16:51:34.147238 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:34.147138 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 16:51:34.147238 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:34.147172 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:36.147162312 +0000 UTC m=+46.679043396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : secret "router-metrics-certs-default" not found Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:36.165585 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:36.165701 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:36.165744 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:36.165771 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:40.16574724 +0000 UTC m=+50.697628321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : configmap references non-existent config key: service-ca.crt Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:36.165833 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:36.165846 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fc6564d6-k9mst: secret "image-registry-tls" not found Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:36.165896 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls podName:98e5f968-3a68-42e3-84dd-37301106e2db nodeName:}" failed. No retries permitted until 2026-07-29 16:51:40.16588056 +0000 UTC m=+50.697761658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls") pod "image-registry-54fc6564d6-k9mst" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db") : secret "image-registry-tls" not found Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:36.165961 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 16:51:36.165626 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:36.165993 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:40.165983449 +0000 UTC m=+50.697864531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : secret "router-metrics-certs-default" not found Jul 29 16:51:37.107883 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.107843 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-gvw5p" event={"ID":"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d","Type":"ContainerStarted","Data":"4dbd3d03d03b8894119502b6dbd7db4844d457d2e0bed9977689cca74a6d5032"} Jul 29 16:51:37.110297 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.109890 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" event={"ID":"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5","Type":"ContainerStarted","Data":"efe5139568128c1e32b7bf70dee770e9080f5a7e8a942a8644419436c555dbb8"} Jul 29 16:51:37.124887 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.124677 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-gvw5p" podStartSLOduration=1.9358086559999998 podStartE2EDuration="5.124656643s" totalImagesPullingTime="3.188847987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:37.124213323 +0000 UTC m=+47.656094427" watchObservedRunningTime="2026-07-29 16:51:37.124656643 +0000 UTC m=+47.656537759" Jul 29 16:51:37.613421 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.613369 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" podStartSLOduration=2.380070367 podStartE2EDuration="5.613350298s" totalImagesPullingTime="3.233279931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:37.142147214 +0000 UTC m=+47.674028318" watchObservedRunningTime="2026-07-29 16:51:37.613350298 +0000 UTC m=+48.145231401" Jul 29 16:51:37.613918 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.613627 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ggsnt"] Jul 29 16:51:37.634044 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.634018 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.637401 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.637370 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5k2d8\"" Jul 29 16:51:37.639058 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.639038 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 16:51:37.639171 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.639040 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 16:51:37.640735 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.640711 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ggsnt"] Jul 29 16:51:37.680284 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.680256 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxw2f\" (UniqueName: \"kubernetes.io/projected/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-api-access-mxw2f\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.680437 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.680314 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.680437 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.680369 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.680533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.680486 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-data-volume\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.680533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.680516 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-crio-socket\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.781724 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.781698 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.781846 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.781777 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-data-volume\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.781846 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.781817 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-crio-socket\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.781846 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:37.781833 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 16:51:37.781994 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.781855 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxw2f\" (UniqueName: \"kubernetes.io/projected/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-api-access-mxw2f\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.781994 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:37.781898 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:38.281878552 +0000 UTC m=+48.813759634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : secret "insights-runtime-extractor-tls" not found Jul 29 16:51:37.781994 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.781955 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.782141 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.782055 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-crio-socket\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.782141 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:37.782100 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 16:51:37.782141 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.782117 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-data-volume\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:37.782260 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:37.782139 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:38.282127218 +0000 UTC m=+48.814008317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : configmap "kube-rbac-proxy" not found Jul 29 16:51:37.792568 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:37.792548 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxw2f\" (UniqueName: \"kubernetes.io/projected/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-api-access-mxw2f\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:38.114493 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:38.114439 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" event={"ID":"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025","Type":"ContainerStarted","Data":"36b41b8108e2e9a6cc6c54fdf916e5ad5a5b462befb27d57f5597418c2e5ce35"} Jul 29 16:51:38.132523 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:38.132473 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" podStartSLOduration=1.253251817 podStartE2EDuration="6.132434981s" totalImagesPullingTime="4.879183164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:38.131587437 +0000 UTC m=+48.663468553" watchObservedRunningTime="2026-07-29 16:51:38.132434981 +0000 UTC m=+48.664316084" Jul 29 16:51:38.286994 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:38.286956 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:38.287214 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:38.287025 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:38.287214 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:38.287091 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 16:51:38.287214 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:38.287142 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 16:51:38.287214 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:38.287168 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:39.287152008 +0000 UTC m=+49.819033109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : configmap "kube-rbac-proxy" not found Jul 29 16:51:38.287214 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:38.287190 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:39.287174788 +0000 UTC m=+49.819055868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : secret "insights-runtime-extractor-tls" not found Jul 29 16:51:39.296700 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:39.296660 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:39.297107 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:39.296726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:39.297107 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:39.296792 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 16:51:39.297107 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:39.296818 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 16:51:39.297107 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:39.296879 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:41.296861923 +0000 UTC m=+51.828743004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : configmap "kube-rbac-proxy" not found Jul 29 16:51:39.297107 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:39.296894 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:41.29688789 +0000 UTC m=+51.828768970 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : secret "insights-runtime-extractor-tls" not found Jul 29 16:51:39.363254 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:39.363227 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-74k8g_05bec12f-b245-492a-ba61-5c7622ae97d9/dns-node-resolver/0.log" Jul 29 16:51:39.800427 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:39.800388 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:39.800614 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:39.800560 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 16:51:39.800656 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:39.800620 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls podName:6ee6848e-fdb6-480e-88db-5d44a713a3e5 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:55.800602425 +0000 UTC m=+66.332483517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls") pod "dns-default-2svw7" (UID: "6ee6848e-fdb6-480e-88db-5d44a713a3e5") : secret "dns-default-metrics-tls" not found Jul 29 16:51:40.203415 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:40.203377 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:40.203605 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:40.203438 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:40.203605 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:40.203510 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:40.203605 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:40.203553 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 16:51:40.203790 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:40.203618 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:48.203603087 +0000 UTC m=+58.735484167 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : secret "router-metrics-certs-default" not found Jul 29 16:51:40.203790 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:40.203639 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:40.203790 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:40.203657 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fc6564d6-k9mst: secret "image-registry-tls" not found Jul 29 16:51:40.203790 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:40.203682 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:51:48.203666276 +0000 UTC m=+58.735547360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : configmap references non-existent config key: service-ca.crt Jul 29 16:51:40.203790 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:40.203708 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls podName:98e5f968-3a68-42e3-84dd-37301106e2db nodeName:}" failed. No retries permitted until 2026-07-29 16:51:48.203697814 +0000 UTC m=+58.735578895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls") pod "image-registry-54fc6564d6-k9mst" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db") : secret "image-registry-tls" not found Jul 29 16:51:40.564058 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:40.563982 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mkttr_4ead991e-a967-4953-8763-c5b779208e97/node-ca/0.log" Jul 29 16:51:41.164856 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:41.164825 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24v95_402d5528-ce3f-43cf-96ee-b86c48acfbf8/serve-healthcheck-canary/0.log" Jul 29 16:51:41.313117 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:41.313061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:41.313303 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:41.313158 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:41.313303 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:41.313192 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 16:51:41.313303 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:41.313251 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:45.313237666 +0000 UTC m=+55.845118748 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : configmap "kube-rbac-proxy" not found Jul 29 16:51:41.313415 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:41.313311 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 16:51:41.313415 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:41.313368 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:45.313354457 +0000 UTC m=+55.845235538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : secret "insights-runtime-extractor-tls" not found Jul 29 16:51:45.346943 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:45.346902 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:45.347493 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:45.346967 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:45.347493 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:45.347014 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 16:51:45.347493 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:45.347069 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 16:51:45.347493 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:45.347079 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:53.34706388 +0000 UTC m=+63.878944960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : configmap "kube-rbac-proxy" not found Jul 29 16:51:45.347493 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:45.347108 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:51:53.347096942 +0000 UTC m=+63.878978023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : secret "insights-runtime-extractor-tls" not found Jul 29 16:51:48.271577 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:48.271529 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:48.272030 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:48.271591 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls\") pod \"image-registry-54fc6564d6-k9mst\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:51:48.272030 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:48.271646 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:51:48.272030 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:48.271696 2584 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 16:51:48.272030 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:48.271745 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 29 16:51:48.272030 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:48.271761 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-54fc6564d6-k9mst: secret "image-registry-tls" not found Jul 29 16:51:48.272030 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:48.271783 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:04.271761916 +0000 UTC m=+74.803643012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : secret "router-metrics-certs-default" not found Jul 29 16:51:48.272030 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:48.271801 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle podName:17603800-dff1-4f82-95a7-743a7f2d5498 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:04.271792851 +0000 UTC m=+74.803673933 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle") pod "router-default-5879bddfbc-j8vzs" (UID: "17603800-dff1-4f82-95a7-743a7f2d5498") : configmap references non-existent config key: service-ca.crt Jul 29 16:51:48.272030 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:48.271811 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls podName:98e5f968-3a68-42e3-84dd-37301106e2db nodeName:}" failed. No retries permitted until 2026-07-29 16:52:04.271806595 +0000 UTC m=+74.803687676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls") pod "image-registry-54fc6564d6-k9mst" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db") : secret "image-registry-tls" not found Jul 29 16:51:50.060677 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:50.060650 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rt4hb" Jul 29 16:51:53.416042 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:53.416002 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:53.416553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:53.416068 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:53.416553 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:53.416193 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 16:51:53.416553 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:51:53.416251 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls podName:9cc6ab97-8223-4efb-8ee9-72375e0dcd7d nodeName:}" failed. No retries permitted until 2026-07-29 16:52:09.41623409 +0000 UTC m=+79.948115172 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ggsnt" (UID: "9cc6ab97-8223-4efb-8ee9-72375e0dcd7d") : secret "insights-runtime-extractor-tls" not found Jul 29 16:51:53.416743 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:53.416717 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:51:55.632824 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.632784 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:55.635594 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.635574 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 16:51:55.645786 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.645754 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c47dc45f-db50-4216-923a-4ef2c5d1e856-metrics-certs\") pod \"network-metrics-daemon-kr8b2\" (UID: \"c47dc45f-db50-4216-923a-4ef2c5d1e856\") " pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:55.733519 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.733480 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:55.735950 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.735933 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 16:51:55.736491 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.736477 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-skp6v\"" Jul 29 16:51:55.744647 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.744628 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kr8b2" Jul 29 16:51:55.746869 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.746840 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4fad74b0-68e8-431e-b017-89885b72b831-original-pull-secret\") pod \"global-pull-secret-syncer-fv4xz\" (UID: \"4fad74b0-68e8-431e-b017-89885b72b831\") " pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:55.834275 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.834244 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:55.834420 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.834297 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:55.837036 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.837003 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6ee6848e-fdb6-480e-88db-5d44a713a3e5-metrics-tls\") pod \"dns-default-2svw7\" (UID: \"6ee6848e-fdb6-480e-88db-5d44a713a3e5\") " pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:55.837264 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.837246 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 16:51:55.847793 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.847772 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 16:51:55.858147 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.858126 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqk8\" (UniqueName: \"kubernetes.io/projected/9cacb46e-18e1-43ad-abe7-da9839a9f635-kube-api-access-2xqk8\") pod \"network-check-target-47n92\" (UID: \"9cacb46e-18e1-43ad-abe7-da9839a9f635\") " pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:55.869579 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:55.869555 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kr8b2"] Jul 29 16:51:55.872459 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:51:55.872420 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc47dc45f_db50_4216_923a_4ef2c5d1e856.slice/crio-3ff148af226c3134551f931e2a6b741577c26f854403313093bfc97640b280df WatchSource:0}: Error finding container 3ff148af226c3134551f931e2a6b741577c26f854403313093bfc97640b280df: Status 404 returned error can't find the container with id 3ff148af226c3134551f931e2a6b741577c26f854403313093bfc97640b280df Jul 29 16:51:56.011358 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.011332 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t2pv4\"" Jul 29 16:51:56.019512 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.019496 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:56.027143 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.027111 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fv4xz" Jul 29 16:51:56.044357 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.044334 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4k2w7\"" Jul 29 16:51:56.053258 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.053234 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:51:56.161863 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.161828 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kr8b2" event={"ID":"c47dc45f-db50-4216-923a-4ef2c5d1e856","Type":"ContainerStarted","Data":"3ff148af226c3134551f931e2a6b741577c26f854403313093bfc97640b280df"} Jul 29 16:51:56.162697 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.162674 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2svw7"] Jul 29 16:51:56.165937 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:51:56.165911 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee6848e_fdb6_480e_88db_5d44a713a3e5.slice/crio-b80d4ae9a7c82d5897c0c71d4b440054787ba210f31c10d0dcc8e22dd345e05f WatchSource:0}: Error finding container b80d4ae9a7c82d5897c0c71d4b440054787ba210f31c10d0dcc8e22dd345e05f: Status 404 returned error can't find the container with id b80d4ae9a7c82d5897c0c71d4b440054787ba210f31c10d0dcc8e22dd345e05f Jul 29 16:51:56.176683 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.176659 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fv4xz"] Jul 29 16:51:56.179535 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:51:56.179503 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fad74b0_68e8_431e_b017_89885b72b831.slice/crio-96844f6251f9cb318a66a96f55e3b63f8da53770f93184ddfb59f136f8dd4fa9 WatchSource:0}: Error finding container 96844f6251f9cb318a66a96f55e3b63f8da53770f93184ddfb59f136f8dd4fa9: Status 404 returned error can't find the container with id 96844f6251f9cb318a66a96f55e3b63f8da53770f93184ddfb59f136f8dd4fa9 Jul 29 16:51:56.204915 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:56.204895 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-47n92"] Jul 29 16:51:56.207347 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:51:56.207319 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cacb46e_18e1_43ad_abe7_da9839a9f635.slice/crio-468727a7a8ae39e759454132ef66b7b594d30cb4ccaee31d5ca041844946a405 WatchSource:0}: Error finding container 468727a7a8ae39e759454132ef66b7b594d30cb4ccaee31d5ca041844946a405: Status 404 returned error can't find the container with id 468727a7a8ae39e759454132ef66b7b594d30cb4ccaee31d5ca041844946a405 Jul 29 16:51:57.166004 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:57.165961 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-47n92" event={"ID":"9cacb46e-18e1-43ad-abe7-da9839a9f635","Type":"ContainerStarted","Data":"468727a7a8ae39e759454132ef66b7b594d30cb4ccaee31d5ca041844946a405"} Jul 29 16:51:57.167015 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:57.166989 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2svw7" event={"ID":"6ee6848e-fdb6-480e-88db-5d44a713a3e5","Type":"ContainerStarted","Data":"b80d4ae9a7c82d5897c0c71d4b440054787ba210f31c10d0dcc8e22dd345e05f"} Jul 29 16:51:57.168004 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:57.167976 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fv4xz" event={"ID":"4fad74b0-68e8-431e-b017-89885b72b831","Type":"ContainerStarted","Data":"96844f6251f9cb318a66a96f55e3b63f8da53770f93184ddfb59f136f8dd4fa9"} Jul 29 16:51:58.176297 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:58.175269 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kr8b2" event={"ID":"c47dc45f-db50-4216-923a-4ef2c5d1e856","Type":"ContainerStarted","Data":"785e2ada9cbe6593c497d12caf56be495709368fb25865372729c1e177700c30"} Jul 29 16:51:58.176297 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:58.175345 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kr8b2" event={"ID":"c47dc45f-db50-4216-923a-4ef2c5d1e856","Type":"ContainerStarted","Data":"c9ce8b4b13d31c1feef5183603c7bb124cfc2170daa6d35ba104a36a372883ad"} Jul 29 16:51:58.198813 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:58.198753 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kr8b2" podStartSLOduration=67.808446727 podStartE2EDuration="1m9.198734114s" totalImagesPullingTime="1.390287387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:58.197828994 +0000 UTC m=+68.729710103" watchObservedRunningTime="2026-07-29 16:51:58.198734114 +0000 UTC m=+68.730615219" Jul 29 16:51:59.182394 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:59.182062 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2svw7" event={"ID":"6ee6848e-fdb6-480e-88db-5d44a713a3e5","Type":"ContainerStarted","Data":"b5d26c3511f67447baab7b7ee1503d9c087f87c0eff060c803e8f1df0dd53a6c"} Jul 29 16:51:59.182394 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:59.182126 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2svw7" event={"ID":"6ee6848e-fdb6-480e-88db-5d44a713a3e5","Type":"ContainerStarted","Data":"dae22722acc0a163a817d2d4966ee43f34759b1adb7471dc1168a5affc8e9add"} Jul 29 16:51:59.182394 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:59.182258 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2svw7" Jul 29 16:51:59.206037 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:51:59.205785 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2svw7" podStartSLOduration=33.413093452 podStartE2EDuration="36.20576474s" totalImagesPullingTime="2.792671288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:51:59.204818907 +0000 UTC m=+69.736700010" watchObservedRunningTime="2026-07-29 16:51:59.20576474 +0000 UTC m=+69.737645820" Jul 29 16:52:00.889402 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:00.889361 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54fc6564d6-k9mst"] Jul 29 16:52:00.889832 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:52:00.889646 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" podUID="98e5f968-3a68-42e3-84dd-37301106e2db" Jul 29 16:52:00.992857 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:00.992806 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-686d6f5557-hbflv"] Jul 29 16:52:00.995576 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:00.995551 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.036331 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.036293 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-686d6f5557-hbflv"] Jul 29 16:52:01.083256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.083221 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-ca-trust-extracted\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.083256 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.083266 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-bound-sa-token\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.083543 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.083306 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-registry-certificates\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.083543 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.083342 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngp9q\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-kube-api-access-ngp9q\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.083543 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.083417 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-installation-pull-secrets\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.083543 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.083482 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-trusted-ca\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.083543 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.083512 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-registry-tls\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.083543 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.083543 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-image-registry-private-configuration\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185005 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.184924 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-trusted-ca\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185005 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.184969 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-registry-tls\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185233 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.185065 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-image-registry-private-configuration\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185233 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.185133 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-ca-trust-extracted\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185233 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.185160 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-bound-sa-token\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185233 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.185186 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-registry-certificates\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185382 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.185242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngp9q\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-kube-api-access-ngp9q\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185382 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.185336 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-installation-pull-secrets\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.185937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.185905 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-ca-trust-extracted\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.186084 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.185959 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-registry-certificates\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.186084 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.186040 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-trusted-ca\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.187914 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.187888 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-installation-pull-secrets\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.188202 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.188180 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-image-registry-private-configuration\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.188289 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.188273 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-registry-tls\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.189348 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.189327 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:52:01.196689 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.196670 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-bound-sa-token\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.199816 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.199513 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngp9q\" (UniqueName: \"kubernetes.io/projected/9ac920e7-7b70-4c5e-ade5-abfb3a0f7546-kube-api-access-ngp9q\") pod \"image-registry-686d6f5557-hbflv\" (UID: \"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546\") " pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.214929 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.214903 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:52:01.286095 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286050 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-bound-sa-token\") pod \"98e5f968-3a68-42e3-84dd-37301106e2db\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " Jul 29 16:52:01.286289 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286106 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwt28\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-kube-api-access-jwt28\") pod \"98e5f968-3a68-42e3-84dd-37301106e2db\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " Jul 29 16:52:01.286289 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286136 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98e5f968-3a68-42e3-84dd-37301106e2db-ca-trust-extracted\") pod \"98e5f968-3a68-42e3-84dd-37301106e2db\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " Jul 29 16:52:01.286289 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286173 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-image-registry-private-configuration\") pod \"98e5f968-3a68-42e3-84dd-37301106e2db\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " Jul 29 16:52:01.286289 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286274 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-installation-pull-secrets\") pod \"98e5f968-3a68-42e3-84dd-37301106e2db\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " Jul 29 16:52:01.286505 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286326 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-registry-certificates\") pod \"98e5f968-3a68-42e3-84dd-37301106e2db\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " Jul 29 16:52:01.286505 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286382 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-trusted-ca\") pod \"98e5f968-3a68-42e3-84dd-37301106e2db\" (UID: \"98e5f968-3a68-42e3-84dd-37301106e2db\") " Jul 29 16:52:01.286614 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286513 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98e5f968-3a68-42e3-84dd-37301106e2db-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "98e5f968-3a68-42e3-84dd-37301106e2db" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:52:01.286714 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286696 2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98e5f968-3a68-42e3-84dd-37301106e2db-ca-trust-extracted\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:01.286874 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.286800 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "98e5f968-3a68-42e3-84dd-37301106e2db" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:52:01.287081 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.287060 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "98e5f968-3a68-42e3-84dd-37301106e2db" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:52:01.288877 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.288850 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "98e5f968-3a68-42e3-84dd-37301106e2db" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:52:01.288983 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.288943 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "98e5f968-3a68-42e3-84dd-37301106e2db" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:52:01.289068 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.289049 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-kube-api-access-jwt28" (OuterVolumeSpecName: "kube-api-access-jwt28") pod "98e5f968-3a68-42e3-84dd-37301106e2db" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db"). InnerVolumeSpecName "kube-api-access-jwt28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:52:01.289142 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.289121 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "98e5f968-3a68-42e3-84dd-37301106e2db" (UID: "98e5f968-3a68-42e3-84dd-37301106e2db"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:52:01.308228 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.308197 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c57j4\"" Jul 29 16:52:01.316204 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.316177 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:01.387567 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.387533 2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-image-registry-private-configuration\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:01.387567 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.387562 2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98e5f968-3a68-42e3-84dd-37301106e2db-installation-pull-secrets\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:01.387567 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.387571 2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-registry-certificates\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:01.387836 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.387580 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98e5f968-3a68-42e3-84dd-37301106e2db-trusted-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:01.387836 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.387598 2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-bound-sa-token\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:01.387836 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.387608 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwt28\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-kube-api-access-jwt28\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:01.934786 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:01.934749 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-686d6f5557-hbflv"] Jul 29 16:52:02.194733 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.194652 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-47n92" event={"ID":"9cacb46e-18e1-43ad-abe7-da9839a9f635","Type":"ContainerStarted","Data":"bebd015ddfc2dc1315f96d864aea35abc8f4d76c67dca22ef9791ba62cba8215"} Jul 29 16:52:02.194889 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.194787 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:52:02.196511 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.196477 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-686d6f5557-hbflv" event={"ID":"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546","Type":"ContainerStarted","Data":"217c62907529bacdce0c428e65a73c95eb661c204c36a9af6076e86a8fc1a15b"} Jul 29 16:52:02.196672 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.196537 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-686d6f5557-hbflv" event={"ID":"9ac920e7-7b70-4c5e-ade5-abfb3a0f7546","Type":"ContainerStarted","Data":"d18655a58e1b70aa6c550098762faa81c08c7913cdf2c69cbc25f30b2bfce32b"} Jul 29 16:52:02.196672 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.196584 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:02.198213 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.198187 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fv4xz" event={"ID":"4fad74b0-68e8-431e-b017-89885b72b831","Type":"ContainerStarted","Data":"a5619bdf9f893dd517b3b37de54c015c9629d8ce8d3257de3431bf0a3f6fd94f"} Jul 29 16:52:02.198213 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.198207 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54fc6564d6-k9mst" Jul 29 16:52:02.218866 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.218812 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-47n92" podStartSLOduration=66.638459099 podStartE2EDuration="1m12.218794602s" totalImagesPullingTime="5.580335503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:02.218351007 +0000 UTC m=+72.750232109" watchObservedRunningTime="2026-07-29 16:52:02.218794602 +0000 UTC m=+72.750675717" Jul 29 16:52:02.257639 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.257580 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-686d6f5557-hbflv" podStartSLOduration=2.257558987 podStartE2EDuration="2.257558987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:02.257322997 +0000 UTC m=+72.789204100" watchObservedRunningTime="2026-07-29 16:52:02.257558987 +0000 UTC m=+72.789440091" Jul 29 16:52:02.311666 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.311609 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fv4xz" podStartSLOduration=66.697660789 podStartE2EDuration="1m12.311591767s" totalImagesPullingTime="5.613930978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:50:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:02.311215321 +0000 UTC m=+72.843096423" watchObservedRunningTime="2026-07-29 16:52:02.311591767 +0000 UTC m=+72.843472869" Jul 29 16:52:02.365697 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.365657 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-54fc6564d6-k9mst"] Jul 29 16:52:02.376976 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.376902 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-54fc6564d6-k9mst"] Jul 29 16:52:02.496216 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:02.496181 2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98e5f968-3a68-42e3-84dd-37301106e2db-registry-tls\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:03.916573 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:03.916539 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98e5f968-3a68-42e3-84dd-37301106e2db" path="/var/lib/kubelet/pods/98e5f968-3a68-42e3-84dd-37301106e2db/volumes" Jul 29 16:52:04.314372 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:04.314331 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:04.314579 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:04.314394 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:04.314979 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:04.314957 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17603800-dff1-4f82-95a7-743a7f2d5498-service-ca-bundle\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:04.316666 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:04.316643 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/17603800-dff1-4f82-95a7-743a7f2d5498-metrics-certs\") pod \"router-default-5879bddfbc-j8vzs\" (UID: \"17603800-dff1-4f82-95a7-743a7f2d5498\") " pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:04.549273 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:04.549243 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-7995t\"" Jul 29 16:52:04.556994 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:04.556973 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:04.685098 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:04.685064 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5879bddfbc-j8vzs"] Jul 29 16:52:04.689253 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:04.689227 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17603800_dff1_4f82_95a7_743a7f2d5498.slice/crio-88d732a251effa230288550899784552cece1a0fb498f862f9847297b8857a0a WatchSource:0}: Error finding container 88d732a251effa230288550899784552cece1a0fb498f862f9847297b8857a0a: Status 404 returned error can't find the container with id 88d732a251effa230288550899784552cece1a0fb498f862f9847297b8857a0a Jul 29 16:52:05.209797 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:05.209764 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" event={"ID":"17603800-dff1-4f82-95a7-743a7f2d5498","Type":"ContainerStarted","Data":"9cb79e42a6ad57798a4125f0ba8f5aa0287a2e138749089ac6bac3ef5460b061"} Jul 29 16:52:05.210181 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:05.209816 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" event={"ID":"17603800-dff1-4f82-95a7-743a7f2d5498","Type":"ContainerStarted","Data":"88d732a251effa230288550899784552cece1a0fb498f862f9847297b8857a0a"} Jul 29 16:52:05.233927 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:05.233876 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" podStartSLOduration=33.233859011 podStartE2EDuration="33.233859011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:05.233124598 +0000 UTC m=+75.765005700" watchObservedRunningTime="2026-07-29 16:52:05.233859011 +0000 UTC m=+75.765740105" Jul 29 16:52:05.558006 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:05.557921 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:05.560545 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:05.560519 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:06.214349 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:06.214318 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:06.215556 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:06.215533 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5879bddfbc-j8vzs" Jul 29 16:52:07.997122 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:07.995391 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5ccbc7c9fd-xt52s"] Jul 29 16:52:07.999549 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:07.999526 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.002950 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.002923 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 29 16:52:08.002950 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.002944 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 29 16:52:08.004025 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.004007 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 29 16:52:08.005157 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.005135 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 29 16:52:08.005272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.005197 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 29 16:52:08.005320 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.005303 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 29 16:52:08.006954 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.006938 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l9zrc\"" Jul 29 16:52:08.007854 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.007835 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 29 16:52:08.012074 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.012056 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ccbc7c9fd-xt52s"] Jul 29 16:52:08.143372 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.143338 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-service-ca\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.143569 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.143400 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-serving-cert\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.143569 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.143468 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-oauth-config\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.143569 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.143503 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmhrx\" (UniqueName: \"kubernetes.io/projected/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-kube-api-access-gmhrx\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.143569 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.143534 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-config\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.143698 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.143580 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-oauth-serving-cert\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.244251 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.244216 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-serving-cert\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.244251 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.244259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-oauth-config\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.244488 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.244278 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmhrx\" (UniqueName: \"kubernetes.io/projected/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-kube-api-access-gmhrx\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.244488 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.244296 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-config\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.244488 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.244341 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-oauth-serving-cert\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.244488 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.244391 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-service-ca\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.245106 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.245084 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-service-ca\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.245213 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.245134 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-config\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.245213 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.245134 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-oauth-serving-cert\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.246716 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.246692 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-oauth-config\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.246812 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.246715 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-serving-cert\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.254007 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.253956 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmhrx\" (UniqueName: \"kubernetes.io/projected/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-kube-api-access-gmhrx\") pod \"console-5ccbc7c9fd-xt52s\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.308172 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.308133 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:08.435060 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:08.435032 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5ccbc7c9fd-xt52s"] Jul 29 16:52:08.439417 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:08.439387 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7fbc49_4c8c_4d0f_8d38_9de142ead87d.slice/crio-ed3114cdf5ddce4fb533b963aa1baf415093d3651aafa5e00231b50ef39c199d WatchSource:0}: Error finding container ed3114cdf5ddce4fb533b963aa1baf415093d3651aafa5e00231b50ef39c199d: Status 404 returned error can't find the container with id ed3114cdf5ddce4fb533b963aa1baf415093d3651aafa5e00231b50ef39c199d Jul 29 16:52:09.187914 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.187882 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2svw7" Jul 29 16:52:09.225600 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.225561 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccbc7c9fd-xt52s" event={"ID":"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d","Type":"ContainerStarted","Data":"ed3114cdf5ddce4fb533b963aa1baf415093d3651aafa5e00231b50ef39c199d"} Jul 29 16:52:09.451779 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.451743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:52:09.454843 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.454786 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9cc6ab97-8223-4efb-8ee9-72375e0dcd7d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ggsnt\" (UID: \"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d\") " pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:52:09.746993 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.746913 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5k2d8\"" Jul 29 16:52:09.755033 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.755007 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ggsnt" Jul 29 16:52:09.866683 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.866624 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp"] Jul 29 16:52:09.875155 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.875128 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" Jul 29 16:52:09.880961 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.880936 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 16:52:09.881224 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.881191 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-66rq7\"" Jul 29 16:52:09.881878 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.881811 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp"] Jul 29 16:52:09.920701 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.920680 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ggsnt"] Jul 29 16:52:09.923677 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:09.923644 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc6ab97_8223_4efb_8ee9_72375e0dcd7d.slice/crio-ce8c9041738778631df38f48c3a2eb06bd594a55501e1daeba8b0358e1efe5d6 WatchSource:0}: Error finding container ce8c9041738778631df38f48c3a2eb06bd594a55501e1daeba8b0358e1efe5d6: Status 404 returned error can't find the container with id ce8c9041738778631df38f48c3a2eb06bd594a55501e1daeba8b0358e1efe5d6 Jul 29 16:52:09.956281 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:09.956244 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9e26ef26-c6a1-41d0-896d-168c4c7eb195-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-5txpp\" (UID: \"9e26ef26-c6a1-41d0-896d-168c4c7eb195\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" Jul 29 16:52:10.057600 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.057516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9e26ef26-c6a1-41d0-896d-168c4c7eb195-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-5txpp\" (UID: \"9e26ef26-c6a1-41d0-896d-168c4c7eb195\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" Jul 29 16:52:10.060298 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.060260 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9e26ef26-c6a1-41d0-896d-168c4c7eb195-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-5txpp\" (UID: \"9e26ef26-c6a1-41d0-896d-168c4c7eb195\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" Jul 29 16:52:10.173631 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.173592 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-544576447b-tvlzw"] Jul 29 16:52:10.190665 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.190629 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544576447b-tvlzw"] Jul 29 16:52:10.191114 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.190684 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" Jul 29 16:52:10.191114 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.190750 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.198592 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.198568 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 29 16:52:10.230488 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.230437 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggsnt" event={"ID":"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d","Type":"ContainerStarted","Data":"ce8c9041738778631df38f48c3a2eb06bd594a55501e1daeba8b0358e1efe5d6"} Jul 29 16:52:10.360234 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.360195 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-serving-cert\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.360234 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.360243 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-oauth-config\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.360471 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.360265 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-config\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.360471 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.360343 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-service-ca\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.360471 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.360413 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-trusted-ca-bundle\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.360598 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.360487 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tmb5\" (UniqueName: \"kubernetes.io/projected/2af37f30-b47a-4d21-8472-2594f3ffb9d9-kube-api-access-5tmb5\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.360598 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.360509 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-oauth-serving-cert\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.363212 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.363178 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp"] Jul 29 16:52:10.367259 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:10.367230 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e26ef26_c6a1_41d0_896d_168c4c7eb195.slice/crio-a49fcd72786b7c23479531c2ebced72827ff5f1d25e9a7b6a92a3938c4f5f010 WatchSource:0}: Error finding container a49fcd72786b7c23479531c2ebced72827ff5f1d25e9a7b6a92a3938c4f5f010: Status 404 returned error can't find the container with id a49fcd72786b7c23479531c2ebced72827ff5f1d25e9a7b6a92a3938c4f5f010 Jul 29 16:52:10.461589 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.461166 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tmb5\" (UniqueName: \"kubernetes.io/projected/2af37f30-b47a-4d21-8472-2594f3ffb9d9-kube-api-access-5tmb5\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.461589 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.461221 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-oauth-serving-cert\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.461589 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.461256 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-serving-cert\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.461589 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.461279 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-oauth-config\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.461589 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.461297 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-config\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.461589 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.461325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-service-ca\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.461589 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.461359 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-trusted-ca-bundle\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.462073 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.461955 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-oauth-serving-cert\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.462209 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.462134 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-config\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.462299 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.462246 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-trusted-ca-bundle\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.462580 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.462536 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-service-ca\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.465086 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.465061 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-oauth-config\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.465181 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.465161 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-serving-cert\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.470640 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.470614 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tmb5\" (UniqueName: \"kubernetes.io/projected/2af37f30-b47a-4d21-8472-2594f3ffb9d9-kube-api-access-5tmb5\") pod \"console-544576447b-tvlzw\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.502876 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.502701 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:10.706995 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:10.706906 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-544576447b-tvlzw"] Jul 29 16:52:10.712662 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:10.712628 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af37f30_b47a_4d21_8472_2594f3ffb9d9.slice/crio-37b0c515486fcd30ae9d1419e88765d375923a67bc9aedc31226f4ea070ed787 WatchSource:0}: Error finding container 37b0c515486fcd30ae9d1419e88765d375923a67bc9aedc31226f4ea070ed787: Status 404 returned error can't find the container with id 37b0c515486fcd30ae9d1419e88765d375923a67bc9aedc31226f4ea070ed787 Jul 29 16:52:11.236892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:11.236856 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" event={"ID":"9e26ef26-c6a1-41d0-896d-168c4c7eb195","Type":"ContainerStarted","Data":"a49fcd72786b7c23479531c2ebced72827ff5f1d25e9a7b6a92a3938c4f5f010"} Jul 29 16:52:11.238365 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:11.238330 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544576447b-tvlzw" event={"ID":"2af37f30-b47a-4d21-8472-2594f3ffb9d9","Type":"ContainerStarted","Data":"37b0c515486fcd30ae9d1419e88765d375923a67bc9aedc31226f4ea070ed787"} Jul 29 16:52:12.244638 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:12.244543 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccbc7c9fd-xt52s" event={"ID":"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d","Type":"ContainerStarted","Data":"91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc"} Jul 29 16:52:12.246632 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:12.246599 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544576447b-tvlzw" event={"ID":"2af37f30-b47a-4d21-8472-2594f3ffb9d9","Type":"ContainerStarted","Data":"307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691"} Jul 29 16:52:12.263537 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:12.263476 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5ccbc7c9fd-xt52s" podStartSLOduration=1.5675325770000001 podStartE2EDuration="5.263435999s" totalImagesPullingTime="3.695903422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:12.262230365 +0000 UTC m=+82.794111469" watchObservedRunningTime="2026-07-29 16:52:12.263435999 +0000 UTC m=+82.795317104" Jul 29 16:52:12.284287 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:12.284219 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-544576447b-tvlzw" podStartSLOduration=0.851013537 podStartE2EDuration="2.284197056s" totalImagesPullingTime="1.433183519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:12.283603968 +0000 UTC m=+82.815485073" watchObservedRunningTime="2026-07-29 16:52:12.284197056 +0000 UTC m=+82.816078159" Jul 29 16:52:16.264295 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.264256 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" event={"ID":"9e26ef26-c6a1-41d0-896d-168c4c7eb195","Type":"ContainerStarted","Data":"249eee80ac475ff47c46d625d67ca8ba964ad781218fca0ad0e4b90fa84cb2f9"} Jul 29 16:52:16.264810 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.264322 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" Jul 29 16:52:16.265955 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.265923 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggsnt" event={"ID":"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d","Type":"ContainerStarted","Data":"5fd4fd6afdab17794dc0d8aaca5c8c4a04339c1b3aaac4750e7a2a3fe76ea1c3"} Jul 29 16:52:16.270331 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.270305 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" Jul 29 16:52:16.280110 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.280057 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-5txpp" podStartSLOduration=2.309891225 podStartE2EDuration="7.280043083s" totalImagesPullingTime="4.970151858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:16.279751371 +0000 UTC m=+86.811632475" watchObservedRunningTime="2026-07-29 16:52:16.280043083 +0000 UTC m=+86.811924185" Jul 29 16:52:16.933904 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.933871 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-96bnh"] Jul 29 16:52:16.936595 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.936574 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:16.939097 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.939070 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 29 16:52:16.939222 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.939090 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 16:52:16.940112 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.940076 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 16:52:16.940112 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.940103 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 29 16:52:16.940272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.940141 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-mrhcg\"" Jul 29 16:52:16.940272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.940083 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 16:52:16.949521 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:16.949496 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-96bnh"] Jul 29 16:52:17.122203 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.122173 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0134c708-26de-454d-acdf-5708e9a406ef-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.122390 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.122213 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0134c708-26de-454d-acdf-5708e9a406ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.122390 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.122250 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5nw6\" (UniqueName: \"kubernetes.io/projected/0134c708-26de-454d-acdf-5708e9a406ef-kube-api-access-z5nw6\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.122390 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.122335 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0134c708-26de-454d-acdf-5708e9a406ef-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.223053 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.223022 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0134c708-26de-454d-acdf-5708e9a406ef-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.223053 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.223058 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0134c708-26de-454d-acdf-5708e9a406ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.223302 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.223086 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5nw6\" (UniqueName: \"kubernetes.io/projected/0134c708-26de-454d-acdf-5708e9a406ef-kube-api-access-z5nw6\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.223302 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.223157 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0134c708-26de-454d-acdf-5708e9a406ef-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.223914 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.223887 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0134c708-26de-454d-acdf-5708e9a406ef-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.225829 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.225804 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0134c708-26de-454d-acdf-5708e9a406ef-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.225943 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.225862 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0134c708-26de-454d-acdf-5708e9a406ef-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.240242 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.240211 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5nw6\" (UniqueName: \"kubernetes.io/projected/0134c708-26de-454d-acdf-5708e9a406ef-kube-api-access-z5nw6\") pod \"prometheus-operator-84d69f794d-96bnh\" (UID: \"0134c708-26de-454d-acdf-5708e9a406ef\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:17.247065 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:17.247037 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" Jul 29 16:52:18.308986 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:18.308951 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:18.309346 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:18.309021 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:18.314002 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:18.313978 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:19.078224 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:19.078190 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-96bnh"] Jul 29 16:52:19.081545 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:19.081520 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0134c708_26de_454d_acdf_5708e9a406ef.slice/crio-81570325947e4328c1788fb70526ea7c1c4063e923fd89faa9f58e249768de19 WatchSource:0}: Error finding container 81570325947e4328c1788fb70526ea7c1c4063e923fd89faa9f58e249768de19: Status 404 returned error can't find the container with id 81570325947e4328c1788fb70526ea7c1c4063e923fd89faa9f58e249768de19 Jul 29 16:52:19.277902 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:19.277865 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" event={"ID":"0134c708-26de-454d-acdf-5708e9a406ef","Type":"ContainerStarted","Data":"81570325947e4328c1788fb70526ea7c1c4063e923fd89faa9f58e249768de19"} Jul 29 16:52:19.279600 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:19.279573 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggsnt" event={"ID":"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d","Type":"ContainerStarted","Data":"3670b1bd1788e7468a5ca67ca8093f92e19f15227994dc648d7c6a51718ecb0b"} Jul 29 16:52:19.283634 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:19.283611 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:20.503161 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:20.503120 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:20.503657 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:20.503194 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:20.509304 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:20.509277 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:21.289439 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:21.289404 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" event={"ID":"0134c708-26de-454d-acdf-5708e9a406ef","Type":"ContainerStarted","Data":"9a0a8bddc949f11d18fa65a939c56a6523f2f3f87b596a24b11f4b204d808d67"} Jul 29 16:52:21.289632 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:21.289480 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" event={"ID":"0134c708-26de-454d-acdf-5708e9a406ef","Type":"ContainerStarted","Data":"4c4c7fb6147413757f972f4f1a68d3f559e75f654756de4773c7c038ac6aa46d"} Jul 29 16:52:21.293354 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:21.293331 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:52:21.331160 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:21.331105 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-96bnh" podStartSLOduration=3.708035786 podStartE2EDuration="5.331087321s" totalImagesPullingTime="1.623051535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:21.329794752 +0000 UTC m=+91.861675859" watchObservedRunningTime="2026-07-29 16:52:21.331087321 +0000 UTC m=+91.862968424" Jul 29 16:52:21.442275 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:21.442231 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ccbc7c9fd-xt52s"] Jul 29 16:52:23.206571 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.206537 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-686d6f5557-hbflv" Jul 29 16:52:23.497968 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.497949 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k"] Jul 29 16:52:23.500195 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.500179 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.503693 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.503653 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 16:52:23.503817 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.503778 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 16:52:23.503929 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.503911 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lb284\"" Jul 29 16:52:23.520432 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.520410 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5crps"] Jul 29 16:52:23.522756 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.522725 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.523737 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.523719 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w"] Jul 29 16:52:23.525253 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.525234 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hcr6d\"" Jul 29 16:52:23.525360 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.525240 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 16:52:23.525535 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.525520 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 16:52:23.525871 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.525855 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 16:52:23.525944 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.525900 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.529611 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.529589 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k"] Jul 29 16:52:23.530025 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.530002 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 29 16:52:23.530391 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.530332 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rs7ph\"" Jul 29 16:52:23.530516 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.530398 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 29 16:52:23.530516 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.530506 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 29 16:52:23.549859 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.549836 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w"] Jul 29 16:52:23.575871 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.575841 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-tls\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.575880 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.576064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.575906 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.576064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.575926 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae252624-487d-4fc3-90ac-711270a8174d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.576064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.575941 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7043adb-ae30-4529-a170-c0227b99f928-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.576064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576017 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576064 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576052 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-sys\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576351 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576082 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.576351 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576116 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-textfile\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576351 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576151 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j2dw\" (UniqueName: \"kubernetes.io/projected/b7043adb-ae30-4529-a170-c0227b99f928-kube-api-access-9j2dw\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.576351 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576200 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-wtmp\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576351 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576228 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b2c476a-8873-474a-9856-4eb9c4041a4c-metrics-client-ca\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576351 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576247 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7043adb-ae30-4529-a170-c0227b99f928-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.576351 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576268 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.576351 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576332 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-root\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576634 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576355 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576634 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576376 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m6lr\" (UniqueName: \"kubernetes.io/projected/1b2c476a-8873-474a-9856-4eb9c4041a4c-kube-api-access-2m6lr\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.576634 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576406 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.576634 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.576422 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqnxs\" (UniqueName: \"kubernetes.io/projected/ae252624-487d-4fc3-90ac-711270a8174d-kube-api-access-cqnxs\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.677058 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677022 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-tls\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.677058 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677065 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.677264 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677083 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.677264 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677102 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae252624-487d-4fc3-90ac-711270a8174d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.677264 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677118 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7043adb-ae30-4529-a170-c0227b99f928-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.677264 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:52:23.677209 2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 29 16:52:23.677264 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677244 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.677493 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:52:23.677287 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-tls podName:1b2c476a-8873-474a-9856-4eb9c4041a4c nodeName:}" failed. No retries permitted until 2026-07-29 16:52:24.177266623 +0000 UTC m=+94.709147704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-tls") pod "node-exporter-5crps" (UID: "1b2c476a-8873-474a-9856-4eb9c4041a4c") : secret "node-exporter-tls" not found Jul 29 16:52:23.677493 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:52:23.677209 2584 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 29 16:52:23.677493 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677350 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-sys\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.677493 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677309 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-sys\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.677493 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:52:23.677394 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-tls podName:ae252624-487d-4fc3-90ac-711270a8174d nodeName:}" failed. No retries permitted until 2026-07-29 16:52:24.177365314 +0000 UTC m=+94.709246397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-pz69k" (UID: "ae252624-487d-4fc3-90ac-711270a8174d") : secret "openshift-state-metrics-tls" not found Jul 29 16:52:23.677493 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677470 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.677776 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677515 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-textfile\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.677776 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677557 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j2dw\" (UniqueName: \"kubernetes.io/projected/b7043adb-ae30-4529-a170-c0227b99f928-kube-api-access-9j2dw\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.677776 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677598 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-wtmp\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.677776 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677621 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b2c476a-8873-474a-9856-4eb9c4041a4c-metrics-client-ca\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.677776 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677650 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7043adb-ae30-4529-a170-c0227b99f928-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.677776 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677683 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.677776 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677734 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-root\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.677776 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677761 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677789 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m6lr\" (UniqueName: \"kubernetes.io/projected/1b2c476a-8873-474a-9856-4eb9c4041a4c-kube-api-access-2m6lr\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677834 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677859 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqnxs\" (UniqueName: \"kubernetes.io/projected/ae252624-487d-4fc3-90ac-711270a8174d-kube-api-access-cqnxs\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677861 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-accelerators-collector-config\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677934 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7043adb-ae30-4529-a170-c0227b99f928-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.677956 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae252624-487d-4fc3-90ac-711270a8174d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:52:23.677969 2584 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:52:23.678024 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-tls podName:b7043adb-ae30-4529-a170-c0227b99f928 nodeName:}" failed. No retries permitted until 2026-07-29 16:52:24.178008577 +0000 UTC m=+94.709889663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-l5n7w" (UID: "b7043adb-ae30-4529-a170-c0227b99f928") : secret "kube-state-metrics-tls" not found Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.678083 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-wtmp\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.678113 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.678168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.678146 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1b2c476a-8873-474a-9856-4eb9c4041a4c-root\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.678652 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.678179 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-textfile\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.678652 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.678271 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b7043adb-ae30-4529-a170-c0227b99f928-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.678652 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.678500 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b2c476a-8873-474a-9856-4eb9c4041a4c-metrics-client-ca\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.679836 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.679811 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:23.680274 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.680253 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.680523 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.680504 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.687150 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.687126 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m6lr\" (UniqueName: \"kubernetes.io/projected/1b2c476a-8873-474a-9856-4eb9c4041a4c-kube-api-access-2m6lr\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:23.687278 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.687258 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j2dw\" (UniqueName: \"kubernetes.io/projected/b7043adb-ae30-4529-a170-c0227b99f928-kube-api-access-9j2dw\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:23.687904 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:23.687880 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqnxs\" (UniqueName: \"kubernetes.io/projected/ae252624-487d-4fc3-90ac-711270a8174d-kube-api-access-cqnxs\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:24.182715 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.182670 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:24.182925 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.182729 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-tls\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:24.182925 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.182763 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:24.185075 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.185043 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1b2c476a-8873-474a-9856-4eb9c4041a4c-node-exporter-tls\") pod \"node-exporter-5crps\" (UID: \"1b2c476a-8873-474a-9856-4eb9c4041a4c\") " pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:24.185190 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.185133 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ae252624-487d-4fc3-90ac-711270a8174d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-pz69k\" (UID: \"ae252624-487d-4fc3-90ac-711270a8174d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:24.185190 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.185150 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7043adb-ae30-4529-a170-c0227b99f928-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-l5n7w\" (UID: \"b7043adb-ae30-4529-a170-c0227b99f928\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:24.302985 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.302947 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ggsnt" event={"ID":"9cc6ab97-8223-4efb-8ee9-72375e0dcd7d","Type":"ContainerStarted","Data":"347cf963a4a221b9b5af77266aeb2fdaf4754ba236fbc55db9d3d7a6dcd242e3"} Jul 29 16:52:24.331527 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.331415 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ggsnt" podStartSLOduration=33.937380444 podStartE2EDuration="47.331397691s" totalImagesPullingTime="13.394017247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 16:51:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:24.331064671 +0000 UTC m=+94.862945774" watchObservedRunningTime="2026-07-29 16:52:24.331397691 +0000 UTC m=+94.863278791" Jul 29 16:52:24.409624 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.409587 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" Jul 29 16:52:24.433535 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.433458 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5crps" Jul 29 16:52:24.438354 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.438322 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" Jul 29 16:52:24.449410 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:24.449340 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2c476a_8873_474a_9856_4eb9c4041a4c.slice/crio-4555d1c4a310a911c7cd9b6b3acfd96f2eada1d0241e6e844addda494b79095a WatchSource:0}: Error finding container 4555d1c4a310a911c7cd9b6b3acfd96f2eada1d0241e6e844addda494b79095a: Status 404 returned error can't find the container with id 4555d1c4a310a911c7cd9b6b3acfd96f2eada1d0241e6e844addda494b79095a Jul 29 16:52:24.591139 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.591106 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k"] Jul 29 16:52:24.593929 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:24.593896 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae252624_487d_4fc3_90ac_711270a8174d.slice/crio-097dee8a5f28be0917181e2625214ee81e3ca277b01979f60e028d9f69bdce4d WatchSource:0}: Error finding container 097dee8a5f28be0917181e2625214ee81e3ca277b01979f60e028d9f69bdce4d: Status 404 returned error can't find the container with id 097dee8a5f28be0917181e2625214ee81e3ca277b01979f60e028d9f69bdce4d Jul 29 16:52:24.634032 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:24.634004 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w"] Jul 29 16:52:24.634936 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:24.634913 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7043adb_ae30_4529_a170_c0227b99f928.slice/crio-6fda59abbe83b558a81b11aaca967b00742617e2145043ec1c95e45d5d675b08 WatchSource:0}: Error finding container 6fda59abbe83b558a81b11aaca967b00742617e2145043ec1c95e45d5d675b08: Status 404 returned error can't find the container with id 6fda59abbe83b558a81b11aaca967b00742617e2145043ec1c95e45d5d675b08 Jul 29 16:52:25.309039 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:25.308953 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" event={"ID":"b7043adb-ae30-4529-a170-c0227b99f928","Type":"ContainerStarted","Data":"6fda59abbe83b558a81b11aaca967b00742617e2145043ec1c95e45d5d675b08"} Jul 29 16:52:25.310642 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:25.310579 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5crps" event={"ID":"1b2c476a-8873-474a-9856-4eb9c4041a4c","Type":"ContainerStarted","Data":"4555d1c4a310a911c7cd9b6b3acfd96f2eada1d0241e6e844addda494b79095a"} Jul 29 16:52:25.312956 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:25.312927 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" event={"ID":"ae252624-487d-4fc3-90ac-711270a8174d","Type":"ContainerStarted","Data":"01ec49bb634fa16f6af16473af32a03c40ebf55e609a67dadf1f7ea44cd02db5"} Jul 29 16:52:25.313086 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:25.312982 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" event={"ID":"ae252624-487d-4fc3-90ac-711270a8174d","Type":"ContainerStarted","Data":"5429660eb399ec59cf29c0703e5162a273bc6f17bb0e7f5bc53e89febff60ab6"} Jul 29 16:52:25.313086 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:25.313006 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" event={"ID":"ae252624-487d-4fc3-90ac-711270a8174d","Type":"ContainerStarted","Data":"097dee8a5f28be0917181e2625214ee81e3ca277b01979f60e028d9f69bdce4d"} Jul 29 16:52:26.318027 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:26.317996 2584 generic.go:356] "Generic (PLEG): container finished" podID="1b2c476a-8873-474a-9856-4eb9c4041a4c" containerID="0d547495de3e1e9b361b5d15152b7428baa5a747ba24353ffa77ecc075736fd6" exitCode=0 Jul 29 16:52:26.318469 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:26.318079 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5crps" event={"ID":"1b2c476a-8873-474a-9856-4eb9c4041a4c","Type":"ContainerDied","Data":"0d547495de3e1e9b361b5d15152b7428baa5a747ba24353ffa77ecc075736fd6"} Jul 29 16:52:26.320131 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:26.320105 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" event={"ID":"ae252624-487d-4fc3-90ac-711270a8174d","Type":"ContainerStarted","Data":"58633d1c8a7d17c4e3d343264cc278cdb50a0fb31ac31fbf62097e8bb22eb2af"} Jul 29 16:52:26.362166 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:26.362113 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-pz69k" podStartSLOduration=2.373769846 podStartE2EDuration="3.362095579s" totalImagesPullingTime="988.325733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:26.36062971 +0000 UTC m=+96.892510807" watchObservedRunningTime="2026-07-29 16:52:26.362095579 +0000 UTC m=+96.893976726" Jul 29 16:52:27.326895 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.326858 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" event={"ID":"b7043adb-ae30-4529-a170-c0227b99f928","Type":"ContainerStarted","Data":"02a922d1737432693f2916f24afdd0ce9f1ce99028b0fcf84247154ee5f2b638"} Jul 29 16:52:27.327319 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.326961 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" event={"ID":"b7043adb-ae30-4529-a170-c0227b99f928","Type":"ContainerStarted","Data":"3f0a636225e2b51e632014e7d5afc86fc5a75e2f38170c909e6d4178caa53d21"} Jul 29 16:52:27.327319 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.326992 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" event={"ID":"b7043adb-ae30-4529-a170-c0227b99f928","Type":"ContainerStarted","Data":"e51111a0765f0f1e1eb28cf82767bc564d34907886feb0a774f88eca7fca9808"} Jul 29 16:52:27.329056 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.329031 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5crps" event={"ID":"1b2c476a-8873-474a-9856-4eb9c4041a4c","Type":"ContainerStarted","Data":"f043ed0f7ccb713dfecd0cbbdc842a5a8b95796fcb983579aad91fe5e8656c2e"} Jul 29 16:52:27.329175 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.329078 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5crps" event={"ID":"1b2c476a-8873-474a-9856-4eb9c4041a4c","Type":"ContainerStarted","Data":"97af679c6c8a80b537fee251bed3278390df4487d58d3067d68994f830e63582"} Jul 29 16:52:27.349998 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.349954 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-l5n7w" podStartSLOduration=2.659760148 podStartE2EDuration="4.349940893s" totalImagesPullingTime="1.690180745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:27.348998949 +0000 UTC m=+97.880880055" watchObservedRunningTime="2026-07-29 16:52:27.349940893 +0000 UTC m=+97.881821996" Jul 29 16:52:27.375610 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.375567 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5crps" podStartSLOduration=3.328308956 podStartE2EDuration="4.375551707s" totalImagesPullingTime="967.81675ms" totalInitContainerRuntime="79.426001ms" isStatefulPod=true podCreationTimestamp="2026-07-29 16:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:27.37434735 +0000 UTC m=+97.906228455" watchObservedRunningTime="2026-07-29 16:52:27.375551707 +0000 UTC m=+97.907432810" Jul 29 16:52:27.922175 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.922137 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-559977b775-hs48q"] Jul 29 16:52:27.924364 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.924342 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:27.927685 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.927664 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 16:52:27.927980 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.927958 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 16:52:27.928068 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.927967 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5j6wm\"" Jul 29 16:52:27.928136 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.928102 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 16:52:27.928238 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.928220 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 16:52:27.928304 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.928239 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-576d1luk6eld4\"" Jul 29 16:52:27.940502 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:27.940477 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-559977b775-hs48q"] Jul 29 16:52:28.018273 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.018232 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/435d51fb-e05a-4add-9702-91ab16b0991c-metrics-server-audit-profiles\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.018273 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.018279 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-secret-metrics-server-client-certs\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.018501 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.018315 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-secret-metrics-server-tls\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.018501 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.018353 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/435d51fb-e05a-4add-9702-91ab16b0991c-audit-log\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.018501 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.018376 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d51fb-e05a-4add-9702-91ab16b0991c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.018501 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.018425 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9459h\" (UniqueName: \"kubernetes.io/projected/435d51fb-e05a-4add-9702-91ab16b0991c-kube-api-access-9459h\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.018501 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.018477 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-client-ca-bundle\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.119497 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.119317 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/435d51fb-e05a-4add-9702-91ab16b0991c-metrics-server-audit-profiles\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.119497 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.119379 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-secret-metrics-server-client-certs\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.119497 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.119425 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-secret-metrics-server-tls\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.119799 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.119517 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/435d51fb-e05a-4add-9702-91ab16b0991c-audit-log\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.119799 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.119548 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d51fb-e05a-4add-9702-91ab16b0991c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.119799 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.119600 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9459h\" (UniqueName: \"kubernetes.io/projected/435d51fb-e05a-4add-9702-91ab16b0991c-kube-api-access-9459h\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.119799 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.119648 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-client-ca-bundle\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.120139 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.120082 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/435d51fb-e05a-4add-9702-91ab16b0991c-audit-log\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.120852 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.120827 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/435d51fb-e05a-4add-9702-91ab16b0991c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.121000 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.120909 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/435d51fb-e05a-4add-9702-91ab16b0991c-metrics-server-audit-profiles\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.122380 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.122353 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-secret-metrics-server-client-certs\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.122751 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.122728 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-client-ca-bundle\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.122841 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.122748 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/435d51fb-e05a-4add-9702-91ab16b0991c-secret-metrics-server-tls\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.130750 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.130725 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9459h\" (UniqueName: \"kubernetes.io/projected/435d51fb-e05a-4add-9702-91ab16b0991c-kube-api-access-9459h\") pod \"metrics-server-559977b775-hs48q\" (UID: \"435d51fb-e05a-4add-9702-91ab16b0991c\") " pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.233904 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.233876 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:28.366903 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.366875 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-559977b775-hs48q"] Jul 29 16:52:28.369219 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:28.369195 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod435d51fb_e05a_4add_9702_91ab16b0991c.slice/crio-dfc323c0bcc4f1b031af1ba5a4f61724270aab76158edbbe89908d6c85bc4230 WatchSource:0}: Error finding container dfc323c0bcc4f1b031af1ba5a4f61724270aab76158edbbe89908d6c85bc4230: Status 404 returned error can't find the container with id dfc323c0bcc4f1b031af1ba5a4f61724270aab76158edbbe89908d6c85bc4230 Jul 29 16:52:28.587899 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.587820 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-88df969b4-pfx4x"] Jul 29 16:52:28.590834 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.590815 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.609995 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.609966 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88df969b4-pfx4x"] Jul 29 16:52:28.625176 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.625140 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-oauth-serving-cert\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.625176 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.625175 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-console-config\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.625344 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.625228 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-trusted-ca-bundle\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.625344 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.625315 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9mvx\" (UniqueName: \"kubernetes.io/projected/e57429b8-f47e-4226-a24a-ad042ce3c038-kube-api-access-q9mvx\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.625344 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.625341 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-service-ca\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.625462 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.625368 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-serving-cert\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.625462 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.625382 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-oauth-config\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.726344 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.726311 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-service-ca\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.726539 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.726361 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-serving-cert\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.726539 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.726380 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-oauth-config\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.726539 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.726421 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-oauth-serving-cert\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.726539 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.726471 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-console-config\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.726539 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.726496 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-trusted-ca-bundle\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.726803 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.726589 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9mvx\" (UniqueName: \"kubernetes.io/projected/e57429b8-f47e-4226-a24a-ad042ce3c038-kube-api-access-q9mvx\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.727182 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.727161 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-service-ca\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.727268 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.727237 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-oauth-serving-cert\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.727302 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.727237 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-console-config\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.727540 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.727516 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-trusted-ca-bundle\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.728892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.728875 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-serving-cert\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.728942 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.728905 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-oauth-config\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.737876 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.737854 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9mvx\" (UniqueName: \"kubernetes.io/projected/e57429b8-f47e-4226-a24a-ad042ce3c038-kube-api-access-q9mvx\") pod \"console-88df969b4-pfx4x\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:28.900526 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:28.900402 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:29.034492 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:29.034462 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-88df969b4-pfx4x"] Jul 29 16:52:29.037533 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:29.037500 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57429b8_f47e_4226_a24a_ad042ce3c038.slice/crio-3a04794cd9840b255de5fa7883335b8838d85887d077e95499f6c9cb2a486dd7 WatchSource:0}: Error finding container 3a04794cd9840b255de5fa7883335b8838d85887d077e95499f6c9cb2a486dd7: Status 404 returned error can't find the container with id 3a04794cd9840b255de5fa7883335b8838d85887d077e95499f6c9cb2a486dd7 Jul 29 16:52:29.340838 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:29.340790 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88df969b4-pfx4x" event={"ID":"e57429b8-f47e-4226-a24a-ad042ce3c038","Type":"ContainerStarted","Data":"c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c"} Jul 29 16:52:29.341016 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:29.340877 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88df969b4-pfx4x" event={"ID":"e57429b8-f47e-4226-a24a-ad042ce3c038","Type":"ContainerStarted","Data":"3a04794cd9840b255de5fa7883335b8838d85887d077e95499f6c9cb2a486dd7"} Jul 29 16:52:29.342322 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:29.342291 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-559977b775-hs48q" event={"ID":"435d51fb-e05a-4add-9702-91ab16b0991c","Type":"ContainerStarted","Data":"dfc323c0bcc4f1b031af1ba5a4f61724270aab76158edbbe89908d6c85bc4230"} Jul 29 16:52:29.361864 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:29.361811 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-88df969b4-pfx4x" podStartSLOduration=1.361791138 podStartE2EDuration="1.361791138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:29.360264705 +0000 UTC m=+99.892145818" watchObservedRunningTime="2026-07-29 16:52:29.361791138 +0000 UTC m=+99.893672240" Jul 29 16:52:30.349317 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:30.349283 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-559977b775-hs48q" event={"ID":"435d51fb-e05a-4add-9702-91ab16b0991c","Type":"ContainerStarted","Data":"0406c4b482bc1b9e2923914dc53892af58116788311d2e46e3f5b96b0a13964e"} Jul 29 16:52:30.369370 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:30.369310 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-559977b775-hs48q" podStartSLOduration=1.57305468 podStartE2EDuration="3.369290296s" totalImagesPullingTime="1.796235616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:30.368704656 +0000 UTC m=+100.900585761" watchObservedRunningTime="2026-07-29 16:52:30.369290296 +0000 UTC m=+100.901171400" Jul 29 16:52:33.204149 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:33.204121 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-47n92" Jul 29 16:52:38.902217 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:38.902179 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:38.902707 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:38.902242 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:38.906086 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:38.906053 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:39.391564 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.391537 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:52:39.450396 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.450358 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544576447b-tvlzw"] Jul 29 16:52:39.570364 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.570332 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8654dfb88f-z4xxt"] Jul 29 16:52:39.572553 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.572531 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.588999 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.588968 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8654dfb88f-z4xxt"] Jul 29 16:52:39.629019 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.628987 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-trusted-ca-bundle\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.629019 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.629029 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-config\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.629243 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.629058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-serving-cert\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.629243 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.629089 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-oauth-config\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.629243 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.629122 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-oauth-serving-cert\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.629243 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.629144 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvtvs\" (UniqueName: \"kubernetes.io/projected/96f23ec8-d017-4a6f-b445-ba37766b8a32-kube-api-access-qvtvs\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.629243 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.629215 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-service-ca\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.730411 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.730376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-config\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.730600 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.730419 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-serving-cert\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.730600 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.730436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-oauth-config\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.730600 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.730488 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-oauth-serving-cert\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.730600 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.730516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvtvs\" (UniqueName: \"kubernetes.io/projected/96f23ec8-d017-4a6f-b445-ba37766b8a32-kube-api-access-qvtvs\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.730600 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.730545 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-service-ca\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.730839 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.730764 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-trusted-ca-bundle\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.731307 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.731278 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-config\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.731436 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.731328 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-service-ca\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.731436 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.731328 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-oauth-serving-cert\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.731759 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.731739 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-trusted-ca-bundle\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.733076 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.733054 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-oauth-config\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.733169 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.733054 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-serving-cert\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.739700 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.739672 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvtvs\" (UniqueName: \"kubernetes.io/projected/96f23ec8-d017-4a6f-b445-ba37766b8a32-kube-api-access-qvtvs\") pod \"console-8654dfb88f-z4xxt\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:39.881257 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:39.881229 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:40.028231 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:40.028203 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8654dfb88f-z4xxt"] Jul 29 16:52:40.029885 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:52:40.029863 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f23ec8_d017_4a6f_b445_ba37766b8a32.slice/crio-e463724ee29415513c10af50c7ee332a05af148e42ad9aa6b84e7ad36d33b76e WatchSource:0}: Error finding container e463724ee29415513c10af50c7ee332a05af148e42ad9aa6b84e7ad36d33b76e: Status 404 returned error can't find the container with id e463724ee29415513c10af50c7ee332a05af148e42ad9aa6b84e7ad36d33b76e Jul 29 16:52:40.393489 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:40.393374 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8654dfb88f-z4xxt" event={"ID":"96f23ec8-d017-4a6f-b445-ba37766b8a32","Type":"ContainerStarted","Data":"02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001"} Jul 29 16:52:40.393489 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:40.393434 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8654dfb88f-z4xxt" event={"ID":"96f23ec8-d017-4a6f-b445-ba37766b8a32","Type":"ContainerStarted","Data":"e463724ee29415513c10af50c7ee332a05af148e42ad9aa6b84e7ad36d33b76e"} Jul 29 16:52:43.406071 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:43.406038 2584 generic.go:356] "Generic (PLEG): container finished" podID="e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025" containerID="36b41b8108e2e9a6cc6c54fdf916e5ad5a5b462befb27d57f5597418c2e5ce35" exitCode=0 Jul 29 16:52:43.406474 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:43.406103 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" event={"ID":"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025","Type":"ContainerDied","Data":"36b41b8108e2e9a6cc6c54fdf916e5ad5a5b462befb27d57f5597418c2e5ce35"} Jul 29 16:52:43.406526 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:43.406500 2584 scope.go:117] "RemoveContainer" containerID="36b41b8108e2e9a6cc6c54fdf916e5ad5a5b462befb27d57f5597418c2e5ce35" Jul 29 16:52:43.426991 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:43.426946 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8654dfb88f-z4xxt" podStartSLOduration=4.426931266 podStartE2EDuration="4.426931266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:52:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:52:40.428762286 +0000 UTC m=+110.960643388" watchObservedRunningTime="2026-07-29 16:52:43.426931266 +0000 UTC m=+113.958812374" Jul 29 16:52:44.412749 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:44.412710 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-698fz" event={"ID":"e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025","Type":"ContainerStarted","Data":"861b090af1828737468a22e8ed8c9752b25d79c2751ba82b09f7faeb158d50d4"} Jul 29 16:52:46.463748 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.463701 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5ccbc7c9fd-xt52s" podUID="ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" containerName="console" containerID="cri-o://91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc" gracePeriod=15 Jul 29 16:52:46.724038 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.723968 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:46.792663 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.792626 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmhrx\" (UniqueName: \"kubernetes.io/projected/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-kube-api-access-gmhrx\") pod \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " Jul 29 16:52:46.792831 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.792698 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-service-ca\") pod \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " Jul 29 16:52:46.792831 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.792716 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-serving-cert\") pod \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " Jul 29 16:52:46.792954 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.792904 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-oauth-serving-cert\") pod \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " Jul 29 16:52:46.793007 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.792963 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-oauth-config\") pod \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " Jul 29 16:52:46.793053 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.793022 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-service-ca" (OuterVolumeSpecName: "service-ca") pod "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" (UID: "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:52:46.793053 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.793029 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-config\") pod \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\" (UID: \"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d\") " Jul 29 16:52:46.793261 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.793232 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" (UID: "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:52:46.793369 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.793286 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-config" (OuterVolumeSpecName: "console-config") pod "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" (UID: "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:52:46.793418 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.793388 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-service-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:46.793418 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.793405 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-oauth-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:46.793521 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.793418 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:46.795059 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.795029 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-kube-api-access-gmhrx" (OuterVolumeSpecName: "kube-api-access-gmhrx") pod "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" (UID: "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d"). InnerVolumeSpecName "kube-api-access-gmhrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:52:46.795150 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.795070 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" (UID: "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:52:46.795150 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.795083 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" (UID: "ef7fbc49-4c8c-4d0f-8d38-9de142ead87d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:52:46.894701 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.894660 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmhrx\" (UniqueName: \"kubernetes.io/projected/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-kube-api-access-gmhrx\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:46.894701 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.894695 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:46.894701 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:46.894708 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d-console-oauth-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:52:47.426255 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.426220 2584 generic.go:356] "Generic (PLEG): container finished" podID="ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" containerID="91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc" exitCode=0 Jul 29 16:52:47.426436 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.426265 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5ccbc7c9fd-xt52s" Jul 29 16:52:47.426436 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.426292 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccbc7c9fd-xt52s" event={"ID":"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d","Type":"ContainerDied","Data":"91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc"} Jul 29 16:52:47.426436 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.426331 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5ccbc7c9fd-xt52s" event={"ID":"ef7fbc49-4c8c-4d0f-8d38-9de142ead87d","Type":"ContainerDied","Data":"ed3114cdf5ddce4fb533b963aa1baf415093d3651aafa5e00231b50ef39c199d"} Jul 29 16:52:47.426436 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.426350 2584 scope.go:117] "RemoveContainer" containerID="91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc" Jul 29 16:52:47.436904 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.436860 2584 scope.go:117] "RemoveContainer" containerID="91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc" Jul 29 16:52:47.437314 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:52:47.437290 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc\": container with ID starting with 91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc not found: ID does not exist" containerID="91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc" Jul 29 16:52:47.437399 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.437328 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc"} err="failed to get container status \"91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc\": rpc error: code = NotFound desc = could not find container \"91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc\": container with ID starting with 91b2176bd27732dea39cf3161e681367f57b01ccbe28fb2be208359dc5c312fc not found: ID does not exist" Jul 29 16:52:47.447651 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.447623 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5ccbc7c9fd-xt52s"] Jul 29 16:52:47.453311 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.453288 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5ccbc7c9fd-xt52s"] Jul 29 16:52:47.917842 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:47.917803 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" path="/var/lib/kubelet/pods/ef7fbc49-4c8c-4d0f-8d38-9de142ead87d/volumes" Jul 29 16:52:48.234820 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:48.234790 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:48.234966 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:48.234849 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:52:49.881373 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:49.881347 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:49.881867 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:49.881405 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:49.886849 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:49.886826 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:50.443586 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:50.443557 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:52:50.491197 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:50.491166 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88df969b4-pfx4x"] Jul 29 16:52:53.452484 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:53.452433 2584 generic.go:356] "Generic (PLEG): container finished" podID="9faedbd4-51a4-4538-bdb9-d6a8c044ffd5" containerID="efe5139568128c1e32b7bf70dee770e9080f5a7e8a942a8644419436c555dbb8" exitCode=0 Jul 29 16:52:53.452932 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:53.452506 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" event={"ID":"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5","Type":"ContainerDied","Data":"efe5139568128c1e32b7bf70dee770e9080f5a7e8a942a8644419436c555dbb8"} Jul 29 16:52:53.452932 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:53.452801 2584 scope.go:117] "RemoveContainer" containerID="efe5139568128c1e32b7bf70dee770e9080f5a7e8a942a8644419436c555dbb8" Jul 29 16:52:54.458476 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:52:54.458427 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-4n5sg" event={"ID":"9faedbd4-51a4-4538-bdb9-d6a8c044ffd5","Type":"ContainerStarted","Data":"1d5a981837642949e7a79614264834620895055d6dba603703307aa408a3787a"} Jul 29 16:53:04.473775 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.473727 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-544576447b-tvlzw" podUID="2af37f30-b47a-4d21-8472-2594f3ffb9d9" containerName="console" containerID="cri-o://307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691" gracePeriod=15 Jul 29 16:53:04.720377 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.720354 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:53:04.851345 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851259 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-oauth-serving-cert\") pod \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " Jul 29 16:53:04.851345 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851301 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-config\") pod \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " Jul 29 16:53:04.851583 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851352 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tmb5\" (UniqueName: \"kubernetes.io/projected/2af37f30-b47a-4d21-8472-2594f3ffb9d9-kube-api-access-5tmb5\") pod \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " Jul 29 16:53:04.851583 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851401 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-serving-cert\") pod \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " Jul 29 16:53:04.851583 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851455 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-oauth-config\") pod \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " Jul 29 16:53:04.851583 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851490 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-service-ca\") pod \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " Jul 29 16:53:04.851583 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851523 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-trusted-ca-bundle\") pod \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\" (UID: \"2af37f30-b47a-4d21-8472-2594f3ffb9d9\") " Jul 29 16:53:04.851847 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851822 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2af37f30-b47a-4d21-8472-2594f3ffb9d9" (UID: "2af37f30-b47a-4d21-8472-2594f3ffb9d9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:04.851919 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.851869 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-config" (OuterVolumeSpecName: "console-config") pod "2af37f30-b47a-4d21-8472-2594f3ffb9d9" (UID: "2af37f30-b47a-4d21-8472-2594f3ffb9d9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:04.852120 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.852093 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-service-ca" (OuterVolumeSpecName: "service-ca") pod "2af37f30-b47a-4d21-8472-2594f3ffb9d9" (UID: "2af37f30-b47a-4d21-8472-2594f3ffb9d9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:04.852203 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.852125 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2af37f30-b47a-4d21-8472-2594f3ffb9d9" (UID: "2af37f30-b47a-4d21-8472-2594f3ffb9d9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:04.853814 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.853779 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af37f30-b47a-4d21-8472-2594f3ffb9d9-kube-api-access-5tmb5" (OuterVolumeSpecName: "kube-api-access-5tmb5") pod "2af37f30-b47a-4d21-8472-2594f3ffb9d9" (UID: "2af37f30-b47a-4d21-8472-2594f3ffb9d9"). InnerVolumeSpecName "kube-api-access-5tmb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:53:04.853907 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.853817 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2af37f30-b47a-4d21-8472-2594f3ffb9d9" (UID: "2af37f30-b47a-4d21-8472-2594f3ffb9d9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:53:04.854104 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.854088 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2af37f30-b47a-4d21-8472-2594f3ffb9d9" (UID: "2af37f30-b47a-4d21-8472-2594f3ffb9d9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:53:04.952713 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.952679 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-oauth-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:04.952713 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.952709 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:04.952713 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.952718 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tmb5\" (UniqueName: \"kubernetes.io/projected/2af37f30-b47a-4d21-8472-2594f3ffb9d9-kube-api-access-5tmb5\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:04.952946 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.952728 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:04.952946 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.952736 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2af37f30-b47a-4d21-8472-2594f3ffb9d9-console-oauth-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:04.952946 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.952744 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-service-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:04.952946 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:04.952752 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2af37f30-b47a-4d21-8472-2594f3ffb9d9-trusted-ca-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:05.503519 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.503483 2584 generic.go:356] "Generic (PLEG): container finished" podID="2af37f30-b47a-4d21-8472-2594f3ffb9d9" containerID="307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691" exitCode=0 Jul 29 16:53:05.503935 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.503541 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544576447b-tvlzw" event={"ID":"2af37f30-b47a-4d21-8472-2594f3ffb9d9","Type":"ContainerDied","Data":"307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691"} Jul 29 16:53:05.503935 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.503547 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-544576447b-tvlzw" Jul 29 16:53:05.503935 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.503581 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-544576447b-tvlzw" event={"ID":"2af37f30-b47a-4d21-8472-2594f3ffb9d9","Type":"ContainerDied","Data":"37b0c515486fcd30ae9d1419e88765d375923a67bc9aedc31226f4ea070ed787"} Jul 29 16:53:05.503935 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.503602 2584 scope.go:117] "RemoveContainer" containerID="307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691" Jul 29 16:53:05.512249 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.512233 2584 scope.go:117] "RemoveContainer" containerID="307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691" Jul 29 16:53:05.512509 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:53:05.512492 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691\": container with ID starting with 307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691 not found: ID does not exist" containerID="307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691" Jul 29 16:53:05.512567 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.512515 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691"} err="failed to get container status \"307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691\": rpc error: code = NotFound desc = could not find container \"307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691\": container with ID starting with 307f68cddd20e0f90d13ca902cc4bf2fb16042bf4d21798e7034f02829689691 not found: ID does not exist" Jul 29 16:53:05.523828 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.523799 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-544576447b-tvlzw"] Jul 29 16:53:05.527453 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.527420 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-544576447b-tvlzw"] Jul 29 16:53:05.918026 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:05.917954 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af37f30-b47a-4d21-8472-2594f3ffb9d9" path="/var/lib/kubelet/pods/2af37f30-b47a-4d21-8472-2594f3ffb9d9/volumes" Jul 29 16:53:07.513517 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:07.513487 2584 generic.go:356] "Generic (PLEG): container finished" podID="7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d" containerID="4dbd3d03d03b8894119502b6dbd7db4844d457d2e0bed9977689cca74a6d5032" exitCode=0 Jul 29 16:53:07.513981 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:07.513542 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-gvw5p" event={"ID":"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d","Type":"ContainerDied","Data":"4dbd3d03d03b8894119502b6dbd7db4844d457d2e0bed9977689cca74a6d5032"} Jul 29 16:53:07.513981 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:07.513971 2584 scope.go:117] "RemoveContainer" containerID="4dbd3d03d03b8894119502b6dbd7db4844d457d2e0bed9977689cca74a6d5032" Jul 29 16:53:08.239927 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:08.239898 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:53:08.244936 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:08.244904 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-559977b775-hs48q" Jul 29 16:53:08.519623 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:08.519542 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-gvw5p" event={"ID":"7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d","Type":"ContainerStarted","Data":"11b1249881e9d077f26e9815be14e96981e5b61d73cba3cb4290b59717d09be1"} Jul 29 16:53:15.517251 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.517190 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-88df969b4-pfx4x" podUID="e57429b8-f47e-4226-a24a-ad042ce3c038" containerName="console" containerID="cri-o://c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c" gracePeriod=15 Jul 29 16:53:15.758732 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.758708 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:53:15.847910 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.847815 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-service-ca\") pod \"e57429b8-f47e-4226-a24a-ad042ce3c038\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " Jul 29 16:53:15.847910 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.847850 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-oauth-config\") pod \"e57429b8-f47e-4226-a24a-ad042ce3c038\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " Jul 29 16:53:15.847910 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.847914 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-oauth-serving-cert\") pod \"e57429b8-f47e-4226-a24a-ad042ce3c038\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " Jul 29 16:53:15.848191 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.847951 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9mvx\" (UniqueName: \"kubernetes.io/projected/e57429b8-f47e-4226-a24a-ad042ce3c038-kube-api-access-q9mvx\") pod \"e57429b8-f47e-4226-a24a-ad042ce3c038\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " Jul 29 16:53:15.848191 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.847981 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-console-config\") pod \"e57429b8-f47e-4226-a24a-ad042ce3c038\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " Jul 29 16:53:15.848191 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.848024 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-trusted-ca-bundle\") pod \"e57429b8-f47e-4226-a24a-ad042ce3c038\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " Jul 29 16:53:15.848191 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.848048 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-serving-cert\") pod \"e57429b8-f47e-4226-a24a-ad042ce3c038\" (UID: \"e57429b8-f47e-4226-a24a-ad042ce3c038\") " Jul 29 16:53:15.848388 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.848367 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-service-ca" (OuterVolumeSpecName: "service-ca") pod "e57429b8-f47e-4226-a24a-ad042ce3c038" (UID: "e57429b8-f47e-4226-a24a-ad042ce3c038"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:15.848561 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.848535 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e57429b8-f47e-4226-a24a-ad042ce3c038" (UID: "e57429b8-f47e-4226-a24a-ad042ce3c038"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:15.848639 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.848542 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-console-config" (OuterVolumeSpecName: "console-config") pod "e57429b8-f47e-4226-a24a-ad042ce3c038" (UID: "e57429b8-f47e-4226-a24a-ad042ce3c038"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:15.848639 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.848604 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e57429b8-f47e-4226-a24a-ad042ce3c038" (UID: "e57429b8-f47e-4226-a24a-ad042ce3c038"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:53:15.850162 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.850137 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e57429b8-f47e-4226-a24a-ad042ce3c038" (UID: "e57429b8-f47e-4226-a24a-ad042ce3c038"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:53:15.850258 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.850231 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e57429b8-f47e-4226-a24a-ad042ce3c038" (UID: "e57429b8-f47e-4226-a24a-ad042ce3c038"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:53:15.850340 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.850320 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57429b8-f47e-4226-a24a-ad042ce3c038-kube-api-access-q9mvx" (OuterVolumeSpecName: "kube-api-access-q9mvx") pod "e57429b8-f47e-4226-a24a-ad042ce3c038" (UID: "e57429b8-f47e-4226-a24a-ad042ce3c038"). InnerVolumeSpecName "kube-api-access-q9mvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:53:15.948792 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.948749 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9mvx\" (UniqueName: \"kubernetes.io/projected/e57429b8-f47e-4226-a24a-ad042ce3c038-kube-api-access-q9mvx\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:15.948792 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.948789 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-console-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:15.949061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.948808 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-trusted-ca-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:15.949061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.948822 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:15.949061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.948835 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-service-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:15.949061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.948847 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e57429b8-f47e-4226-a24a-ad042ce3c038-console-oauth-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:15.949061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:15.948860 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e57429b8-f47e-4226-a24a-ad042ce3c038-oauth-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:53:16.554985 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.554944 2584 generic.go:356] "Generic (PLEG): container finished" podID="e57429b8-f47e-4226-a24a-ad042ce3c038" containerID="c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c" exitCode=0 Jul 29 16:53:16.555515 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.554998 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-88df969b4-pfx4x" Jul 29 16:53:16.555515 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.555033 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88df969b4-pfx4x" event={"ID":"e57429b8-f47e-4226-a24a-ad042ce3c038","Type":"ContainerDied","Data":"c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c"} Jul 29 16:53:16.555515 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.555125 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-88df969b4-pfx4x" event={"ID":"e57429b8-f47e-4226-a24a-ad042ce3c038","Type":"ContainerDied","Data":"3a04794cd9840b255de5fa7883335b8838d85887d077e95499f6c9cb2a486dd7"} Jul 29 16:53:16.555515 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.555157 2584 scope.go:117] "RemoveContainer" containerID="c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c" Jul 29 16:53:16.563309 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.563289 2584 scope.go:117] "RemoveContainer" containerID="c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c" Jul 29 16:53:16.563703 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:53:16.563681 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c\": container with ID starting with c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c not found: ID does not exist" containerID="c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c" Jul 29 16:53:16.563797 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.563708 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c"} err="failed to get container status \"c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c\": rpc error: code = NotFound desc = could not find container \"c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c\": container with ID starting with c73612c1778fb8f3cd5aaf5ada17cd5c1ecec16d09c6d9b0c921c22f17575a4c not found: ID does not exist" Jul 29 16:53:16.574499 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.574470 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-88df969b4-pfx4x"] Jul 29 16:53:16.579327 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:16.579301 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-88df969b4-pfx4x"] Jul 29 16:53:17.918208 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:17.918171 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57429b8-f47e-4226-a24a-ad042ce3c038" path="/var/lib/kubelet/pods/e57429b8-f47e-4226-a24a-ad042ce3c038/volumes" Jul 29 16:53:40.344525 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344492 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5799768964-h842n"] Jul 29 16:53:40.344892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344800 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57429b8-f47e-4226-a24a-ad042ce3c038" containerName="console" Jul 29 16:53:40.344892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344811 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57429b8-f47e-4226-a24a-ad042ce3c038" containerName="console" Jul 29 16:53:40.344892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344819 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af37f30-b47a-4d21-8472-2594f3ffb9d9" containerName="console" Jul 29 16:53:40.344892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344824 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af37f30-b47a-4d21-8472-2594f3ffb9d9" containerName="console" Jul 29 16:53:40.344892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344840 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" containerName="console" Jul 29 16:53:40.344892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344845 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" containerName="console" Jul 29 16:53:40.344892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344891 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7fbc49-4c8c-4d0f-8d38-9de142ead87d" containerName="console" Jul 29 16:53:40.345107 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344898 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af37f30-b47a-4d21-8472-2594f3ffb9d9" containerName="console" Jul 29 16:53:40.345107 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.344908 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57429b8-f47e-4226-a24a-ad042ce3c038" containerName="console" Jul 29 16:53:40.346540 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.346520 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.416137 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.416105 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5799768964-h842n"] Jul 29 16:53:40.460310 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.460271 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-serving-cert\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.460310 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.460309 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-oauth-config\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.460546 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.460362 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-trusted-ca-bundle\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.460546 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.460403 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-service-ca\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.460546 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.460439 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwl7g\" (UniqueName: \"kubernetes.io/projected/10b60b21-f522-44e1-a281-0790dbc928e7-kube-api-access-mwl7g\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.460546 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.460529 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-console-config\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.460669 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.460557 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-oauth-serving-cert\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.561732 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.561692 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-serving-cert\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.561732 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.561730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-oauth-config\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.561978 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.561772 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-trusted-ca-bundle\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.561978 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.561800 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-service-ca\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.561978 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.561829 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwl7g\" (UniqueName: \"kubernetes.io/projected/10b60b21-f522-44e1-a281-0790dbc928e7-kube-api-access-mwl7g\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.561978 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.561883 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-console-config\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.562180 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.562001 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-oauth-serving-cert\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.562694 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.562672 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-oauth-serving-cert\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.562818 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.562701 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-service-ca\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.562818 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.562777 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-trusted-ca-bundle\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.562936 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.562815 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-console-config\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.564258 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.564232 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-serving-cert\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.564386 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.564362 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-oauth-config\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.572018 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.571999 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwl7g\" (UniqueName: \"kubernetes.io/projected/10b60b21-f522-44e1-a281-0790dbc928e7-kube-api-access-mwl7g\") pod \"console-5799768964-h842n\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.655288 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.655187 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:40.790408 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:40.790376 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5799768964-h842n"] Jul 29 16:53:40.793605 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:53:40.793577 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b60b21_f522_44e1_a281_0790dbc928e7.slice/crio-09652f5f6749bd0ebe79f9244f9ae0e4b3bbd5a95ca92bb77d4650f1c57b0972 WatchSource:0}: Error finding container 09652f5f6749bd0ebe79f9244f9ae0e4b3bbd5a95ca92bb77d4650f1c57b0972: Status 404 returned error can't find the container with id 09652f5f6749bd0ebe79f9244f9ae0e4b3bbd5a95ca92bb77d4650f1c57b0972 Jul 29 16:53:41.661852 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:41.661766 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5799768964-h842n" event={"ID":"10b60b21-f522-44e1-a281-0790dbc928e7","Type":"ContainerStarted","Data":"0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7"} Jul 29 16:53:41.661852 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:41.661816 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5799768964-h842n" event={"ID":"10b60b21-f522-44e1-a281-0790dbc928e7","Type":"ContainerStarted","Data":"09652f5f6749bd0ebe79f9244f9ae0e4b3bbd5a95ca92bb77d4650f1c57b0972"} Jul 29 16:53:41.703477 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:41.703410 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5799768964-h842n" podStartSLOduration=1.703393124 podStartE2EDuration="1.703393124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:53:41.703337313 +0000 UTC m=+172.235218415" watchObservedRunningTime="2026-07-29 16:53:41.703393124 +0000 UTC m=+172.235274226" Jul 29 16:53:50.656017 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:50.655977 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:50.656436 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:50.656061 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:50.660829 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:50.660802 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:50.697203 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:50.697176 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5799768964-h842n" Jul 29 16:53:50.759327 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:53:50.759294 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8654dfb88f-z4xxt"] Jul 29 16:54:15.783904 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:15.783866 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8654dfb88f-z4xxt" podUID="96f23ec8-d017-4a6f-b445-ba37766b8a32" containerName="console" containerID="cri-o://02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001" gracePeriod=15 Jul 29 16:54:16.025417 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.025382 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:54:16.170016 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.169925 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-service-ca\") pod \"96f23ec8-d017-4a6f-b445-ba37766b8a32\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " Jul 29 16:54:16.170016 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.169962 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-trusted-ca-bundle\") pod \"96f23ec8-d017-4a6f-b445-ba37766b8a32\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " Jul 29 16:54:16.170016 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170011 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-serving-cert\") pod \"96f23ec8-d017-4a6f-b445-ba37766b8a32\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " Jul 29 16:54:16.170277 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170052 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-oauth-serving-cert\") pod \"96f23ec8-d017-4a6f-b445-ba37766b8a32\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " Jul 29 16:54:16.170277 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170078 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-oauth-config\") pod \"96f23ec8-d017-4a6f-b445-ba37766b8a32\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " Jul 29 16:54:16.170277 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170107 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-config\") pod \"96f23ec8-d017-4a6f-b445-ba37766b8a32\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " Jul 29 16:54:16.170277 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170151 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvtvs\" (UniqueName: \"kubernetes.io/projected/96f23ec8-d017-4a6f-b445-ba37766b8a32-kube-api-access-qvtvs\") pod \"96f23ec8-d017-4a6f-b445-ba37766b8a32\" (UID: \"96f23ec8-d017-4a6f-b445-ba37766b8a32\") " Jul 29 16:54:16.170515 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170362 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-service-ca" (OuterVolumeSpecName: "service-ca") pod "96f23ec8-d017-4a6f-b445-ba37766b8a32" (UID: "96f23ec8-d017-4a6f-b445-ba37766b8a32"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:54:16.170515 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170502 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "96f23ec8-d017-4a6f-b445-ba37766b8a32" (UID: "96f23ec8-d017-4a6f-b445-ba37766b8a32"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:54:16.170623 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170539 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "96f23ec8-d017-4a6f-b445-ba37766b8a32" (UID: "96f23ec8-d017-4a6f-b445-ba37766b8a32"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:54:16.170675 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.170619 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-config" (OuterVolumeSpecName: "console-config") pod "96f23ec8-d017-4a6f-b445-ba37766b8a32" (UID: "96f23ec8-d017-4a6f-b445-ba37766b8a32"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:54:16.172261 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.172233 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "96f23ec8-d017-4a6f-b445-ba37766b8a32" (UID: "96f23ec8-d017-4a6f-b445-ba37766b8a32"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:16.172353 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.172266 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "96f23ec8-d017-4a6f-b445-ba37766b8a32" (UID: "96f23ec8-d017-4a6f-b445-ba37766b8a32"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:54:16.172353 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.172293 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f23ec8-d017-4a6f-b445-ba37766b8a32-kube-api-access-qvtvs" (OuterVolumeSpecName: "kube-api-access-qvtvs") pod "96f23ec8-d017-4a6f-b445-ba37766b8a32" (UID: "96f23ec8-d017-4a6f-b445-ba37766b8a32"). InnerVolumeSpecName "kube-api-access-qvtvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:54:16.271272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.271237 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:54:16.271272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.271264 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-oauth-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:54:16.271272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.271273 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-oauth-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:54:16.271272 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.271282 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-console-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:54:16.271562 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.271291 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvtvs\" (UniqueName: \"kubernetes.io/projected/96f23ec8-d017-4a6f-b445-ba37766b8a32-kube-api-access-qvtvs\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:54:16.271562 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.271301 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-service-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:54:16.271562 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.271309 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/96f23ec8-d017-4a6f-b445-ba37766b8a32-trusted-ca-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:54:16.792548 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.792501 2584 generic.go:356] "Generic (PLEG): container finished" podID="96f23ec8-d017-4a6f-b445-ba37766b8a32" containerID="02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001" exitCode=0 Jul 29 16:54:16.792548 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.792549 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8654dfb88f-z4xxt" Jul 29 16:54:16.793009 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.792588 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8654dfb88f-z4xxt" event={"ID":"96f23ec8-d017-4a6f-b445-ba37766b8a32","Type":"ContainerDied","Data":"02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001"} Jul 29 16:54:16.793009 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.792637 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8654dfb88f-z4xxt" event={"ID":"96f23ec8-d017-4a6f-b445-ba37766b8a32","Type":"ContainerDied","Data":"e463724ee29415513c10af50c7ee332a05af148e42ad9aa6b84e7ad36d33b76e"} Jul 29 16:54:16.793009 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.792661 2584 scope.go:117] "RemoveContainer" containerID="02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001" Jul 29 16:54:16.801367 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.801350 2584 scope.go:117] "RemoveContainer" containerID="02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001" Jul 29 16:54:16.801632 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:54:16.801614 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001\": container with ID starting with 02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001 not found: ID does not exist" containerID="02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001" Jul 29 16:54:16.801692 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.801640 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001"} err="failed to get container status \"02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001\": rpc error: code = NotFound desc = could not find container \"02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001\": container with ID starting with 02917f2583a488748efc57294215d7b63be8964d59ca6069da1ef313251ae001 not found: ID does not exist" Jul 29 16:54:16.816836 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.816804 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8654dfb88f-z4xxt"] Jul 29 16:54:16.820090 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:16.820067 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8654dfb88f-z4xxt"] Jul 29 16:54:17.917713 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:17.917678 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f23ec8-d017-4a6f-b445-ba37766b8a32" path="/var/lib/kubelet/pods/96f23ec8-d017-4a6f-b445-ba37766b8a32/volumes" Jul 29 16:54:41.434454 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.434420 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw"] Jul 29 16:54:41.434879 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.434718 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f23ec8-d017-4a6f-b445-ba37766b8a32" containerName="console" Jul 29 16:54:41.434879 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.434729 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f23ec8-d017-4a6f-b445-ba37766b8a32" containerName="console" Jul 29 16:54:41.434879 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.434783 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f23ec8-d017-4a6f-b445-ba37766b8a32" containerName="console" Jul 29 16:54:41.437570 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.437554 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.440003 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.439980 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 29 16:54:41.440127 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.440009 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-z6ssk\"" Jul 29 16:54:41.440771 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.440749 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 29 16:54:41.446607 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.446586 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw"] Jul 29 16:54:41.496253 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.496209 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.496430 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.496281 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.496430 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.496305 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7j2z\" (UniqueName: \"kubernetes.io/projected/272fb035-b414-41f7-9f62-110e65d99163-kube-api-access-t7j2z\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.597479 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.597432 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.597637 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.597536 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.597637 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.597564 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7j2z\" (UniqueName: \"kubernetes.io/projected/272fb035-b414-41f7-9f62-110e65d99163-kube-api-access-t7j2z\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.597893 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.597871 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.597937 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.597894 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.607360 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.607328 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7j2z\" (UniqueName: \"kubernetes.io/projected/272fb035-b414-41f7-9f62-110e65d99163-kube-api-access-t7j2z\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.747938 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.747903 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:54:41.878555 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:41.878525 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw"] Jul 29 16:54:41.882286 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:54:41.882257 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod272fb035_b414_41f7_9f62_110e65d99163.slice/crio-0e0e2aaa27be408452f2cd4728b389d1bf316bb755daa34c8dcdfdac3e78a04d WatchSource:0}: Error finding container 0e0e2aaa27be408452f2cd4728b389d1bf316bb755daa34c8dcdfdac3e78a04d: Status 404 returned error can't find the container with id 0e0e2aaa27be408452f2cd4728b389d1bf316bb755daa34c8dcdfdac3e78a04d Jul 29 16:54:42.889428 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:42.889390 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" event={"ID":"272fb035-b414-41f7-9f62-110e65d99163","Type":"ContainerStarted","Data":"0e0e2aaa27be408452f2cd4728b389d1bf316bb755daa34c8dcdfdac3e78a04d"} Jul 29 16:54:48.915360 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:48.915325 2584 generic.go:356] "Generic (PLEG): container finished" podID="272fb035-b414-41f7-9f62-110e65d99163" containerID="535885091aa69bc55d36c44349e9ef77b19d9bb46a346ccb67186a9312c9278a" exitCode=0 Jul 29 16:54:48.915732 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:48.915403 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" event={"ID":"272fb035-b414-41f7-9f62-110e65d99163","Type":"ContainerDied","Data":"535885091aa69bc55d36c44349e9ef77b19d9bb46a346ccb67186a9312c9278a"} Jul 29 16:54:51.928861 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:51.928817 2584 generic.go:356] "Generic (PLEG): container finished" podID="272fb035-b414-41f7-9f62-110e65d99163" containerID="bc727b90c03ac49de2853d850965493317c1a70237366c1fd765784f63007e56" exitCode=0 Jul 29 16:54:51.929258 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:51.928891 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" event={"ID":"272fb035-b414-41f7-9f62-110e65d99163","Type":"ContainerDied","Data":"bc727b90c03ac49de2853d850965493317c1a70237366c1fd765784f63007e56"} Jul 29 16:54:58.959198 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:58.959157 2584 generic.go:356] "Generic (PLEG): container finished" podID="272fb035-b414-41f7-9f62-110e65d99163" containerID="8a1c5a664133f371146fb6ea32855ab578efe6a62cff4693e02d6a398a580a18" exitCode=0 Jul 29 16:54:58.959724 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:54:58.959242 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" event={"ID":"272fb035-b414-41f7-9f62-110e65d99163","Type":"ContainerDied","Data":"8a1c5a664133f371146fb6ea32855ab578efe6a62cff4693e02d6a398a580a18"} Jul 29 16:55:00.086224 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.086198 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:55:00.166348 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.166312 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-bundle\") pod \"272fb035-b414-41f7-9f62-110e65d99163\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " Jul 29 16:55:00.166348 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.166358 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-util\") pod \"272fb035-b414-41f7-9f62-110e65d99163\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " Jul 29 16:55:00.166635 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.166383 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7j2z\" (UniqueName: \"kubernetes.io/projected/272fb035-b414-41f7-9f62-110e65d99163-kube-api-access-t7j2z\") pod \"272fb035-b414-41f7-9f62-110e65d99163\" (UID: \"272fb035-b414-41f7-9f62-110e65d99163\") " Jul 29 16:55:00.167183 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.167154 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-bundle" (OuterVolumeSpecName: "bundle") pod "272fb035-b414-41f7-9f62-110e65d99163" (UID: "272fb035-b414-41f7-9f62-110e65d99163"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:55:00.168623 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.168595 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/272fb035-b414-41f7-9f62-110e65d99163-kube-api-access-t7j2z" (OuterVolumeSpecName: "kube-api-access-t7j2z") pod "272fb035-b414-41f7-9f62-110e65d99163" (UID: "272fb035-b414-41f7-9f62-110e65d99163"). InnerVolumeSpecName "kube-api-access-t7j2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:55:00.171164 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.171143 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-util" (OuterVolumeSpecName: "util") pod "272fb035-b414-41f7-9f62-110e65d99163" (UID: "272fb035-b414-41f7-9f62-110e65d99163"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 16:55:00.267297 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.267197 2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:55:00.267297 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.267238 2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/272fb035-b414-41f7-9f62-110e65d99163-util\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:55:00.267297 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.267248 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7j2z\" (UniqueName: \"kubernetes.io/projected/272fb035-b414-41f7-9f62-110e65d99163-kube-api-access-t7j2z\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:55:00.968907 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.968879 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" Jul 29 16:55:00.969092 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.968874 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5l7dzw" event={"ID":"272fb035-b414-41f7-9f62-110e65d99163","Type":"ContainerDied","Data":"0e0e2aaa27be408452f2cd4728b389d1bf316bb755daa34c8dcdfdac3e78a04d"} Jul 29 16:55:00.969092 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:00.969025 2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e0e2aaa27be408452f2cd4728b389d1bf316bb755daa34c8dcdfdac3e78a04d" Jul 29 16:55:04.440126 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.440094 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m"] Jul 29 16:55:04.440533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.440364 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="272fb035-b414-41f7-9f62-110e65d99163" containerName="util" Jul 29 16:55:04.440533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.440375 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="272fb035-b414-41f7-9f62-110e65d99163" containerName="util" Jul 29 16:55:04.440533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.440384 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="272fb035-b414-41f7-9f62-110e65d99163" containerName="extract" Jul 29 16:55:04.440533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.440390 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="272fb035-b414-41f7-9f62-110e65d99163" containerName="extract" Jul 29 16:55:04.440533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.440411 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="272fb035-b414-41f7-9f62-110e65d99163" containerName="pull" Jul 29 16:55:04.440533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.440416 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="272fb035-b414-41f7-9f62-110e65d99163" containerName="pull" Jul 29 16:55:04.440533 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.440474 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="272fb035-b414-41f7-9f62-110e65d99163" containerName="extract" Jul 29 16:55:04.442490 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.442467 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:04.444987 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.444964 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 29 16:55:04.445087 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.445044 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 29 16:55:04.445479 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.445457 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-fbhdp\"" Jul 29 16:55:04.445590 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.445489 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 29 16:55:04.458083 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.458054 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m"] Jul 29 16:55:04.506110 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.506076 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d6efba7f-8978-437e-83dd-ffb10a5d1729-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-lc65m\" (UID: \"d6efba7f-8978-437e-83dd-ffb10a5d1729\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:04.506275 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.506136 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62nl4\" (UniqueName: \"kubernetes.io/projected/d6efba7f-8978-437e-83dd-ffb10a5d1729-kube-api-access-62nl4\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-lc65m\" (UID: \"d6efba7f-8978-437e-83dd-ffb10a5d1729\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:04.607486 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.607430 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d6efba7f-8978-437e-83dd-ffb10a5d1729-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-lc65m\" (UID: \"d6efba7f-8978-437e-83dd-ffb10a5d1729\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:04.607655 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.607512 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62nl4\" (UniqueName: \"kubernetes.io/projected/d6efba7f-8978-437e-83dd-ffb10a5d1729-kube-api-access-62nl4\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-lc65m\" (UID: \"d6efba7f-8978-437e-83dd-ffb10a5d1729\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:04.609755 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.609734 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d6efba7f-8978-437e-83dd-ffb10a5d1729-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-lc65m\" (UID: \"d6efba7f-8978-437e-83dd-ffb10a5d1729\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:04.616481 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.616435 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62nl4\" (UniqueName: \"kubernetes.io/projected/d6efba7f-8978-437e-83dd-ffb10a5d1729-kube-api-access-62nl4\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-lc65m\" (UID: \"d6efba7f-8978-437e-83dd-ffb10a5d1729\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:04.753182 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.753128 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:04.888021 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.887998 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m"] Jul 29 16:55:04.890345 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:55:04.890319 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6efba7f_8978_437e_83dd_ffb10a5d1729.slice/crio-5052c0a1fd2df56d371bcde813e98935f85c6c208ebf7b98277f1c3a03cfcf24 WatchSource:0}: Error finding container 5052c0a1fd2df56d371bcde813e98935f85c6c208ebf7b98277f1c3a03cfcf24: Status 404 returned error can't find the container with id 5052c0a1fd2df56d371bcde813e98935f85c6c208ebf7b98277f1c3a03cfcf24 Jul 29 16:55:04.985913 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:04.985881 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" event={"ID":"d6efba7f-8978-437e-83dd-ffb10a5d1729","Type":"ContainerStarted","Data":"5052c0a1fd2df56d371bcde813e98935f85c6c208ebf7b98277f1c3a03cfcf24"} Jul 29 16:55:10.008209 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.008164 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" event={"ID":"d6efba7f-8978-437e-83dd-ffb10a5d1729","Type":"ContainerStarted","Data":"a7d392048cd7f16e2b5ef6b6cf94097440a3a217b895093acb86ace18b01d2b7"} Jul 29 16:55:10.008709 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.008270 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:10.030725 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.030676 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" podStartSLOduration=1.369200798 podStartE2EDuration="6.03065971s" totalImagesPullingTime="4.661458912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:55:10.029182248 +0000 UTC m=+260.561063351" watchObservedRunningTime="2026-07-29 16:55:10.03065971 +0000 UTC m=+260.562540816" Jul 29 16:55:10.488004 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.487967 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-nmzcs"] Jul 29 16:55:10.513579 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.513548 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-nmzcs"] Jul 29 16:55:10.513750 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.513664 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:10.516409 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.516364 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 29 16:55:10.516573 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.516456 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-x4kgg\"" Jul 29 16:55:10.516573 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.516436 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 29 16:55:10.665047 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.665017 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:10.665217 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.665066 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e98d9f1f-692d-4095-b619-a5f3241cb4cb-cabundle0\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:10.665217 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.665137 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9cg7\" (UniqueName: \"kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-kube-api-access-b9cg7\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:10.766061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.765979 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:10.766061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.766025 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e98d9f1f-692d-4095-b619-a5f3241cb4cb-cabundle0\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:10.766061 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.766055 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9cg7\" (UniqueName: \"kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-kube-api-access-b9cg7\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:10.766357 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:10.766131 2584 secret.go:281] references non-existent secret key: ca.crt Jul 29 16:55:10.766357 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:10.766151 2584 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 16:55:10.766357 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:10.766160 2584 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-nmzcs: references non-existent secret key: ca.crt Jul 29 16:55:10.766357 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:10.766211 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates podName:e98d9f1f-692d-4095-b619-a5f3241cb4cb nodeName:}" failed. No retries permitted until 2026-07-29 16:55:11.266196253 +0000 UTC m=+261.798077334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates") pod "keda-operator-77f648d694-nmzcs" (UID: "e98d9f1f-692d-4095-b619-a5f3241cb4cb") : references non-existent secret key: ca.crt Jul 29 16:55:10.766806 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.766783 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/e98d9f1f-692d-4095-b619-a5f3241cb4cb-cabundle0\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:10.777394 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:10.777371 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9cg7\" (UniqueName: \"kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-kube-api-access-b9cg7\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:11.271278 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.271242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:11.271686 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:11.271387 2584 secret.go:281] references non-existent secret key: ca.crt Jul 29 16:55:11.271686 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:11.271406 2584 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 29 16:55:11.271686 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:11.271415 2584 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-nmzcs: references non-existent secret key: ca.crt Jul 29 16:55:11.271686 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:11.271494 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates podName:e98d9f1f-692d-4095-b619-a5f3241cb4cb nodeName:}" failed. No retries permitted until 2026-07-29 16:55:12.271474524 +0000 UTC m=+262.803355629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates") pod "keda-operator-77f648d694-nmzcs" (UID: "e98d9f1f-692d-4095-b619-a5f3241cb4cb") : references non-existent secret key: ca.crt Jul 29 16:55:11.396278 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.396202 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-2glx5"] Jul 29 16:55:11.417580 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.417548 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-2glx5"] Jul 29 16:55:11.417754 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.417640 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.420340 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.420316 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 29 16:55:11.573592 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.573507 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/95a223f6-da11-4e72-a90f-c35df27233ab-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.573592 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.573558 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/95a223f6-da11-4e72-a90f-c35df27233ab-certificates\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.573780 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.573640 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp2nm\" (UniqueName: \"kubernetes.io/projected/95a223f6-da11-4e72-a90f-c35df27233ab-kube-api-access-bp2nm\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.588630 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.588598 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-p5c6k"] Jul 29 16:55:11.602046 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.602017 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:11.604882 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.604855 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 29 16:55:11.611726 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.611698 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-p5c6k"] Jul 29 16:55:11.674716 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.674684 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxmt\" (UniqueName: \"kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-kube-api-access-4zxmt\") pod \"keda-admission-56f9798bb4-p5c6k\" (UID: \"4c55ad7e-2802-404b-9ca9-9b00e1826f18\") " pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:11.674925 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.674725 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/95a223f6-da11-4e72-a90f-c35df27233ab-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.674925 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.674751 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-certificates\") pod \"keda-admission-56f9798bb4-p5c6k\" (UID: \"4c55ad7e-2802-404b-9ca9-9b00e1826f18\") " pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:11.674925 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.674823 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/95a223f6-da11-4e72-a90f-c35df27233ab-certificates\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.674925 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.674878 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp2nm\" (UniqueName: \"kubernetes.io/projected/95a223f6-da11-4e72-a90f-c35df27233ab-kube-api-access-bp2nm\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.675162 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.675140 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/95a223f6-da11-4e72-a90f-c35df27233ab-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.677336 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.677315 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/95a223f6-da11-4e72-a90f-c35df27233ab-certificates\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.686273 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.686244 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp2nm\" (UniqueName: \"kubernetes.io/projected/95a223f6-da11-4e72-a90f-c35df27233ab-kube-api-access-bp2nm\") pod \"keda-metrics-apiserver-55557df8c-2glx5\" (UID: \"95a223f6-da11-4e72-a90f-c35df27233ab\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.727836 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.727803 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:11.775539 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.775507 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxmt\" (UniqueName: \"kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-kube-api-access-4zxmt\") pod \"keda-admission-56f9798bb4-p5c6k\" (UID: \"4c55ad7e-2802-404b-9ca9-9b00e1826f18\") " pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:11.775734 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.775569 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-certificates\") pod \"keda-admission-56f9798bb4-p5c6k\" (UID: \"4c55ad7e-2802-404b-9ca9-9b00e1826f18\") " pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:11.775808 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:11.775788 2584 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 29 16:55:11.775860 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:11.775823 2584 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-p5c6k: secret "keda-admission-webhooks-certs" not found Jul 29 16:55:11.775895 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:55:11.775888 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-certificates podName:4c55ad7e-2802-404b-9ca9-9b00e1826f18 nodeName:}" failed. No retries permitted until 2026-07-29 16:55:12.275869419 +0000 UTC m=+262.807750501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-certificates") pod "keda-admission-56f9798bb4-p5c6k" (UID: "4c55ad7e-2802-404b-9ca9-9b00e1826f18") : secret "keda-admission-webhooks-certs" not found Jul 29 16:55:11.792770 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.792691 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxmt\" (UniqueName: \"kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-kube-api-access-4zxmt\") pod \"keda-admission-56f9798bb4-p5c6k\" (UID: \"4c55ad7e-2802-404b-9ca9-9b00e1826f18\") " pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:11.909011 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:11.908980 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-2glx5"] Jul 29 16:55:11.915231 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:55:11.915196 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a223f6_da11_4e72_a90f_c35df27233ab.slice/crio-d60b666200a0daa5daa0850e66b623a125d891270269097d1e041b59e6b1d9f6 WatchSource:0}: Error finding container d60b666200a0daa5daa0850e66b623a125d891270269097d1e041b59e6b1d9f6: Status 404 returned error can't find the container with id d60b666200a0daa5daa0850e66b623a125d891270269097d1e041b59e6b1d9f6 Jul 29 16:55:12.018916 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.018870 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" event={"ID":"95a223f6-da11-4e72-a90f-c35df27233ab","Type":"ContainerStarted","Data":"d60b666200a0daa5daa0850e66b623a125d891270269097d1e041b59e6b1d9f6"} Jul 29 16:55:12.283000 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.282965 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:12.283496 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.283012 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-certificates\") pod \"keda-admission-56f9798bb4-p5c6k\" (UID: \"4c55ad7e-2802-404b-9ca9-9b00e1826f18\") " pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:12.285518 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.285495 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e98d9f1f-692d-4095-b619-a5f3241cb4cb-certificates\") pod \"keda-operator-77f648d694-nmzcs\" (UID: \"e98d9f1f-692d-4095-b619-a5f3241cb4cb\") " pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:12.285518 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.285505 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/4c55ad7e-2802-404b-9ca9-9b00e1826f18-certificates\") pod \"keda-admission-56f9798bb4-p5c6k\" (UID: \"4c55ad7e-2802-404b-9ca9-9b00e1826f18\") " pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:12.324772 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.324733 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:12.490906 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.490876 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-nmzcs"] Jul 29 16:55:12.493805 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:55:12.493780 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98d9f1f_692d_4095_b619_a5f3241cb4cb.slice/crio-91d69ff5fddb0a50a74fbeadd2fe798e6bd46cd7ae44da1b29ca7a96f79a63e8 WatchSource:0}: Error finding container 91d69ff5fddb0a50a74fbeadd2fe798e6bd46cd7ae44da1b29ca7a96f79a63e8: Status 404 returned error can't find the container with id 91d69ff5fddb0a50a74fbeadd2fe798e6bd46cd7ae44da1b29ca7a96f79a63e8 Jul 29 16:55:12.514920 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.514892 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:12.679601 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:12.679468 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-p5c6k"] Jul 29 16:55:12.682186 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:55:12.682161 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c55ad7e_2802_404b_9ca9_9b00e1826f18.slice/crio-3865f96ca3a8c8fe74f6d3fa50657738909c28f0038d0b71caac96a84c715753 WatchSource:0}: Error finding container 3865f96ca3a8c8fe74f6d3fa50657738909c28f0038d0b71caac96a84c715753: Status 404 returned error can't find the container with id 3865f96ca3a8c8fe74f6d3fa50657738909c28f0038d0b71caac96a84c715753 Jul 29 16:55:13.024635 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:13.024594 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" event={"ID":"4c55ad7e-2802-404b-9ca9-9b00e1826f18","Type":"ContainerStarted","Data":"3865f96ca3a8c8fe74f6d3fa50657738909c28f0038d0b71caac96a84c715753"} Jul 29 16:55:13.025573 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:13.025551 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-nmzcs" event={"ID":"e98d9f1f-692d-4095-b619-a5f3241cb4cb","Type":"ContainerStarted","Data":"91d69ff5fddb0a50a74fbeadd2fe798e6bd46cd7ae44da1b29ca7a96f79a63e8"} Jul 29 16:55:16.040575 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:16.040544 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" event={"ID":"4c55ad7e-2802-404b-9ca9-9b00e1826f18","Type":"ContainerStarted","Data":"3d66b0831febdbf9b52aa549296f9a3866a02ba47d324f00d409101e2ece0c1b"} Jul 29 16:55:16.041001 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:16.040645 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:16.042310 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:16.042277 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-nmzcs" event={"ID":"e98d9f1f-692d-4095-b619-a5f3241cb4cb","Type":"ContainerStarted","Data":"b52a99f2b5407475397a1057f1546c3d1a3d3ec49eb4312881dee4503e3ac5bb"} Jul 29 16:55:16.042397 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:16.042326 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:16.056430 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:16.056373 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" podStartSLOduration=1.772840182 podStartE2EDuration="5.056354101s" totalImagesPullingTime="3.283513919s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:55:16.055794375 +0000 UTC m=+266.587675477" watchObservedRunningTime="2026-07-29 16:55:16.056354101 +0000 UTC m=+266.588235205" Jul 29 16:55:16.072700 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:16.072479 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-nmzcs" podStartSLOduration=2.591056216 podStartE2EDuration="6.07246083s" totalImagesPullingTime="3.481404614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:55:16.071970408 +0000 UTC m=+266.603851510" watchObservedRunningTime="2026-07-29 16:55:16.07246083 +0000 UTC m=+266.604341933" Jul 29 16:55:29.100818 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:29.100779 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" event={"ID":"95a223f6-da11-4e72-a90f-c35df27233ab","Type":"ContainerStarted","Data":"ec40267fccd84a66b5943d4217c82f6da4254542a56dd3110f3b2038902e856a"} Jul 29 16:55:29.101238 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:29.100893 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:29.117439 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:29.117387 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" podStartSLOduration=1.36826462 podStartE2EDuration="18.117372097s" totalImagesPullingTime="16.749107477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:55:29.116440015 +0000 UTC m=+279.648321112" watchObservedRunningTime="2026-07-29 16:55:29.117372097 +0000 UTC m=+279.649253200" Jul 29 16:55:31.015510 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:31.015478 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-lc65m" Jul 29 16:55:37.049790 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:37.049760 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-nmzcs" Jul 29 16:55:37.050202 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:37.049828 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-p5c6k" Jul 29 16:55:40.110688 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:40.110653 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-2glx5" Jul 29 16:55:49.816066 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:55:49.816037 2584 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 16:56:15.900657 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:15.900624 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-nfdb8"] Jul 29 16:56:15.902820 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:15.902799 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:15.906134 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:15.906115 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 29 16:56:15.906134 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:15.906125 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 29 16:56:15.906296 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:15.906258 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-dr6ms\"" Jul 29 16:56:15.907224 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:15.907211 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 29 16:56:15.919818 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:15.919794 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-nfdb8"] Jul 29 16:56:16.006628 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.006588 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgtfq\" (UniqueName: \"kubernetes.io/projected/fbd7f685-b3ca-4be5-bac0-e4ae9ba14345-kube-api-access-fgtfq\") pod \"llmisvc-controller-manager-67d95fdc48-nfdb8\" (UID: \"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:16.006844 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.006674 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbd7f685-b3ca-4be5-bac0-e4ae9ba14345-cert\") pod \"llmisvc-controller-manager-67d95fdc48-nfdb8\" (UID: \"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:16.107608 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.107577 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgtfq\" (UniqueName: \"kubernetes.io/projected/fbd7f685-b3ca-4be5-bac0-e4ae9ba14345-kube-api-access-fgtfq\") pod \"llmisvc-controller-manager-67d95fdc48-nfdb8\" (UID: \"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:16.107799 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.107616 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbd7f685-b3ca-4be5-bac0-e4ae9ba14345-cert\") pod \"llmisvc-controller-manager-67d95fdc48-nfdb8\" (UID: \"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:16.109991 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.109960 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbd7f685-b3ca-4be5-bac0-e4ae9ba14345-cert\") pod \"llmisvc-controller-manager-67d95fdc48-nfdb8\" (UID: \"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:16.116558 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.116537 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgtfq\" (UniqueName: \"kubernetes.io/projected/fbd7f685-b3ca-4be5-bac0-e4ae9ba14345-kube-api-access-fgtfq\") pod \"llmisvc-controller-manager-67d95fdc48-nfdb8\" (UID: \"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:16.213508 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.213477 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:16.369166 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.369142 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-nfdb8"] Jul 29 16:56:16.371274 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:56:16.371248 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfbd7f685_b3ca_4be5_bac0_e4ae9ba14345.slice/crio-e82b11b045cd64c8aa782d91f1cdc4b2257832449619df715e72b4981a1777b7 WatchSource:0}: Error finding container e82b11b045cd64c8aa782d91f1cdc4b2257832449619df715e72b4981a1777b7: Status 404 returned error can't find the container with id e82b11b045cd64c8aa782d91f1cdc4b2257832449619df715e72b4981a1777b7 Jul 29 16:56:16.372494 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:16.372474 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 16:56:17.304927 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:17.304894 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerStarted","Data":"e82b11b045cd64c8aa782d91f1cdc4b2257832449619df715e72b4981a1777b7"} Jul 29 16:56:19.315167 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:19.315129 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" containerID="1420b82ac04b4455f3ee8c1d90a88281f172659fef0b3d8e287f01a726087027" exitCode=1 Jul 29 16:56:19.315556 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:19.315213 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerDied","Data":"1420b82ac04b4455f3ee8c1d90a88281f172659fef0b3d8e287f01a726087027"} Jul 29 16:56:19.315556 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:19.315399 2584 scope.go:117] "RemoveContainer" containerID="1420b82ac04b4455f3ee8c1d90a88281f172659fef0b3d8e287f01a726087027" Jul 29 16:56:20.321168 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:20.321136 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" containerID="c643a862acf9444e567103964979fc0ed51c1e493c5c789c0e1f9c2bee436b70" exitCode=1 Jul 29 16:56:20.321571 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:20.321211 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerDied","Data":"c643a862acf9444e567103964979fc0ed51c1e493c5c789c0e1f9c2bee436b70"} Jul 29 16:56:20.321571 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:20.321272 2584 scope.go:117] "RemoveContainer" containerID="1420b82ac04b4455f3ee8c1d90a88281f172659fef0b3d8e287f01a726087027" Jul 29 16:56:20.321680 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:20.321570 2584 scope.go:117] "RemoveContainer" containerID="c643a862acf9444e567103964979fc0ed51c1e493c5c789c0e1f9c2bee436b70" Jul 29 16:56:20.321824 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:56:20.321797 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:56:21.214625 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:21.214589 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:21.327108 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:21.327085 2584 scope.go:117] "RemoveContainer" containerID="c643a862acf9444e567103964979fc0ed51c1e493c5c789c0e1f9c2bee436b70" Jul 29 16:56:21.327492 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:56:21.327282 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:56:22.331247 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:22.331224 2584 scope.go:117] "RemoveContainer" containerID="c643a862acf9444e567103964979fc0ed51c1e493c5c789c0e1f9c2bee436b70" Jul 29 16:56:22.331650 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:56:22.331403 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:56:26.214658 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:26.214620 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:26.215063 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:26.214992 2584 scope.go:117] "RemoveContainer" containerID="c643a862acf9444e567103964979fc0ed51c1e493c5c789c0e1f9c2bee436b70" Jul 29 16:56:26.215200 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:56:26.215180 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:56:37.913292 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:37.913257 2584 scope.go:117] "RemoveContainer" containerID="c643a862acf9444e567103964979fc0ed51c1e493c5c789c0e1f9c2bee436b70" Jul 29 16:56:38.399504 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:38.399465 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerStarted","Data":"d7766d8739d1be26b0034616d7ebe727c7ba24389b699d03466d60b8614fa00c"} Jul 29 16:56:38.399700 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:38.399681 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:38.421902 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:38.421854 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podStartSLOduration=21.103330337 podStartE2EDuration="23.42183892s" totalImagesPullingTime="2.318508583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:56:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:56:38.420521497 +0000 UTC m=+348.952402601" watchObservedRunningTime="2026-07-29 16:56:38.42183892 +0000 UTC m=+348.953720022" Jul 29 16:56:39.405478 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:39.405427 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" containerID="d7766d8739d1be26b0034616d7ebe727c7ba24389b699d03466d60b8614fa00c" exitCode=1 Jul 29 16:56:39.405892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:39.405511 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerDied","Data":"d7766d8739d1be26b0034616d7ebe727c7ba24389b699d03466d60b8614fa00c"} Jul 29 16:56:39.405892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:39.405599 2584 scope.go:117] "RemoveContainer" containerID="c643a862acf9444e567103964979fc0ed51c1e493c5c789c0e1f9c2bee436b70" Jul 29 16:56:39.405892 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:39.405854 2584 scope.go:117] "RemoveContainer" containerID="d7766d8739d1be26b0034616d7ebe727c7ba24389b699d03466d60b8614fa00c" Jul 29 16:56:39.406049 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:56:39.406032 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:56:40.412306 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:40.412279 2584 scope.go:117] "RemoveContainer" containerID="d7766d8739d1be26b0034616d7ebe727c7ba24389b699d03466d60b8614fa00c" Jul 29 16:56:40.413255 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:56:40.413217 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:56:46.213898 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:46.213814 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:56:46.214263 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:56:46.214169 2584 scope.go:117] "RemoveContainer" containerID="d7766d8739d1be26b0034616d7ebe727c7ba24389b699d03466d60b8614fa00c" Jul 29 16:56:46.214362 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:56:46.214339 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:00.913060 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:00.913027 2584 scope.go:117] "RemoveContainer" containerID="d7766d8739d1be26b0034616d7ebe727c7ba24389b699d03466d60b8614fa00c" Jul 29 16:57:01.503831 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:01.503749 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerStarted","Data":"aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb"} Jul 29 16:57:01.504001 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:01.503979 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:57:02.509626 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:02.509596 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" containerID="aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb" exitCode=1 Jul 29 16:57:02.510034 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:02.509636 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerDied","Data":"aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb"} Jul 29 16:57:02.510034 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:02.509683 2584 scope.go:117] "RemoveContainer" containerID="d7766d8739d1be26b0034616d7ebe727c7ba24389b699d03466d60b8614fa00c" Jul 29 16:57:02.510034 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:02.509874 2584 scope.go:117] "RemoveContainer" containerID="aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb" Jul 29 16:57:02.510152 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:57:02.510091 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:03.515727 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:03.515692 2584 scope.go:117] "RemoveContainer" containerID="aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb" Jul 29 16:57:03.516124 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:57:03.515888 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:06.214101 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:06.214051 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:57:06.214541 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:06.214436 2584 scope.go:117] "RemoveContainer" containerID="aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb" Jul 29 16:57:06.214648 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:57:06.214627 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:17.918137 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:17.918108 2584 scope.go:117] "RemoveContainer" containerID="aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb" Jul 29 16:57:17.918632 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:57:17.918273 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:31.913981 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:31.913951 2584 scope.go:117] "RemoveContainer" containerID="aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb" Jul 29 16:57:31.914547 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:57:31.914111 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:46.913727 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:46.913699 2584 scope.go:117] "RemoveContainer" containerID="aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb" Jul 29 16:57:47.706514 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:47.706478 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerStarted","Data":"209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae"} Jul 29 16:57:47.706695 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:47.706679 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:57:48.713142 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:48.713110 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" exitCode=1 Jul 29 16:57:48.713612 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:48.713149 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerDied","Data":"209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae"} Jul 29 16:57:48.713612 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:48.713197 2584 scope.go:117] "RemoveContainer" containerID="aef226396c267deb8ad867d397854742c4b1798f31d64ba15765018834cb92fb" Jul 29 16:57:48.713612 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:48.713407 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:57:48.713780 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:57:48.713628 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:49.719131 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:49.719102 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:57:49.719541 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:57:49.719293 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:56.214487 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:56.214423 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:57:56.215047 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:56.214839 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:57:56.215047 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:57:56.215014 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:57:57.307745 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.307712 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb49457b5-zr2j8"] Jul 29 16:57:57.312125 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.312084 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.324517 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.324488 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb49457b5-zr2j8"] Jul 29 16:57:57.449515 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.449478 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-trusted-ca-bundle\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.449689 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.449564 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-oauth-serving-cert\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.449689 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.449605 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-serving-cert\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.449689 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.449627 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-oauth-config\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.449689 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.449686 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-service-ca\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.449843 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.449729 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qdmc\" (UniqueName: \"kubernetes.io/projected/c38b8d58-5a6f-4abb-bc26-e459a20d5888-kube-api-access-2qdmc\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.449843 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.449765 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-config\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.550407 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.550365 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-config\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.550616 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.550419 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-trusted-ca-bundle\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.550616 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.550472 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-oauth-serving-cert\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.550616 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.550494 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-serving-cert\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.550616 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.550510 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-oauth-config\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.550616 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.550544 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-service-ca\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.550616 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.550573 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qdmc\" (UniqueName: \"kubernetes.io/projected/c38b8d58-5a6f-4abb-bc26-e459a20d5888-kube-api-access-2qdmc\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.551265 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.551230 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-config\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.551265 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.551248 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-oauth-serving-cert\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.551265 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.551262 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-service-ca\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.551514 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.551422 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c38b8d58-5a6f-4abb-bc26-e459a20d5888-trusted-ca-bundle\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.553044 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.553011 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-oauth-config\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.553163 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.553146 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c38b8d58-5a6f-4abb-bc26-e459a20d5888-console-serving-cert\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.561464 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.561391 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qdmc\" (UniqueName: \"kubernetes.io/projected/c38b8d58-5a6f-4abb-bc26-e459a20d5888-kube-api-access-2qdmc\") pod \"console-fb49457b5-zr2j8\" (UID: \"c38b8d58-5a6f-4abb-bc26-e459a20d5888\") " pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.621021 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.620988 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:57:57.752268 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:57.752244 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb49457b5-zr2j8"] Jul 29 16:57:57.754830 ip-10-0-142-232 kubenswrapper[2584]: W0729 16:57:57.754808 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38b8d58_5a6f_4abb_bc26_e459a20d5888.slice/crio-db84451c2bafa53006ff5ccfb665cc9b9e14f3969a4932ad93d4af648a672bd7 WatchSource:0}: Error finding container db84451c2bafa53006ff5ccfb665cc9b9e14f3969a4932ad93d4af648a672bd7: Status 404 returned error can't find the container with id db84451c2bafa53006ff5ccfb665cc9b9e14f3969a4932ad93d4af648a672bd7 Jul 29 16:57:58.757807 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:58.757771 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb49457b5-zr2j8" event={"ID":"c38b8d58-5a6f-4abb-bc26-e459a20d5888","Type":"ContainerStarted","Data":"f765d3d1319fbe6a650aba05934b6cc9d0cf6799ab5b076e58d2bfea2ec2b334"} Jul 29 16:57:58.758217 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:58.757823 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb49457b5-zr2j8" event={"ID":"c38b8d58-5a6f-4abb-bc26-e459a20d5888","Type":"ContainerStarted","Data":"db84451c2bafa53006ff5ccfb665cc9b9e14f3969a4932ad93d4af648a672bd7"} Jul 29 16:57:58.779250 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:57:58.779203 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb49457b5-zr2j8" podStartSLOduration=1.779185719 podStartE2EDuration="1.779185719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 16:57:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 16:57:58.777540631 +0000 UTC m=+429.309421735" watchObservedRunningTime="2026-07-29 16:57:58.779185719 +0000 UTC m=+429.311066878" Jul 29 16:58:06.913667 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:06.913638 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:58:06.914143 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:58:06.913813 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:58:07.621525 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:07.621481 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:58:07.621702 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:07.621547 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:58:07.626624 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:07.626601 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:58:07.799722 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:07.799695 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fb49457b5-zr2j8" Jul 29 16:58:07.850012 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:07.849983 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5799768964-h842n"] Jul 29 16:58:18.913179 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:18.913105 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:58:18.913597 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:58:18.913270 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:58:30.913097 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:30.913069 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:58:30.913505 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:58:30.913245 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:58:32.874125 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:32.874084 2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5799768964-h842n" podUID="10b60b21-f522-44e1-a281-0790dbc928e7" containerName="console" containerID="cri-o://0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7" gracePeriod=15 Jul 29 16:58:33.119769 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.119745 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5799768964-h842n" Jul 29 16:58:33.149927 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.149847 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-serving-cert\") pod \"10b60b21-f522-44e1-a281-0790dbc928e7\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " Jul 29 16:58:33.149927 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.149891 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwl7g\" (UniqueName: \"kubernetes.io/projected/10b60b21-f522-44e1-a281-0790dbc928e7-kube-api-access-mwl7g\") pod \"10b60b21-f522-44e1-a281-0790dbc928e7\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " Jul 29 16:58:33.149927 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.149915 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-oauth-config\") pod \"10b60b21-f522-44e1-a281-0790dbc928e7\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " Jul 29 16:58:33.150173 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.149943 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-oauth-serving-cert\") pod \"10b60b21-f522-44e1-a281-0790dbc928e7\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " Jul 29 16:58:33.150173 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.149972 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-service-ca\") pod \"10b60b21-f522-44e1-a281-0790dbc928e7\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " Jul 29 16:58:33.150173 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.150025 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-trusted-ca-bundle\") pod \"10b60b21-f522-44e1-a281-0790dbc928e7\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " Jul 29 16:58:33.150324 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.150188 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-console-config\") pod \"10b60b21-f522-44e1-a281-0790dbc928e7\" (UID: \"10b60b21-f522-44e1-a281-0790dbc928e7\") " Jul 29 16:58:33.150388 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.150359 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "10b60b21-f522-44e1-a281-0790dbc928e7" (UID: "10b60b21-f522-44e1-a281-0790dbc928e7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:58:33.150478 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.150436 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-service-ca" (OuterVolumeSpecName: "service-ca") pod "10b60b21-f522-44e1-a281-0790dbc928e7" (UID: "10b60b21-f522-44e1-a281-0790dbc928e7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:58:33.150660 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.150636 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-console-config" (OuterVolumeSpecName: "console-config") pod "10b60b21-f522-44e1-a281-0790dbc928e7" (UID: "10b60b21-f522-44e1-a281-0790dbc928e7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:58:33.150739 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.150655 2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-oauth-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:58:33.150739 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.150677 2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-service-ca\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:58:33.150868 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.150839 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "10b60b21-f522-44e1-a281-0790dbc928e7" (UID: "10b60b21-f522-44e1-a281-0790dbc928e7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 16:58:33.152217 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.152192 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "10b60b21-f522-44e1-a281-0790dbc928e7" (UID: "10b60b21-f522-44e1-a281-0790dbc928e7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:58:33.152217 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.152201 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10b60b21-f522-44e1-a281-0790dbc928e7-kube-api-access-mwl7g" (OuterVolumeSpecName: "kube-api-access-mwl7g") pod "10b60b21-f522-44e1-a281-0790dbc928e7" (UID: "10b60b21-f522-44e1-a281-0790dbc928e7"). InnerVolumeSpecName "kube-api-access-mwl7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 16:58:33.152217 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.152210 2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "10b60b21-f522-44e1-a281-0790dbc928e7" (UID: "10b60b21-f522-44e1-a281-0790dbc928e7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 16:58:33.251408 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.251374 2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-serving-cert\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:58:33.251408 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.251400 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwl7g\" (UniqueName: \"kubernetes.io/projected/10b60b21-f522-44e1-a281-0790dbc928e7-kube-api-access-mwl7g\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:58:33.251408 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.251410 2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/10b60b21-f522-44e1-a281-0790dbc928e7-console-oauth-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:58:33.251408 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.251419 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-trusted-ca-bundle\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:58:33.251692 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.251427 2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/10b60b21-f522-44e1-a281-0790dbc928e7-console-config\") on node \"ip-10-0-142-232.ec2.internal\" DevicePath \"\"" Jul 29 16:58:33.907088 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.907058 2584 generic.go:356] "Generic (PLEG): container finished" podID="10b60b21-f522-44e1-a281-0790dbc928e7" containerID="0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7" exitCode=0 Jul 29 16:58:33.907510 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.907104 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5799768964-h842n" Jul 29 16:58:33.907510 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.907103 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5799768964-h842n" event={"ID":"10b60b21-f522-44e1-a281-0790dbc928e7","Type":"ContainerDied","Data":"0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7"} Jul 29 16:58:33.907510 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.907222 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5799768964-h842n" event={"ID":"10b60b21-f522-44e1-a281-0790dbc928e7","Type":"ContainerDied","Data":"09652f5f6749bd0ebe79f9244f9ae0e4b3bbd5a95ca92bb77d4650f1c57b0972"} Jul 29 16:58:33.907510 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.907248 2584 scope.go:117] "RemoveContainer" containerID="0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7" Jul 29 16:58:33.916493 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.916470 2584 scope.go:117] "RemoveContainer" containerID="0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7" Jul 29 16:58:33.916763 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:58:33.916736 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7\": container with ID starting with 0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7 not found: ID does not exist" containerID="0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7" Jul 29 16:58:33.916815 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.916772 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7"} err="failed to get container status \"0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7\": rpc error: code = NotFound desc = could not find container \"0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7\": container with ID starting with 0d3b62cfea816ec5f1fb6c95bc739a424aa2a42197ebae8cd292be7cb41756b7 not found: ID does not exist" Jul 29 16:58:33.930772 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.930747 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5799768964-h842n"] Jul 29 16:58:33.932546 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:33.932528 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5799768964-h842n"] Jul 29 16:58:35.917820 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:35.917790 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10b60b21-f522-44e1-a281-0790dbc928e7" path="/var/lib/kubelet/pods/10b60b21-f522-44e1-a281-0790dbc928e7/volumes" Jul 29 16:58:45.913490 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:45.913432 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:58:45.913954 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:58:45.913649 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:58:56.913417 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:58:56.913387 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:58:56.913919 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:58:56.913614 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:59:07.913996 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:07.913965 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:59:09.057298 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:09.057267 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerStarted","Data":"a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e"} Jul 29 16:59:09.057713 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:09.057478 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:59:10.063799 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:10.063763 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" exitCode=1 Jul 29 16:59:10.064265 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:10.063842 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerDied","Data":"a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e"} Jul 29 16:59:10.064265 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:10.063898 2584 scope.go:117] "RemoveContainer" containerID="209fb29d3b9b3d1fd488cf43a5d8ef61171f5d68d445aef08539b3e93fdebbae" Jul 29 16:59:10.064265 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:10.064136 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 16:59:10.064419 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:59:10.064337 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:59:11.070211 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:11.070183 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 16:59:11.070666 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:59:11.070417 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:59:16.214091 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:16.214058 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 16:59:16.214508 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:16.214490 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 16:59:16.214758 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:59:16.214735 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:59:30.912956 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:30.912924 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 16:59:30.913338 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:59:30.913119 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:59:41.913185 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:41.913093 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 16:59:41.913786 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:59:41.913324 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 16:59:55.913650 ip-10-0-142-232 kubenswrapper[2584]: I0729 16:59:55.913618 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 16:59:55.914141 ip-10-0-142-232 kubenswrapper[2584]: E0729 16:59:55.913792 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:00:10.912896 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:00:10.912863 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:00:10.913291 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:00:10.913035 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:00:25.913241 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:00:25.913214 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:00:25.913724 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:00:25.913414 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:00:37.913434 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:00:37.913404 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:00:37.913815 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:00:37.913591 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:00:50.913244 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:00:50.913211 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:00:50.913706 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:00:50.913385 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:01:03.913306 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:03.913277 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:01:03.913790 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:01:03.913434 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:01:15.913850 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:15.913713 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:01:15.917904 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:01:15.913953 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:01:27.918947 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:27.918919 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:01:27.919389 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:01:27.919110 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:01:38.912931 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:38.912899 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:01:38.913341 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:01:38.913082 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:01:49.914792 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:49.914756 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:01:49.915338 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:49.915203 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:01:50.753903 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:50.753862 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerStarted","Data":"5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce"} Jul 29 17:01:50.754131 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:50.754113 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 17:01:51.762793 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:51.762760 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" exitCode=1 Jul 29 17:01:51.763193 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:51.762848 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerDied","Data":"5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce"} Jul 29 17:01:51.763193 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:51.762917 2584 scope.go:117] "RemoveContainer" containerID="a199f53e9ab776b85c4af362eb94c6399b0645439095d34941ff5161ffc2790e" Jul 29 17:01:51.763193 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:51.763159 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:01:51.763375 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:01:51.763357 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:01:52.768883 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:52.768860 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:01:52.769237 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:01:52.769029 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:01:56.214522 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:56.214483 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 17:01:56.214950 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:01:56.214937 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:01:56.215128 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:01:56.215097 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:02:08.913248 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:02:08.913217 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:02:08.913686 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:02:08.913411 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:02:21.912865 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:02:21.912825 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:02:21.913337 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:02:21.913039 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:02:36.913996 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:02:36.913963 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:02:36.914386 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:02:36.914139 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:02:50.913279 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:02:50.913249 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:02:50.913707 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:02:50.913430 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:03:05.913525 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:03:05.913486 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:03:05.913993 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:03:05.913641 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:03:18.913138 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:03:18.913104 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:03:18.913640 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:03:18.913281 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:03:30.913023 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:03:30.912991 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:03:30.913535 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:03:30.913191 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:03:42.913230 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:03:42.913196 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:03:42.913668 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:03:42.913379 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:03:56.913563 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:03:56.913535 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:03:56.913975 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:03:56.913712 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:04:09.915605 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:04:09.915578 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:04:09.916092 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:04:09.915762 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:04:21.913948 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:04:21.913870 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:04:21.914313 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:04:21.914064 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:04:32.913129 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:04:32.913096 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:04:32.913575 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:04:32.913275 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:04:45.913113 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:04:45.913075 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:04:45.913599 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:04:45.913293 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:04:59.915228 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:04:59.915189 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:04:59.915632 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:04:59.915432 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:05:13.913137 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:05:13.913100 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:05:13.913669 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:05:13.913279 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:05:28.913022 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:05:28.912989 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:05:28.913538 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:05:28.913186 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:05:41.913180 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:05:41.913103 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:05:41.913668 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:05:41.913277 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:05:55.913167 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:05:55.913137 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:05:55.913668 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:05:55.913312 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:06:09.916418 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:09.916387 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:06:09.916942 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:06:09.916611 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:06:22.369120 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:22.369088 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-nfdb8_fbd7f685-b3ca-4be5-bac0-e4ae9ba14345/manager/6.log" Jul 29 17:06:23.913830 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:23.913798 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:06:23.914218 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:06:23.914010 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:06:35.913526 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:35.913499 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:06:35.914005 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:06:35.913683 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:06:48.812122 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:48.812095 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fv4xz_4fad74b0-68e8-431e-b017-89885b72b831/global-pull-secret-syncer/0.log" Jul 29 17:06:48.913860 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:48.913828 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:06:48.914087 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:06:48.914066 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:06:48.962913 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:48.962883 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cdt7n_16de1a4e-c081-4a68-9d60-011c7049df50/konnectivity-agent/0.log" Jul 29 17:06:49.027352 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:49.027319 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-232.ec2.internal_d0ddd5c5c7644f7a04469a88243a8d6a/haproxy/0.log" Jul 29 17:06:52.983807 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:52.983777 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-l5n7w_b7043adb-ae30-4529-a170-c0227b99f928/kube-state-metrics/0.log" Jul 29 17:06:53.006201 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.006173 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-l5n7w_b7043adb-ae30-4529-a170-c0227b99f928/kube-rbac-proxy-main/0.log" Jul 29 17:06:53.034121 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.034096 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-l5n7w_b7043adb-ae30-4529-a170-c0227b99f928/kube-rbac-proxy-self/0.log" Jul 29 17:06:53.092544 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.092518 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-559977b775-hs48q_435d51fb-e05a-4add-9702-91ab16b0991c/metrics-server/0.log" Jul 29 17:06:53.164264 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.164237 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5crps_1b2c476a-8873-474a-9856-4eb9c4041a4c/node-exporter/0.log" Jul 29 17:06:53.198221 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.198197 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5crps_1b2c476a-8873-474a-9856-4eb9c4041a4c/kube-rbac-proxy/0.log" Jul 29 17:06:53.224755 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.224733 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5crps_1b2c476a-8873-474a-9856-4eb9c4041a4c/init-textfile/0.log" Jul 29 17:06:53.418644 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.418549 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-pz69k_ae252624-487d-4fc3-90ac-711270a8174d/kube-rbac-proxy-main/0.log" Jul 29 17:06:53.443914 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.443870 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-pz69k_ae252624-487d-4fc3-90ac-711270a8174d/kube-rbac-proxy-self/0.log" Jul 29 17:06:53.469574 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.469550 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-pz69k_ae252624-487d-4fc3-90ac-711270a8174d/openshift-state-metrics/0.log" Jul 29 17:06:53.705236 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.705212 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-96bnh_0134c708-26de-454d-acdf-5708e9a406ef/prometheus-operator/0.log" Jul 29 17:06:53.726493 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.726466 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-96bnh_0134c708-26de-454d-acdf-5708e9a406ef/kube-rbac-proxy/0.log" Jul 29 17:06:53.750614 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:53.750593 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-5txpp_9e26ef26-c6a1-41d0-896d-168c4c7eb195/prometheus-operator-admission-webhook/0.log" Jul 29 17:06:56.204180 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:56.204151 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fb49457b5-zr2j8_c38b8d58-5a6f-4abb-bc26-e459a20d5888/console/0.log" Jul 29 17:06:57.355595 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.355564 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp"] Jul 29 17:06:57.355974 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.355886 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10b60b21-f522-44e1-a281-0790dbc928e7" containerName="console" Jul 29 17:06:57.355974 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.355896 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="10b60b21-f522-44e1-a281-0790dbc928e7" containerName="console" Jul 29 17:06:57.355974 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.355969 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="10b60b21-f522-44e1-a281-0790dbc928e7" containerName="console" Jul 29 17:06:57.359029 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.359010 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.361369 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.361347 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-msg6d\"/\"kube-root-ca.crt\"" Jul 29 17:06:57.361538 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.361521 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-msg6d\"/\"default-dockercfg-jssst\"" Jul 29 17:06:57.362120 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.362103 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-msg6d\"/\"openshift-service-ca.crt\"" Jul 29 17:06:57.368654 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.368630 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp"] Jul 29 17:06:57.503183 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.503137 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-sys\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.503183 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.503185 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-lib-modules\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.503480 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.503323 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69msn\" (UniqueName: \"kubernetes.io/projected/6e99798b-cc8d-4740-96fb-69c4e45a7788-kube-api-access-69msn\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.503480 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.503376 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-podres\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.503480 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.503417 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-proc\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604542 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604501 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69msn\" (UniqueName: \"kubernetes.io/projected/6e99798b-cc8d-4740-96fb-69c4e45a7788-kube-api-access-69msn\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604542 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604548 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-podres\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604799 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604567 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-proc\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604799 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604604 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-sys\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604799 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604626 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-lib-modules\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604799 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604716 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-podres\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604799 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604733 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-sys\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604799 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604721 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-proc\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.604799 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.604757 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e99798b-cc8d-4740-96fb-69c4e45a7788-lib-modules\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.611956 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.611899 2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69msn\" (UniqueName: \"kubernetes.io/projected/6e99798b-cc8d-4740-96fb-69c4e45a7788-kube-api-access-69msn\") pod \"perf-node-gather-daemonset-6phlp\" (UID: \"6e99798b-cc8d-4740-96fb-69c4e45a7788\") " pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.626227 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.626203 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2svw7_6ee6848e-fdb6-480e-88db-5d44a713a3e5/dns/0.log" Jul 29 17:06:57.650430 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.650402 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2svw7_6ee6848e-fdb6-480e-88db-5d44a713a3e5/kube-rbac-proxy/0.log" Jul 29 17:06:57.668741 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.668712 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:57.780508 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.780479 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-74k8g_05bec12f-b245-492a-ba61-5c7622ae97d9/dns-node-resolver/0.log" Jul 29 17:06:57.806425 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:57.806316 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp"] Jul 29 17:06:57.809180 ip-10-0-142-232 kubenswrapper[2584]: W0729 17:06:57.809155 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6e99798b_cc8d_4740_96fb_69c4e45a7788.slice/crio-a5c900927abaec9b6a8036831c5e00099dfac122e0f3abc8702e42bcd6dc4a2e WatchSource:0}: Error finding container a5c900927abaec9b6a8036831c5e00099dfac122e0f3abc8702e42bcd6dc4a2e: Status 404 returned error can't find the container with id a5c900927abaec9b6a8036831c5e00099dfac122e0f3abc8702e42bcd6dc4a2e Jul 29 17:06:58.078520 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:58.078486 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" event={"ID":"6e99798b-cc8d-4740-96fb-69c4e45a7788","Type":"ContainerStarted","Data":"1469335e0299fbea7cc722ce31ceabe9316af294126a2981645058738165597f"} Jul 29 17:06:58.078706 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:58.078541 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" event={"ID":"6e99798b-cc8d-4740-96fb-69c4e45a7788","Type":"ContainerStarted","Data":"a5c900927abaec9b6a8036831c5e00099dfac122e0f3abc8702e42bcd6dc4a2e"} Jul 29 17:06:58.078706 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:58.078616 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:06:58.099145 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:58.099090 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" podStartSLOduration=1.099072636 podStartE2EDuration="1.099072636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:06:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:06:58.09741624 +0000 UTC m=+968.629297345" watchObservedRunningTime="2026-07-29 17:06:58.099072636 +0000 UTC m=+968.630953773" Jul 29 17:06:58.271934 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:58.271902 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-686d6f5557-hbflv_9ac920e7-7b70-4c5e-ade5-abfb3a0f7546/registry/0.log" Jul 29 17:06:58.315526 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:58.315499 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mkttr_4ead991e-a967-4953-8763-c5b779208e97/node-ca/0.log" Jul 29 17:06:59.163641 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:59.163616 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5879bddfbc-j8vzs_17603800-dff1-4f82-95a7-743a7f2d5498/router/0.log" Jul 29 17:06:59.507628 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:59.507601 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24v95_402d5528-ce3f-43cf-96ee-b86c48acfbf8/serve-healthcheck-canary/0.log" Jul 29 17:06:59.917146 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:59.917065 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-gvw5p_7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d/insights-operator/0.log" Jul 29 17:06:59.917304 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:06:59.917292 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-gvw5p_7d1bcd0b-c46f-4bbb-b308-0f11628b6c9d/insights-operator/1.log" Jul 29 17:07:00.085600 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:00.085564 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggsnt_9cc6ab97-8223-4efb-8ee9-72375e0dcd7d/kube-rbac-proxy/0.log" Jul 29 17:07:00.109270 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:00.109244 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggsnt_9cc6ab97-8223-4efb-8ee9-72375e0dcd7d/exporter/0.log" Jul 29 17:07:00.130563 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:00.130533 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ggsnt_9cc6ab97-8223-4efb-8ee9-72375e0dcd7d/extractor/0.log" Jul 29 17:07:01.913274 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:01.913238 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:07:01.913797 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:01.913688 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 17:07:02.097314 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:02.097266 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-nfdb8_fbd7f685-b3ca-4be5-bac0-e4ae9ba14345/manager/6.log" Jul 29 17:07:02.097314 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:02.097272 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-nfdb8_fbd7f685-b3ca-4be5-bac0-e4ae9ba14345/manager/6.log" Jul 29 17:07:03.101729 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:03.101698 2584 generic.go:356] "Generic (PLEG): container finished" podID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" containerID="e925f77249b721de133340f0f94fb7949c540f831c38dedd6f427946bb634c76" exitCode=1 Jul 29 17:07:03.102193 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:03.101772 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" event={"ID":"fbd7f685-b3ca-4be5-bac0-e4ae9ba14345","Type":"ContainerDied","Data":"e925f77249b721de133340f0f94fb7949c540f831c38dedd6f427946bb634c76"} Jul 29 17:07:03.102193 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:03.101847 2584 scope.go:117] "RemoveContainer" containerID="5ca9809f48163d273779a4c9a9af017dde25584d1d1aba559d97bdb9dc96a0ce" Jul 29 17:07:03.102193 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:03.102185 2584 scope.go:117] "RemoveContainer" containerID="e925f77249b721de133340f0f94fb7949c540f831c38dedd6f427946bb634c76" Jul 29 17:07:03.102397 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:07:03.102378 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:07:04.093067 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:04.093036 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-msg6d/perf-node-gather-daemonset-6phlp" Jul 29 17:07:05.754460 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:05.754401 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 17:07:05.754858 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:05.754764 2584 scope.go:117] "RemoveContainer" containerID="e925f77249b721de133340f0f94fb7949c540f831c38dedd6f427946bb634c76" Jul 29 17:07:05.754951 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:07:05.754932 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:07:06.043350 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:06.043270 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-698fz_e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025/kube-storage-version-migrator-operator/1.log" Jul 29 17:07:06.044117 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:06.044099 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-698fz_e8c18a3e-efc5-4a0d-9a72-3b3fd35d9025/kube-storage-version-migrator-operator/0.log" Jul 29 17:07:06.213798 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:06.213764 2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" Jul 29 17:07:06.214132 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:06.214119 2584 scope.go:117] "RemoveContainer" containerID="e925f77249b721de133340f0f94fb7949c540f831c38dedd6f427946bb634c76" Jul 29 17:07:06.214305 ip-10-0-142-232 kubenswrapper[2584]: E0729 17:07:06.214288 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-67d95fdc48-nfdb8_kserve(fbd7f685-b3ca-4be5-bac0-e4ae9ba14345)\"" pod="kserve/llmisvc-controller-manager-67d95fdc48-nfdb8" podUID="fbd7f685-b3ca-4be5-bac0-e4ae9ba14345" Jul 29 17:07:07.596083 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.596044 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbbxd_49db7fbb-4cff-41a5-901d-951954ce4d32/kube-multus-additional-cni-plugins/0.log" Jul 29 17:07:07.635942 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.635866 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbbxd_49db7fbb-4cff-41a5-901d-951954ce4d32/egress-router-binary-copy/0.log" Jul 29 17:07:07.665854 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.665828 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbbxd_49db7fbb-4cff-41a5-901d-951954ce4d32/cni-plugins/0.log" Jul 29 17:07:07.710751 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.710723 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbbxd_49db7fbb-4cff-41a5-901d-951954ce4d32/bond-cni-plugin/0.log" Jul 29 17:07:07.744286 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.744261 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbbxd_49db7fbb-4cff-41a5-901d-951954ce4d32/routeoverride-cni/0.log" Jul 29 17:07:07.783914 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.783880 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbbxd_49db7fbb-4cff-41a5-901d-951954ce4d32/whereabouts-cni-bincopy/0.log" Jul 29 17:07:07.818723 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.818703 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tbbxd_49db7fbb-4cff-41a5-901d-951954ce4d32/whereabouts-cni/0.log" Jul 29 17:07:07.861423 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.861397 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kxlmz_3c69035b-a871-4e7c-b9ed-0ad59e5fd54b/kube-multus/0.log" Jul 29 17:07:07.943505 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.943415 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kr8b2_c47dc45f-db50-4216-923a-4ef2c5d1e856/network-metrics-daemon/0.log" Jul 29 17:07:07.976787 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:07.976759 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kr8b2_c47dc45f-db50-4216-923a-4ef2c5d1e856/kube-rbac-proxy/0.log" Jul 29 17:07:09.313152 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:09.313119 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rt4hb_425ce19e-afd9-4f87-960d-5ac72c5c025d/ovn-controller/0.log" Jul 29 17:07:09.330903 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:09.330868 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rt4hb_425ce19e-afd9-4f87-960d-5ac72c5c025d/ovn-acl-logging/0.log" Jul 29 17:07:09.356304 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:09.356276 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rt4hb_425ce19e-afd9-4f87-960d-5ac72c5c025d/kube-rbac-proxy-node/0.log" Jul 29 17:07:09.375539 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:09.375512 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rt4hb_425ce19e-afd9-4f87-960d-5ac72c5c025d/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 17:07:09.393778 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:09.393747 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rt4hb_425ce19e-afd9-4f87-960d-5ac72c5c025d/northd/0.log" Jul 29 17:07:09.415519 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:09.415490 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rt4hb_425ce19e-afd9-4f87-960d-5ac72c5c025d/nbdb/0.log" Jul 29 17:07:09.435105 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:09.435079 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rt4hb_425ce19e-afd9-4f87-960d-5ac72c5c025d/sbdb/0.log" Jul 29 17:07:09.475674 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:09.475642 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rt4hb_425ce19e-afd9-4f87-960d-5ac72c5c025d/ovnkube-controller/0.log" Jul 29 17:07:10.404922 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:10.404899 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-47n92_9cacb46e-18e1-43ad-abe7-da9839a9f635/network-check-target-container/0.log" Jul 29 17:07:11.358092 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:11.358068 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-x5b5q_f0bfffac-dd64-4bca-b80f-96d637553acd/iptables-alerter/0.log" Jul 29 17:07:11.925327 ip-10-0-142-232 kubenswrapper[2584]: I0729 17:07:11.925298 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-9dl77_7799e27e-e7b7-49c5-ab70-219172fcc3f6/tuned/0.log"