Jul 16 16:50:35.671148 ip-10-0-130-64 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 16:50:35.671161 ip-10-0-130-64 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 16:50:35.671170 ip-10-0-130-64 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 16:50:35.671455 ip-10-0-130-64 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 16:50:45.900747 ip-10-0-130-64 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 16:50:45.900777 ip-10-0-130-64 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2247bc33260a4e2bb691e98fa2155a88 -- Jul 16 16:52:41.752229 ip-10-0-130-64 systemd[1]: Starting Kubernetes Kubelet... Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.168654 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182053 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182065 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182069 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182072 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182075 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182078 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182081 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:42.263409 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182085 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182089 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182092 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182095 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182097 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182101 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182105 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182108 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182122 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182125 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182128 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182130 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182133 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182135 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182138 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182140 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182143 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182145 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182148 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182151 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:42.264324 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182154 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182156 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182159 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182161 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182163 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182167 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182169 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182172 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182174 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182177 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182179 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182181 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182184 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182187 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182189 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182192 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182195 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182197 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182200 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:42.265108 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182203 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:42.265102 ip-10-0-130-64 systemd[1]: Started Kubernetes Kubelet. Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182207 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182210 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182213 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182215 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182218 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182220 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182223 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182226 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182228 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182230 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182233 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182236 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182238 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182241 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182243 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182246 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182248 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182250 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182253 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:42.266179 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182255 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182258 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182261 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182263 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182267 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182271 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182274 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182278 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182281 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182284 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182287 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182289 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182292 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182295 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182297 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182299 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182302 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182304 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182308 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:42.267112 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182310 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182313 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182316 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182318 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182321 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182323 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182325 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182328 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182330 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182333 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182335 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182338 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182341 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.182344 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183021 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183029 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183032 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183035 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183037 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183041 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183043 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:42.268019 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183046 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183048 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183051 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183054 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183056 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183059 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183061 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183064 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183067 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183071 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183075 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183077 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183080 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183083 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183085 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183088 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183091 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183093 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183096 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:42.268617 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183099 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183102 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183104 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183107 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183110 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183112 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183116 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183119 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183121 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183124 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183127 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183129 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183132 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183134 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183137 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183140 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183142 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183145 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183149 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183151 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:42.269379 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183154 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183157 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183159 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183163 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183166 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183168 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183171 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183173 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183176 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183179 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183182 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183185 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183187 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183190 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183193 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183195 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183198 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183200 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183203 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183205 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:42.269881 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183208 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183210 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183213 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183216 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183220 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183225 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183229 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183232 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183235 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183238 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183241 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183243 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183247 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183249 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183252 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183254 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183257 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183260 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183263 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:42.270493 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183266 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183268 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183271 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183273 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183275 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183278 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183280 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183283 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183286 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183288 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183290 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183293 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183295 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183298 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183653 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183658 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183661 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183664 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183667 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:42.271287 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183671 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183675 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183679 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183682 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183684 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183689 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183692 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183694 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183697 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183699 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183702 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183705 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183707 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183710 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183712 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183715 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183718 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183721 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183723 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:42.272132 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183726 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183730 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183733 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183735 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183738 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183741 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183743 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183746 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183748 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183751 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183753 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183756 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183758 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183761 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183764 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183767 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183769 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183772 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183776 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183779 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:42.272951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183781 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183784 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183786 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183789 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183791 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183794 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183796 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183799 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183801 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183803 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183806 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183808 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183810 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183815 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183817 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183820 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183822 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183825 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183827 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183831 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:42.423114 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183834 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183837 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183840 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183843 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183845 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183848 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183851 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183854 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183857 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183859 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183863 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183866 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183869 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183871 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183873 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183876 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183878 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183881 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183885 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183888 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:42.440361 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183891 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183893 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183896 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183898 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183900 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183904 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183907 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183909 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183912 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183914 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183917 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183919 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183921 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183924 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.183926 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184000 2560 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184007 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184013 2560 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184017 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184021 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184024 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 16:52:42.441786 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184029 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184035 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184038 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184041 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184045 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184048 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184051 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184054 2560 flags.go:64] FLAG: --cgroup-root="" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184056 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184059 2560 flags.go:64] FLAG: --client-ca-file="" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184062 2560 flags.go:64] FLAG: --cloud-provider="external" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184065 2560 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184069 2560 flags.go:64] FLAG: --cluster-domain="" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184071 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184074 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184077 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184081 2560 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184085 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184087 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184090 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184094 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184097 2560 flags.go:64] FLAG: --contention-profiling="false" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184100 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184102 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 16:52:42.442837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184105 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184108 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184112 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184115 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184118 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184120 2560 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184123 2560 flags.go:64] FLAG: --enable-server="true" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184126 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184130 2560 flags.go:64] FLAG: --event-burst="100" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184135 2560 flags.go:64] FLAG: --event-qps="50" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184138 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184141 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184143 2560 flags.go:64] FLAG: --eviction-hard="" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184147 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184150 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184152 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184155 2560 flags.go:64] FLAG: --eviction-soft="" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184158 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184161 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184163 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184166 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184169 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184171 2560 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184174 2560 flags.go:64] FLAG: --feature-gates="" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184178 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 16:52:42.443659 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184181 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184184 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184187 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184189 2560 flags.go:64] FLAG: --healthz-port="10248" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184192 2560 flags.go:64] FLAG: --help="false" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184195 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184198 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184201 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184204 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184207 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184210 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184213 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184216 2560 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184218 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184221 2560 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184224 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184229 2560 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184231 2560 flags.go:64] FLAG: --kube-reserved="" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184234 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184237 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184240 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184243 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184245 2560 flags.go:64] FLAG: --lock-file="" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184248 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 16:52:42.444522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184251 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184253 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184259 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184261 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184264 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184267 2560 flags.go:64] FLAG: --logging-format="text" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184269 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184274 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184277 2560 flags.go:64] FLAG: --manifest-url="" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184280 2560 flags.go:64] FLAG: --manifest-url-header="" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184283 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184286 2560 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184290 2560 flags.go:64] FLAG: --max-pods="110" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184293 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184296 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184298 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184301 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184304 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184307 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184309 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184316 2560 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184319 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184322 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 16:52:42.445290 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184325 2560 flags.go:64] FLAG: --pod-cidr="" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184329 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184334 2560 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184337 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184340 2560 flags.go:64] FLAG: --pods-per-core="0" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184343 2560 flags.go:64] FLAG: --port="10250" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184346 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184349 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-068448f0429dd36cd" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184352 2560 flags.go:64] FLAG: --qos-reserved="" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184354 2560 flags.go:64] FLAG: --read-only-port="10255" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184357 2560 flags.go:64] FLAG: --register-node="true" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184360 2560 flags.go:64] FLAG: --register-with-taints="" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184363 2560 flags.go:64] FLAG: --registry-burst="10" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184366 2560 flags.go:64] FLAG: --registry-qps="5" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184369 2560 flags.go:64] FLAG: --reserved-cpus="" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184371 2560 flags.go:64] FLAG: --reserved-memory="" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184375 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184380 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184382 2560 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184385 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184388 2560 flags.go:64] FLAG: --runonce="false" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184391 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184394 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184396 2560 flags.go:64] FLAG: --seccomp-default="false" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184399 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 16:52:42.446321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184402 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184405 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184408 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184411 2560 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184413 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184416 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184419 2560 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184421 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184425 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184429 2560 flags.go:64] FLAG: --system-cgroups="" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184431 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184436 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184439 2560 flags.go:64] FLAG: --tls-cert-file="" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184441 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184445 2560 flags.go:64] FLAG: --tls-min-version="" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184448 2560 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184451 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184454 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184456 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184459 2560 flags.go:64] FLAG: --v="2" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184463 2560 flags.go:64] FLAG: --version="false" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184466 2560 flags.go:64] FLAG: --vmodule="" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184469 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.184472 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184575 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:42.447070 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184579 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184582 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184585 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184587 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184589 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184592 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184595 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184597 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184600 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184602 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184605 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184608 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184610 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184612 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184615 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184619 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184621 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184624 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184626 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184629 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:42.641449 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184631 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184634 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184636 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184639 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184641 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184644 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184647 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184651 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184654 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184658 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184661 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184665 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184668 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184671 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184674 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184677 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184679 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184681 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184684 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184686 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:42.642224 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184689 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184691 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184693 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184696 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184699 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184701 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184704 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184707 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184710 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184712 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184715 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184718 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184720 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184723 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184727 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184729 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184732 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184734 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184737 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:42.642870 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184740 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184742 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184744 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184747 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184751 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184753 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184756 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184758 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184760 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184763 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184765 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184768 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184770 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184772 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184775 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184777 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184780 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184782 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184784 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184787 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:42.643473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184790 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184793 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184795 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184798 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184801 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184803 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184806 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184808 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184811 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184813 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184815 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184818 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184820 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184823 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184825 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184828 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184832 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184834 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:42.644017 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.184837 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.185459 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.193721 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.193736 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.198923 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.198934 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199012 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199018 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199021 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199024 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199027 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199030 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199032 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199035 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199038 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:42.644580 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199041 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199043 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199047 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199050 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199053 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199055 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199058 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199060 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199063 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199068 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199071 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199073 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199076 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199078 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199082 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199086 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199089 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199091 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199094 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:42.645099 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199096 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199100 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199102 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199104 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199107 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199110 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199112 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199115 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199119 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199122 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199125 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199127 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199130 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199133 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199136 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199139 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199142 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199145 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199147 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199150 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:42.645666 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199152 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199154 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199158 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199161 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199163 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199166 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199168 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199172 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199174 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199176 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199179 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199181 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199184 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199186 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199189 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199192 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199194 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199197 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199199 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199202 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:42.646250 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199204 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199207 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199209 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199212 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199214 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199217 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199219 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199223 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199226 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199228 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199230 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199233 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199235 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199237 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199242 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199244 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199247 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199249 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199252 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:42.646883 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199255 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199259 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199262 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199264 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199267 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199270 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199273 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199275 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199284 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199286 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199289 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199292 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.199297 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199430 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199434 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:42.647455 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199437 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199440 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199443 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199445 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199448 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199452 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199454 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199456 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199459 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199461 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199464 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199467 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199469 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199473 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199476 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199479 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199482 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199486 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199489 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199491 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:42.647916 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199494 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199497 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199499 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199503 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199507 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199509 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199519 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199522 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199524 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199527 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199529 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199532 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199534 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199537 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199539 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199541 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199544 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199548 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199550 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199552 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:42.648520 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199555 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199557 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199560 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199562 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199564 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199568 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199570 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199573 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199575 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199578 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199580 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199583 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199585 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199587 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199590 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199592 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199595 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199597 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199599 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199607 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:42.649122 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199610 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199612 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199615 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199617 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199619 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199622 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199624 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199626 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199629 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199633 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199635 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199638 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199640 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199643 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199645 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199647 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199650 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199654 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199656 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199659 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:42.649674 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199661 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199664 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199666 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199669 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199671 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199674 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199676 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199679 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199682 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199686 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199688 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199691 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199699 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199702 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199705 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199708 2560 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:42.650263 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:42.199710 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.199715 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.199828 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.202492 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.203823 2560 server.go:1019] "Starting client certificate rotation" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.203915 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.204691 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.206097 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.209084 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.222347 2560 log.go:25] "Validated CRI v1 runtime API" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.224457 2560 log.go:25] "Validated CRI v1 image API" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.225787 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 16:52:42.650723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.231446 2560 fs.go:135] Filesystem UUIDs: map[3810c47c-7edf-4687-834a-f4d4f537784c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 97e6c36c-1a45-4c6d-9d20-ad19fdc39e2f:/dev/nvme0n1p4] Jul 16 16:52:42.651179 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.231460 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 16:52:42.651256 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.237714 2560 manager.go:216] Machine: {Timestamp:2026-07-16 16:52:42.236469909 +0000 UTC m=+0.372084566 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200230 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec215d65b984b9ee7c068ac74d063c28 SystemUUID:ec215d65-b984-b9ee-7c06-8ac74d063c28 BootID:2247bc33-260a-4e2b-b691-e98fa2155a88 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:96:d4:26:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:96:d4:26:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:d4:98:ba:14:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 16:52:42.651256 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.237810 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 16:52:42.651256 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.237889 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 16:52:42.651256 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.237905 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 16:52:42.651256 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.241164 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 16:52:42.651256 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.241187 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 16:52:42.651256 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.245851 2560 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.245862 2560 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.245870 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.246571 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.247489 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.250598 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.250712 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.250740 2560 kubelet.go:486] "Attempting to sync node with API server" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.250763 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.250786 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.250799 2560 kubelet.go:398] "Adding apiserver pod source" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.250811 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.251188 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.251204 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.252004 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vsxpl" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.253264 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.254689 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.254716 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255364 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255377 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255383 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255388 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255396 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255401 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255410 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255415 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255421 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255427 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255435 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.255440 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.256193 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.256202 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.262745 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vsxpl" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.262951 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.263058 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.263193 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.264150 2560 server.go:1268] "Started kubelet" Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.264215 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.264249 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.264357 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 16:52:42.651560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.266110 2560 server.go:310] "Adding debug handlers to kubelet server" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.267994 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.272080 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.271925 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-64.ec2.internal.18c2d3547fa14280 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-64.ec2.internal,UID:ip-10-0-130-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-64.ec2.internal,},FirstTimestamp:2026-07-16 16:52:42.26412608 +0000 UTC m=+0.399740738,LastTimestamp:2026-07-16 16:52:42.26412608 +0000 UTC m=+0.399740738,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-64.ec2.internal,}" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.278796 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.278798 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.279000 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.279652 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.279667 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.279652 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280235 2560 reconstruct.go:97] "Volume reconstruction finished" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280246 2560 reconciler.go:29] "Reconciler: start to sync state" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280267 2560 factory.go:153] Registering CRI-O factory Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280289 2560 factory.go:223] Registration of the crio container factory successfully Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280344 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280354 2560 factory.go:55] Registering systemd factory Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280364 2560 factory.go:223] Registration of the systemd container factory successfully Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280414 2560 factory.go:103] Registering Raw factory Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280439 2560 manager.go:1196] Started watching for new ooms in manager Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.280878 2560 manager.go:349] Starting recovery of all containers Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.282034 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.288219 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-64.ec2.internal\" not found" node="ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.292842 2560 manager.go:354] Recovery completed Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.297328 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.299027 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.299053 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.299063 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.299546 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.299545 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.299610 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.299637 2560 state_mem.go:36] "Initialized new in-memory state store" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.300204 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.300227 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.300236 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.300930 2560 policy_none.go:49] "None policy: Start" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.300941 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 16:52:42.652954 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.300950 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.301990 2560 policy_none.go:47] "Start" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.348499 2560 manager.go:337] "Starting Device Plugin manager" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.348531 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.348544 2560 server.go:87] "Starting device plugin registration server" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.348829 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.348840 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.348926 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.349027 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.349035 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.349480 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.349522 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.449335 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.450376 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.450405 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.450416 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.450442 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.457239 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.457259 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-64.ec2.internal\": node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.468275 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.469572 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.469615 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.469639 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.469682 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.472087 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.473201 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.573371 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"] Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.573449 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.573383 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.574936 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.574961 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.574990 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.576302 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.576398 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.576434 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.577043 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.577067 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:42.653985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.577076 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.577043 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.577150 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.577163 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.582502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.582522 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.583211 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.583235 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.583253 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.584560 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db96f14572c7d84521d7dec9bd349ea7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"db96f14572c7d84521d7dec9bd349ea7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.584585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db96f14572c7d84521d7dec9bd349ea7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"db96f14572c7d84521d7dec9bd349ea7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.584601 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7195bd60e889079b94ab3446c3676a9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-64.ec2.internal\" (UID: \"d7195bd60e889079b94ab3446c3676a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.594601 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-64.ec2.internal\" not found" node="ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.600509 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-64.ec2.internal\" not found" node="ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.673997 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.685430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db96f14572c7d84521d7dec9bd349ea7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"db96f14572c7d84521d7dec9bd349ea7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.685455 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db96f14572c7d84521d7dec9bd349ea7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"db96f14572c7d84521d7dec9bd349ea7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.685480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7195bd60e889079b94ab3446c3676a9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-64.ec2.internal\" (UID: \"d7195bd60e889079b94ab3446c3676a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.685514 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7195bd60e889079b94ab3446c3676a9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-64.ec2.internal\" (UID: \"d7195bd60e889079b94ab3446c3676a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.685522 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/db96f14572c7d84521d7dec9bd349ea7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"db96f14572c7d84521d7dec9bd349ea7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.753911 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.685531 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/db96f14572c7d84521d7dec9bd349ea7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal\" (UID: \"db96f14572c7d84521d7dec9bd349ea7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:42.816692 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.775547 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:42.883543 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.883017 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:43.039422 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.904904 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" Jul 16 16:52:43.039422 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:42.907441 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:43.039422 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:42.983224 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:43.203402 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.083266 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:43.203402 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.184293 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-64.ec2.internal\" not found" Jul 16 16:52:43.203402 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.202938 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 16:52:43.203402 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.203083 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:52:43.203402 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.203087 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.224808 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.251836 2560 apiserver.go:52] "Watching apiserver" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.261652 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.262022 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-pntcv","openshift-multus/multus-additional-cni-plugins-l5885","openshift-multus/network-metrics-daemon-mxtg5","kube-system/konnectivity-agent-qd6k7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r","openshift-image-registry/node-ca-vws6z","openshift-multus/multus-cjtlh","openshift-network-diagnostics/network-check-target-m625q","openshift-network-operator/iptables-alerter-xsmpg","openshift-ovn-kubernetes/ovnkube-node-gwnpv","kube-system/global-pull-secret-syncer-7bhhh","openshift-cluster-node-tuning-operator/tuned-kk2mk"] Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.263452 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.264730 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.265628 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.265630 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.265635 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-66rd9\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.266016 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.266103 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.266755 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.266910 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xmdrz\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.266925 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.266993 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.267294 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.267651 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.268105 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.269721 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 16:47:42 +0000 UTC" deadline="2027-12-16 07:02:28.597226851 +0000 UTC" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.269764 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12422h9m45.327467494s" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.269868 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fx4r9\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.270158 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.270344 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.276132 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.277449 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.278141 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.278224 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 16:52:43.384400 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.278298 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.278331 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s2v9l\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.278927 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.279085 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.279108 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.279277 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.279483 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.279780 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.279853 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-79hwk\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.280534 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.281022 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l6jtf\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.281093 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.281914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.282658 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.282738 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8nlrm\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.282741 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.282763 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.283450 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.283991 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.284064 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dz4sf\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.284090 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.284111 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.284093 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.284427 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.284470 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.284828 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.284901 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.285534 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.285584 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.285614 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-54lkv\"" Jul 16 16:52:43.386553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.286415 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.286458 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-registration-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289058 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f0efdf0-3149-4aa4-b377-9a8a5c804294-serviceca\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289083 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-cni-multus\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289111 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f339eebd-e2df-404a-9090-c02dfd645115-multus-daemon-config\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-cnibin\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289216 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289933 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/529480ee-cf59-4642-a6a4-6aa4443a17ed-iptables-alerter-script\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289959 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-tmp-dir\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.289983 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-k8s-cni-cncf-io\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290004 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-cni-bin\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290054 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n85w5\" (UniqueName: \"kubernetes.io/projected/f339eebd-e2df-404a-9090-c02dfd645115-kube-api-access-n85w5\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.388560 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290086 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-os-release\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-device-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290160 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66znw\" (UniqueName: \"kubernetes.io/projected/529480ee-cf59-4642-a6a4-6aa4443a17ed-kube-api-access-66znw\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290192 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-cnibin\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-os-release\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290250 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-conf-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-etc-kubernetes\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290367 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/529480ee-cf59-4642-a6a4-6aa4443a17ed-host-slash\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290396 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m46c\" (UniqueName: \"kubernetes.io/projected/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-kube-api-access-5m46c\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290418 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-hostroot\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290439 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290459 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gnk8\" (UniqueName: \"kubernetes.io/projected/66845054-acb6-4525-8c1f-16b0e462bc2c-kube-api-access-9gnk8\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8170ec8a-46c8-4685-b342-bf12c1919111-konnectivity-ca\") pod \"konnectivity-agent-qd6k7\" (UID: \"8170ec8a-46c8-4685-b342-bf12c1919111\") " pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:52:43.389210 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290503 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sf27\" (UniqueName: \"kubernetes.io/projected/6f0efdf0-3149-4aa4-b377-9a8a5c804294-kube-api-access-5sf27\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-system-cni-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290562 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-cni-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290585 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f339eebd-e2df-404a-9090-c02dfd645115-cni-binary-copy\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290605 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-socket-dir-parent\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-multus-certs\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290647 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdw7h\" (UniqueName: \"kubernetes.io/projected/2b94d035-84c9-40a7-9b57-60a91d278a3b-kube-api-access-wdw7h\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290677 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-socket-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-netns\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290754 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-sys-fs\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-hosts-file\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.290833 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-kubelet\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.389857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291427 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291455 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkf82\" (UniqueName: \"kubernetes.io/projected/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-kube-api-access-rkf82\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291499 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8170ec8a-46c8-4685-b342-bf12c1919111-agent-certs\") pod \"konnectivity-agent-qd6k7\" (UID: \"8170ec8a-46c8-4685-b342-bf12c1919111\") " pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291510 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal"] Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f0efdf0-3149-4aa4-b377-9a8a5c804294-host\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291542 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-system-cni-dir\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291555 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291563 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.291611 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.295099 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.301307 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.301448 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal"] Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.321792 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c9p8c" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.330497 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c9p8c" Jul 16 16:52:43.390437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.381141 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 16:52:43.392522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.392522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392360 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/529480ee-cf59-4642-a6a4-6aa4443a17ed-iptables-alerter-script\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.392522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392378 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-run\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.392522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392481 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-lib-modules\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.392522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392504 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-k8s-cni-cncf-io\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.392522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392521 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n85w5\" (UniqueName: \"kubernetes.io/projected/f339eebd-e2df-404a-9090-c02dfd645115-kube-api-access-n85w5\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392537 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91fc1288-02fd-4414-916c-734288b37cc6-kubelet-config\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392554 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392605 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-k8s-cni-cncf-io\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-os-release\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392694 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/529480ee-cf59-4642-a6a4-6aa4443a17ed-host-slash\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392746 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m46c\" (UniqueName: \"kubernetes.io/projected/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-kube-api-access-5m46c\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392751 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-os-release\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-etc-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392777 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392815 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392819 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/529480ee-cf59-4642-a6a4-6aa4443a17ed-host-slash\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.393154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392844 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnk8\" (UniqueName: \"kubernetes.io/projected/66845054-acb6-4525-8c1f-16b0e462bc2c-kube-api-access-9gnk8\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392873 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8170ec8a-46c8-4685-b342-bf12c1919111-konnectivity-ca\") pod \"konnectivity-agent-qd6k7\" (UID: \"8170ec8a-46c8-4685-b342-bf12c1919111\") " pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392901 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-var-lib-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392925 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-node-log\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392950 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-system-cni-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.392995 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-socket-dir-parent\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393001 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/529480ee-cf59-4642-a6a4-6aa4443a17ed-iptables-alerter-script\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393021 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-multus-certs\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393034 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-system-cni-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393057 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-multus-certs\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393127 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-socket-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393134 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-socket-dir-parent\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393157 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393184 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-systemd\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.393994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393208 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-tmp\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393232 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393237 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-sys-fs\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393250 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-socket-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393278 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-hosts-file\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393284 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-sys-fs\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393308 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-run-netns\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393328 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-hosts-file\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393335 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-host\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393390 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8170ec8a-46c8-4685-b342-bf12c1919111-agent-certs\") pod \"konnectivity-agent-qd6k7\" (UID: \"8170ec8a-46c8-4685-b342-bf12c1919111\") " pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393414 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f0efdf0-3149-4aa4-b377-9a8a5c804294-host\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-log-socket\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393464 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6f0efdf0-3149-4aa4-b377-9a8a5c804294-host\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.395017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-system-cni-dir\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393498 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-system-cni-dir\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393519 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393466 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8170ec8a-46c8-4685-b342-bf12c1919111-konnectivity-ca\") pod \"konnectivity-agent-qd6k7\" (UID: \"8170ec8a-46c8-4685-b342-bf12c1919111\") " pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393548 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-registration-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393576 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f0efdf0-3149-4aa4-b377-9a8a5c804294-serviceca\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393602 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-env-overrides\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/605f0508-1200-4b51-abff-682d4a6ba04a-ovn-node-metrics-cert\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393549 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-tuned\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393697 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-cni-multus\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393716 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-registration-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393748 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-cnibin\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.395906 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393796 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-cni-multus\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393798 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-tmp-dir\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393830 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393849 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-cni-bin\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-cni-bin\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393881 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-cnibin\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-os-release\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393926 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-cni-bin\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393944 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-device-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393985 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66znw\" (UniqueName: \"kubernetes.io/projected/529480ee-cf59-4642-a6a4-6aa4443a17ed-kube-api-access-66znw\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393990 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2b94d035-84c9-40a7-9b57-60a91d278a3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-ovnkube-script-lib\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394041 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/66845054-acb6-4525-8c1f-16b0e462bc2c-device-dir\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394045 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-systemd\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.396824 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.393985 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2b94d035-84c9-40a7-9b57-60a91d278a3b-os-release\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394078 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-cnibin\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394122 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-tmp-dir\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394128 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6f0efdf0-3149-4aa4-b377-9a8a5c804294-serviceca\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394192 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-conf-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394202 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-cnibin\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394236 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-etc-kubernetes\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394255 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-conf-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394318 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-kubelet\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394326 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-etc-kubernetes\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-ovn\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394374 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysctl-conf\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91fc1288-02fd-4414-916c-734288b37cc6-dbus\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394442 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394486 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-hostroot\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.397776 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sf27\" (UniqueName: \"kubernetes.io/projected/6f0efdf0-3149-4aa4-b377-9a8a5c804294-kube-api-access-5sf27\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394540 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-kubernetes\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394550 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-hostroot\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394563 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-cni-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f339eebd-e2df-404a-9090-c02dfd645115-cni-binary-copy\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdw7h\" (UniqueName: \"kubernetes.io/projected/2b94d035-84c9-40a7-9b57-60a91d278a3b-kube-api-access-wdw7h\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394666 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv46f\" (UniqueName: \"kubernetes.io/projected/605f0508-1200-4b51-abff-682d4a6ba04a-kube-api-access-lv46f\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394681 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-modprobe-d\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394694 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysconfig\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394708 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysctl-d\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394730 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-netns\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394749 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-cni-netd\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394726 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-multus-cni-dir\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.568077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394766 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394798 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-sys\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-var-lib-kubelet\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394929 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-run-netns\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.394961 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cv6r\" (UniqueName: \"kubernetes.io/projected/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-kube-api-access-7cv6r\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395014 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-kubelet\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395055 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkf82\" (UniqueName: \"kubernetes.io/projected/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-kube-api-access-rkf82\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395086 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f339eebd-e2df-404a-9090-c02dfd645115-host-var-lib-kubelet\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.395104 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395130 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-systemd-units\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.395175 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:43.895152511 +0000 UTC m=+2.030767161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395196 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-slash\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395290 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.569433 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395333 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-ovnkube-config\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395333 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f339eebd-e2df-404a-9090-c02dfd645115-cni-binary-copy\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395379 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f339eebd-e2df-404a-9090-c02dfd645115-multus-daemon-config\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.395834 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f339eebd-e2df-404a-9090-c02dfd645115-multus-daemon-config\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.397835 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8170ec8a-46c8-4685-b342-bf12c1919111-agent-certs\") pod \"konnectivity-agent-qd6k7\" (UID: \"8170ec8a-46c8-4685-b342-bf12c1919111\") " pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.403346 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n85w5\" (UniqueName: \"kubernetes.io/projected/f339eebd-e2df-404a-9090-c02dfd645115-kube-api-access-n85w5\") pod \"multus-cjtlh\" (UID: \"f339eebd-e2df-404a-9090-c02dfd645115\") " pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.404409 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gnk8\" (UniqueName: \"kubernetes.io/projected/66845054-acb6-4525-8c1f-16b0e462bc2c-kube-api-access-9gnk8\") pod \"aws-ebs-csi-driver-node-7982r\" (UID: \"66845054-acb6-4525-8c1f-16b0e462bc2c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.405448 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m46c\" (UniqueName: \"kubernetes.io/projected/7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed-kube-api-access-5m46c\") pod \"node-resolver-pntcv\" (UID: \"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed\") " pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.405838 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66znw\" (UniqueName: \"kubernetes.io/projected/529480ee-cf59-4642-a6a4-6aa4443a17ed-kube-api-access-66znw\") pod \"iptables-alerter-xsmpg\" (UID: \"529480ee-cf59-4642-a6a4-6aa4443a17ed\") " pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.406757 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sf27\" (UniqueName: \"kubernetes.io/projected/6f0efdf0-3149-4aa4-b377-9a8a5c804294-kube-api-access-5sf27\") pod \"node-ca-vws6z\" (UID: \"6f0efdf0-3149-4aa4-b377-9a8a5c804294\") " pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.407274 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdw7h\" (UniqueName: \"kubernetes.io/projected/2b94d035-84c9-40a7-9b57-60a91d278a3b-kube-api-access-wdw7h\") pod \"multus-additional-cni-plugins-l5885\" (UID: \"2b94d035-84c9-40a7-9b57-60a91d278a3b\") " pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.407815 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkf82\" (UniqueName: \"kubernetes.io/projected/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-kube-api-access-rkf82\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.426030 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cjtlh" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.449417 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xsmpg" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495645 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-systemd\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-tmp\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.570117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-run-netns\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-host\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495719 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-log-socket\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-env-overrides\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/605f0508-1200-4b51-abff-682d4a6ba04a-ovn-node-metrics-cert\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495767 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-tuned\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495794 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-cni-bin\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495819 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-ovnkube-script-lib\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495833 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-systemd\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495848 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-kubelet\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495865 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-ovn\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495880 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysctl-conf\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495966 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-systemd\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495980 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-run-netns\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496029 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-kubelet\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.570700 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496050 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-systemd\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495989 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-host\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496096 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-cni-bin\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496143 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-ovn\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496248 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysctl-conf\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496292 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-log-socket\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.495895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91fc1288-02fd-4414-916c-734288b37cc6-dbus\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496343 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496411 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/91fc1288-02fd-4414-916c-734288b37cc6-dbus\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.496511 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496538 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-ovnkube-script-lib\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.496572 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret podName:91fc1288-02fd-4414-916c-734288b37cc6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:43.996552629 +0000 UTC m=+2.132167295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret") pod "global-pull-secret-syncer-7bhhh" (UID: "91fc1288-02fd-4414-916c-734288b37cc6") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496784 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-kubernetes\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496829 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-kubernetes\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572122 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.496852 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv46f\" (UniqueName: \"kubernetes.io/projected/605f0508-1200-4b51-abff-682d4a6ba04a-kube-api-access-lv46f\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-modprobe-d\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysconfig\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497105 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysctl-d\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497130 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-cni-netd\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497198 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-modprobe-d\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497180 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-sys\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497260 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysconfig\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497261 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-var-lib-kubelet\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497295 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cv6r\" (UniqueName: \"kubernetes.io/projected/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-kube-api-access-7cv6r\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497314 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-sysctl-d\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497316 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-cni-netd\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497320 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-systemd-units\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497363 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-var-lib-kubelet\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.572600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497366 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-systemd-units\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497370 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-slash\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497413 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-sys\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497408 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-slash\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497472 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497499 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497507 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497534 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-run-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497536 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-ovnkube-config\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497596 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-run\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-lib-modules\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497666 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497909 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-run\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497570 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-host-run-ovn-kubernetes\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573166 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91fc1288-02fd-4414-916c-734288b37cc6-kubelet-config\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.497966 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-etc-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498000 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-lib-modules\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498054 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-var-lib-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-var-lib-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498115 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-node-log\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498238 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-node-log\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498302 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/91fc1288-02fd-4414-916c-734288b37cc6-kubelet-config\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498357 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/605f0508-1200-4b51-abff-682d4a6ba04a-etc-openvswitch\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498361 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-env-overrides\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498439 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-tmp\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498600 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/605f0508-1200-4b51-abff-682d4a6ba04a-ovn-node-metrics-cert\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498789 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/605f0508-1200-4b51-abff-682d4a6ba04a-ovnkube-config\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.498910 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-etc-tuned\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.573660 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.505436 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7195bd60e889079b94ab3446c3676a9.slice/crio-676d7579d8538e63ab45849860398e223aa98a6609b65c2e3f14f8361988b0be WatchSource:0}: Error finding container 676d7579d8538e63ab45849860398e223aa98a6609b65c2e3f14f8361988b0be: Status 404 returned error can't find the container with id 676d7579d8538e63ab45849860398e223aa98a6609b65c2e3f14f8361988b0be Jul 16 16:52:43.574214 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.506007 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb96f14572c7d84521d7dec9bd349ea7.slice/crio-5c6faf6abd459e912d301e0101f8a413770ab1759c649d1dc7f0983c1cba2bda WatchSource:0}: Error finding container 5c6faf6abd459e912d301e0101f8a413770ab1759c649d1dc7f0983c1cba2bda: Status 404 returned error can't find the container with id 5c6faf6abd459e912d301e0101f8a413770ab1759c649d1dc7f0983c1cba2bda Jul 16 16:52:43.574214 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.506079 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:43.574214 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.506097 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:43.574214 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.506106 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mtnsb for pod openshift-network-diagnostics/network-check-target-m625q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:43.574214 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.506152 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb podName:47f541e4-4e7e-42d8-8532-3e922bd9bd0d nodeName:}" failed. No retries permitted until 2026-07-16 16:52:44.006133511 +0000 UTC m=+2.141748162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mtnsb" (UniqueName: "kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb") pod "network-check-target-m625q" (UID: "47f541e4-4e7e-42d8-8532-3e922bd9bd0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:43.574214 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.508429 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cv6r\" (UniqueName: \"kubernetes.io/projected/49900c60-ff99-4c10-b5fa-47f3cf2fc5bc-kube-api-access-7cv6r\") pod \"tuned-kk2mk\" (UID: \"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc\") " pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.574214 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.509152 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv46f\" (UniqueName: \"kubernetes.io/projected/605f0508-1200-4b51-abff-682d4a6ba04a-kube-api-access-lv46f\") pod \"ovnkube-node-gwnpv\" (UID: \"605f0508-1200-4b51-abff-682d4a6ba04a\") " pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.574214 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.511892 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.603140 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pntcv" Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.611090 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e54a8a9_b9fe_4d40_b68f_2e1e9222f1ed.slice/crio-9ea7ae0ffa8dc269a4b4e2415a765e9590880d7a17c6a21145b63b8bfbec168d WatchSource:0}: Error finding container 9ea7ae0ffa8dc269a4b4e2415a765e9590880d7a17c6a21145b63b8bfbec168d: Status 404 returned error can't find the container with id 9ea7ae0ffa8dc269a4b4e2415a765e9590880d7a17c6a21145b63b8bfbec168d Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.623536 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l5885" Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.630417 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b94d035_84c9_40a7_9b57_60a91d278a3b.slice/crio-66ba1bbd0fb49098d88da541e858fd9bddcef7a8e8b21ee8f9a261dc35f2518e WatchSource:0}: Error finding container 66ba1bbd0fb49098d88da541e858fd9bddcef7a8e8b21ee8f9a261dc35f2518e: Status 404 returned error can't find the container with id 66ba1bbd0fb49098d88da541e858fd9bddcef7a8e8b21ee8f9a261dc35f2518e Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.632520 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.644572 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8170ec8a_46c8_4685_b342_bf12c1919111.slice/crio-84c78af2cbb53cc8fda27481caceed76fdf80569b7123cd0837db2c82202c1d5 WatchSource:0}: Error finding container 84c78af2cbb53cc8fda27481caceed76fdf80569b7123cd0837db2c82202c1d5: Status 404 returned error can't find the container with id 84c78af2cbb53cc8fda27481caceed76fdf80569b7123cd0837db2c82202c1d5 Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.671418 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.676583 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vws6z" Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.678708 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66845054_acb6_4525_8c1f_16b0e462bc2c.slice/crio-1e76abee35ba934e9a1c8ed611130e0a26861abd13f1ac30ef81406cfcd6a482 WatchSource:0}: Error finding container 1e76abee35ba934e9a1c8ed611130e0a26861abd13f1ac30ef81406cfcd6a482: Status 404 returned error can't find the container with id 1e76abee35ba934e9a1c8ed611130e0a26861abd13f1ac30ef81406cfcd6a482 Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.682853 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0efdf0_3149_4aa4_b377_9a8a5c804294.slice/crio-67ae5e104584d07e086b383856e8ca0d4605c50ec1f58c406fec84de5fade203 WatchSource:0}: Error finding container 67ae5e104584d07e086b383856e8ca0d4605c50ec1f58c406fec84de5fade203: Status 404 returned error can't find the container with id 67ae5e104584d07e086b383856e8ca0d4605c50ec1f58c406fec84de5fade203 Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.777872 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" Jul 16 16:52:43.781951 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.777925 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:52:43.786391 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.786244 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49900c60_ff99_4c10_b5fa_47f3cf2fc5bc.slice/crio-41ba3c122ce8c6568a869dfe5a57c3339b5f01cdcf03bb979069b0df0d1e2059 WatchSource:0}: Error finding container 41ba3c122ce8c6568a869dfe5a57c3339b5f01cdcf03bb979069b0df0d1e2059: Status 404 returned error can't find the container with id 41ba3c122ce8c6568a869dfe5a57c3339b5f01cdcf03bb979069b0df0d1e2059 Jul 16 16:52:43.789622 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.788561 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod605f0508_1200_4b51_abff_682d4a6ba04a.slice/crio-1d8d9bcb72d99b5c32c670e08e9e7f151f3e8503428b5524028e1774bf4bdb8f WatchSource:0}: Error finding container 1d8d9bcb72d99b5c32c670e08e9e7f151f3e8503428b5524028e1774bf4bdb8f: Status 404 returned error can't find the container with id 1d8d9bcb72d99b5c32c670e08e9e7f151f3e8503428b5524028e1774bf4bdb8f Jul 16 16:52:43.934437 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:52:43.808658 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529480ee_cf59_4642_a6a4_6aa4443a17ed.slice/crio-227712a11ce19162349f6a57b827e26ab4768e91ff0a8238436b242d831c7d51 WatchSource:0}: Error finding container 227712a11ce19162349f6a57b827e26ab4768e91ff0a8238436b242d831c7d51: Status 404 returned error can't find the container with id 227712a11ce19162349f6a57b827e26ab4768e91ff0a8238436b242d831c7d51 Jul 16 16:52:43.934437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.822897 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:43.934437 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:43.900186 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:43.934437 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.900288 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:43.934437 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:43.900330 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:44.900317409 +0000 UTC m=+3.035932059 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:44.050313 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.001263 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:44.050313 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:44.001443 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:44.050313 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:44.001498 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret podName:91fc1288-02fd-4414-916c-734288b37cc6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:45.001483353 +0000 UTC m=+3.137098000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret") pod "global-pull-secret-syncer-7bhhh" (UID: "91fc1288-02fd-4414-916c-734288b37cc6") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:44.050313 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.008952 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:44.143475 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.102124 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:44.143475 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:44.102329 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:44.143475 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:44.102348 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:44.143475 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:44.102361 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mtnsb for pod openshift-network-diagnostics/network-check-target-m625q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:44.143475 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:44.102424 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb podName:47f541e4-4e7e-42d8-8532-3e922bd9bd0d nodeName:}" failed. No retries permitted until 2026-07-16 16:52:45.102404651 +0000 UTC m=+3.238019297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtnsb" (UniqueName: "kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb") pod "network-check-target-m625q" (UID: "47f541e4-4e7e-42d8-8532-3e922bd9bd0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:44.335377 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.332694 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:47:43 +0000 UTC" deadline="2028-02-20 07:30:26.525506817 +0000 UTC" Jul 16 16:52:44.335377 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.332765 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14006h37m42.192746345s" Jul 16 16:52:44.356631 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.356393 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:44.496697 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.496637 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pntcv" event={"ID":"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed","Type":"ContainerStarted","Data":"9ea7ae0ffa8dc269a4b4e2415a765e9590880d7a17c6a21145b63b8bfbec168d"} Jul 16 16:52:44.511944 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.511902 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" event={"ID":"db96f14572c7d84521d7dec9bd349ea7","Type":"ContainerStarted","Data":"5c6faf6abd459e912d301e0101f8a413770ab1759c649d1dc7f0983c1cba2bda"} Jul 16 16:52:44.517043 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.516890 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" event={"ID":"d7195bd60e889079b94ab3446c3676a9","Type":"ContainerStarted","Data":"676d7579d8538e63ab45849860398e223aa98a6609b65c2e3f14f8361988b0be"} Jul 16 16:52:44.524127 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.524071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cjtlh" event={"ID":"f339eebd-e2df-404a-9090-c02dfd645115","Type":"ContainerStarted","Data":"afa13e7f2bc425131e5fb7ecbdff2125f577a3c07e7e8d0e93805f9ba43dd7e7"} Jul 16 16:52:44.533215 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.533186 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xsmpg" event={"ID":"529480ee-cf59-4642-a6a4-6aa4443a17ed","Type":"ContainerStarted","Data":"227712a11ce19162349f6a57b827e26ab4768e91ff0a8238436b242d831c7d51"} Jul 16 16:52:44.561409 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.561310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"1d8d9bcb72d99b5c32c670e08e9e7f151f3e8503428b5524028e1774bf4bdb8f"} Jul 16 16:52:44.577831 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.577778 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vws6z" event={"ID":"6f0efdf0-3149-4aa4-b377-9a8a5c804294","Type":"ContainerStarted","Data":"67ae5e104584d07e086b383856e8ca0d4605c50ec1f58c406fec84de5fade203"} Jul 16 16:52:44.582716 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.582624 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" event={"ID":"66845054-acb6-4525-8c1f-16b0e462bc2c","Type":"ContainerStarted","Data":"1e76abee35ba934e9a1c8ed611130e0a26861abd13f1ac30ef81406cfcd6a482"} Jul 16 16:52:44.592998 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.592883 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerStarted","Data":"66ba1bbd0fb49098d88da541e858fd9bddcef7a8e8b21ee8f9a261dc35f2518e"} Jul 16 16:52:44.599282 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.599219 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" event={"ID":"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc","Type":"ContainerStarted","Data":"41ba3c122ce8c6568a869dfe5a57c3339b5f01cdcf03bb979069b0df0d1e2059"} Jul 16 16:52:44.609434 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.609407 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qd6k7" event={"ID":"8170ec8a-46c8-4685-b342-bf12c1919111","Type":"ContainerStarted","Data":"84c78af2cbb53cc8fda27481caceed76fdf80569b7123cd0837db2c82202c1d5"} Jul 16 16:52:44.909178 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:44.909004 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:44.909178 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:44.909155 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:44.909406 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:44.909221 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:46.909202557 +0000 UTC m=+5.044817211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:45.010100 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:45.010063 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:45.010284 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.010232 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:45.010342 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.010301 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret podName:91fc1288-02fd-4414-916c-734288b37cc6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:47.010279999 +0000 UTC m=+5.145894647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret") pod "global-pull-secret-syncer-7bhhh" (UID: "91fc1288-02fd-4414-916c-734288b37cc6") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:45.110523 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:45.110482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:45.110776 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.110666 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:45.110776 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.110687 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:45.110776 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.110701 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mtnsb for pod openshift-network-diagnostics/network-check-target-m625q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:45.110776 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.110758 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb podName:47f541e4-4e7e-42d8-8532-3e922bd9bd0d nodeName:}" failed. No retries permitted until 2026-07-16 16:52:47.11073762 +0000 UTC m=+5.246352285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtnsb" (UniqueName: "kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb") pod "network-check-target-m625q" (UID: "47f541e4-4e7e-42d8-8532-3e922bd9bd0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:45.333156 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:45.333065 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:47:43 +0000 UTC" deadline="2027-12-31 15:35:31.557168408 +0000 UTC" Jul 16 16:52:45.333156 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:45.333111 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12790h42m46.22406241s" Jul 16 16:52:45.472061 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:45.471013 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:45.472061 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.471164 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:52:45.472061 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:45.471709 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:45.472061 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.471810 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:45.472061 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:45.471898 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:45.472061 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:45.471984 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:46.926194 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:46.926052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:46.926771 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:46.926224 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:46.926771 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:46.926295 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:50.926273472 +0000 UTC m=+9.061888120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:47.026731 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:47.026661 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:47.026969 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.026816 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:47.026969 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.026884 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret podName:91fc1288-02fd-4414-916c-734288b37cc6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:51.026863013 +0000 UTC m=+9.162477664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret") pod "global-pull-secret-syncer-7bhhh" (UID: "91fc1288-02fd-4414-916c-734288b37cc6") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:47.127336 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:47.127296 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:47.127526 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.127467 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:47.127526 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.127486 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:47.127526 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.127498 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mtnsb for pod openshift-network-diagnostics/network-check-target-m625q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:47.127690 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.127558 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb podName:47f541e4-4e7e-42d8-8532-3e922bd9bd0d nodeName:}" failed. No retries permitted until 2026-07-16 16:52:51.127537664 +0000 UTC m=+9.263152317 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtnsb" (UniqueName: "kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb") pod "network-check-target-m625q" (UID: "47f541e4-4e7e-42d8-8532-3e922bd9bd0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:47.470964 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:47.470330 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:47.470964 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:47.470380 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:47.470964 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.470495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:47.470964 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:47.470712 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:47.470964 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.470831 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:47.470964 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:47.470926 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:52:49.470243 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:49.470212 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:49.470681 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:49.470341 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:52:49.470758 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:49.470700 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:49.470825 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:49.470797 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:49.470895 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:49.470854 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:49.470955 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:49.470924 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:50.960990 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:50.960942 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:50.961421 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:50.961137 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:50.961421 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:50.961212 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:52:58.961191845 +0000 UTC m=+17.096806491 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:51.061372 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:51.061331 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:51.061535 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.061523 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:51.061590 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.061580 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret podName:91fc1288-02fd-4414-916c-734288b37cc6 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:59.06156343 +0000 UTC m=+17.197178084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret") pod "global-pull-secret-syncer-7bhhh" (UID: "91fc1288-02fd-4414-916c-734288b37cc6") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:51.163232 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:51.162668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:51.163232 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.162839 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:51.163232 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.162860 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:51.163232 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.162871 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mtnsb for pod openshift-network-diagnostics/network-check-target-m625q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:51.163232 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.162927 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb podName:47f541e4-4e7e-42d8-8532-3e922bd9bd0d nodeName:}" failed. No retries permitted until 2026-07-16 16:52:59.162909015 +0000 UTC m=+17.298523675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtnsb" (UniqueName: "kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb") pod "network-check-target-m625q" (UID: "47f541e4-4e7e-42d8-8532-3e922bd9bd0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:51.470436 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:51.470403 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:51.470618 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.470522 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:51.470618 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:51.470580 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:51.470735 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.470652 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:51.470735 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:51.470699 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:51.470832 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:51.470785 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:52:53.470536 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:53.470502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:53.470988 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:53.470622 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:53.470988 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:53.470629 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:53.470988 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:53.470656 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:53.470988 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:53.470723 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:53.470988 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:53.470826 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:52:55.470604 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:55.470565 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:55.471062 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:55.470612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:55.471062 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:55.470612 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:55.471062 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:55.470698 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:55.471062 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:55.470817 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:52:55.471062 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:55.470897 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:57.469871 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:57.469825 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:57.469871 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:57.469852 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:57.470372 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:57.469953 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:57.470372 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:57.469997 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:57.470372 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:57.470143 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:52:57.470372 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:57.470234 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:59.020058 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:59.020018 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:59.020541 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.020185 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:59.020541 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.020260 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:53:15.020240507 +0000 UTC m=+33.155855169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:59.121316 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:59.121273 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:59.121469 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.121441 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:59.121531 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.121511 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret podName:91fc1288-02fd-4414-916c-734288b37cc6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:15.12149058 +0000 UTC m=+33.257105247 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret") pod "global-pull-secret-syncer-7bhhh" (UID: "91fc1288-02fd-4414-916c-734288b37cc6") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:59.222093 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:59.222056 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:59.222288 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.222202 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:59.222288 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.222227 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:59.222288 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.222241 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mtnsb for pod openshift-network-diagnostics/network-check-target-m625q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:59.222482 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.222306 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb podName:47f541e4-4e7e-42d8-8532-3e922bd9bd0d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:15.222287669 +0000 UTC m=+33.357902338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtnsb" (UniqueName: "kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb") pod "network-check-target-m625q" (UID: "47f541e4-4e7e-42d8-8532-3e922bd9bd0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:59.470984 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:59.470890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:52:59.471148 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:59.470901 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:52:59.471148 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.471027 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:52:59.471148 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:52:59.470901 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:52:59.471148 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.471094 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:52:59.471306 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:52:59.471187 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:01.469872 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:01.469835 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:01.470247 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:01.469835 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:01.470247 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:01.469944 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:01.470247 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:01.470041 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:01.470247 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:01.469835 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:01.470247 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:01.470114 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:03.470117 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:03.469890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:03.470438 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:03.469890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:03.470438 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:03.470163 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:03.470438 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:03.470220 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:03.470438 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:03.469890 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:03.470438 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:03.470277 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:04.652282 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.652107 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qd6k7" event={"ID":"8170ec8a-46c8-4685-b342-bf12c1919111","Type":"ContainerStarted","Data":"62cd04b954039dbfb3a15a05f7ac8ee0fd03f698b5ead2a5443d7a5b1473e976"} Jul 16 16:53:04.653342 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.653321 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pntcv" event={"ID":"7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed","Type":"ContainerStarted","Data":"ed0b8fd203b2616afbe0ed4233bcec0df90e7a011ab5b168aed42365ebb82886"} Jul 16 16:53:04.654632 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.654612 2560 generic.go:356] "Generic (PLEG): container finished" podID="db96f14572c7d84521d7dec9bd349ea7" containerID="ddb9ebc137332e4c72f922a137d1dc4de6a98aa0202be607a9d66bf352b173d6" exitCode=0 Jul 16 16:53:04.654720 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.654670 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" event={"ID":"db96f14572c7d84521d7dec9bd349ea7","Type":"ContainerDied","Data":"ddb9ebc137332e4c72f922a137d1dc4de6a98aa0202be607a9d66bf352b173d6"} Jul 16 16:53:04.658368 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.658220 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" event={"ID":"d7195bd60e889079b94ab3446c3676a9","Type":"ContainerStarted","Data":"a84970e4b624010e4444e270224b8b1f09c438faad05fc106ca37dd91f29d45e"} Jul 16 16:53:04.660059 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.660018 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cjtlh" event={"ID":"f339eebd-e2df-404a-9090-c02dfd645115","Type":"ContainerStarted","Data":"4825f3307c69e51430543d52af949c75f41617eda748037f9b6b804ff47cc090"} Jul 16 16:53:04.662208 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.662191 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 16:53:04.662493 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.662475 2560 generic.go:356] "Generic (PLEG): container finished" podID="605f0508-1200-4b51-abff-682d4a6ba04a" containerID="757e4c4a5bcc136877ea8337b83047c9e04520332a16f7792162bfafd497c2f5" exitCode=1 Jul 16 16:53:04.662558 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.662539 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"9059f4bc49ec106dc2873d83e5eab3a7582a644f3d4432d8f87c86ddf150e6d3"} Jul 16 16:53:04.662607 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.662595 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"b4c1631645a4c39213d008699e5062942de6396043222ac26142acfbe616435a"} Jul 16 16:53:04.662648 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.662632 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"cf5534c5b842e616a77e2302076a7a36e1ec676426465123a8475c724f7d9845"} Jul 16 16:53:04.662689 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.662661 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerDied","Data":"757e4c4a5bcc136877ea8337b83047c9e04520332a16f7792162bfafd497c2f5"} Jul 16 16:53:04.662735 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.662687 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"a153223c056eb877623bba60bc5ca3e326615fc5943167776b1005776a850d71"} Jul 16 16:53:04.663880 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.663852 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vws6z" event={"ID":"6f0efdf0-3149-4aa4-b377-9a8a5c804294","Type":"ContainerStarted","Data":"f6b418e1e7f43d232fc1cdea8ea6f5994e7fa4171e9e027a9cffa85e2826cad2"} Jul 16 16:53:04.665254 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.665236 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" event={"ID":"66845054-acb6-4525-8c1f-16b0e462bc2c","Type":"ContainerStarted","Data":"7207623eb2383fb6c194639d377bf9d42fb3f54453489bc3845286ce8d365f2a"} Jul 16 16:53:04.666536 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.666514 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b94d035-84c9-40a7-9b57-60a91d278a3b" containerID="b97de11d677038a82b430738f7631cacf92f35aefb4e1acf46f33970baa53aec" exitCode=0 Jul 16 16:53:04.666625 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.666542 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerDied","Data":"b97de11d677038a82b430738f7631cacf92f35aefb4e1acf46f33970baa53aec"} Jul 16 16:53:04.668011 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.667951 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qd6k7" podStartSLOduration=11.428340577 podStartE2EDuration="22.667937141s" totalImagesPullingTime="11.239596564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:04.666976492 +0000 UTC m=+22.802591173" watchObservedRunningTime="2026-07-16 16:53:04.667937141 +0000 UTC m=+22.803551819" Jul 16 16:53:04.668253 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.668234 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" event={"ID":"49900c60-ff99-4c10-b5fa-47f3cf2fc5bc","Type":"ContainerStarted","Data":"2e8b7dfb21cc703c355b504c3ae00bfa76d36b0e54cb2e350fc72b4e590cc140"} Jul 16 16:53:04.680264 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.680235 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-64.ec2.internal" podStartSLOduration=21.680223094 podStartE2EDuration="21.680223094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:04.679677206 +0000 UTC m=+22.815291873" watchObservedRunningTime="2026-07-16 16:53:04.680223094 +0000 UTC m=+22.815837760" Jul 16 16:53:04.695725 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.695684 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pntcv" podStartSLOduration=2.7171778140000002 podStartE2EDuration="22.695666996s" totalImagesPullingTime="19.978489182s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:04.695100222 +0000 UTC m=+22.830714889" watchObservedRunningTime="2026-07-16 16:53:04.695666996 +0000 UTC m=+22.831281663" Jul 16 16:53:04.744658 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.744619 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vws6z" podStartSLOduration=3.218405304 podStartE2EDuration="22.744604521s" totalImagesPullingTime="19.526199217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:04.744492732 +0000 UTC m=+22.880107422" watchObservedRunningTime="2026-07-16 16:53:04.744604521 +0000 UTC m=+22.880219187" Jul 16 16:53:04.760109 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.760067 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kk2mk" podStartSLOduration=2.956614824 podStartE2EDuration="22.76005206s" totalImagesPullingTime="19.803437236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:04.759447521 +0000 UTC m=+22.895062188" watchObservedRunningTime="2026-07-16 16:53:04.76005206 +0000 UTC m=+22.895666729" Jul 16 16:53:04.776503 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:04.776460 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cjtlh" podStartSLOduration=3.020369338 podStartE2EDuration="22.77644512s" totalImagesPullingTime="19.756075782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:04.776163855 +0000 UTC m=+22.911778521" watchObservedRunningTime="2026-07-16 16:53:04.77644512 +0000 UTC m=+22.912059786" Jul 16 16:53:05.470388 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.470291 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:05.470651 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.470307 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:05.470651 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.470444 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:05.470651 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:05.470514 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:05.470651 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:05.470411 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:05.470651 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:05.470619 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:05.672879 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.672843 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" event={"ID":"db96f14572c7d84521d7dec9bd349ea7","Type":"ContainerStarted","Data":"19122a0096e9224dd713a2bd60c5766ee163de4a92dca54cafe9ff2a99ee84cd"} Jul 16 16:53:05.674376 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.674347 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xsmpg" event={"ID":"529480ee-cf59-4642-a6a4-6aa4443a17ed","Type":"ContainerStarted","Data":"7e120137d6df4d954036ef5f0c8e005b590cd875a78b345484055e523b962f4e"} Jul 16 16:53:05.677429 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.677406 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 16:53:05.678236 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.678055 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"23de721268d66661cd0bb6dfffaa438e0e4f1b6cbcba5bf6fa78b2f09e7cbcf9"} Jul 16 16:53:05.690528 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.690481 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-64.ec2.internal" podStartSLOduration=22.690468882 podStartE2EDuration="22.690468882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:05.690379224 +0000 UTC m=+23.825993893" watchObservedRunningTime="2026-07-16 16:53:05.690468882 +0000 UTC m=+23.826083547" Jul 16 16:53:05.704151 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.704103 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xsmpg" podStartSLOduration=4.303703404 podStartE2EDuration="23.704086938s" totalImagesPullingTime="19.400383534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:05.703567625 +0000 UTC m=+23.839182293" watchObservedRunningTime="2026-07-16 16:53:05.704086938 +0000 UTC m=+23.839701605" Jul 16 16:53:05.720293 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:05.720259 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 16:53:06.367424 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:06.367320 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T16:53:05.720278582Z","UUID":"1390d9d5-6af9-4a45-9a68-96fd2ec5b6c3","Handler":null,"Name":"","Endpoint":""} Jul 16 16:53:06.370591 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:06.370570 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 16:53:06.370723 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:06.370611 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 16:53:06.682068 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:06.681972 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" event={"ID":"66845054-acb6-4525-8c1f-16b0e462bc2c","Type":"ContainerStarted","Data":"f6de7e0a309376b215c6bf05649676aa431498d2bb3388c443c2751d8db3c1ec"} Jul 16 16:53:07.470075 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:07.469990 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:07.470075 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:07.470020 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:07.470075 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:07.470025 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:07.470324 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:07.470139 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:07.470324 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:07.470294 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:07.470405 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:07.470378 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:07.688016 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:07.687986 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 16:53:07.688470 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:07.688362 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"70392f0c7d50b1966be0acb38c1290eee2818f90874e80d11377631612581f43"} Jul 16 16:53:07.690532 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:07.690505 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" event={"ID":"66845054-acb6-4525-8c1f-16b0e462bc2c","Type":"ContainerStarted","Data":"90d826185fc03097b58c1e43aead9d4972fd9aedc00a174b15951b96c4613ea6"} Jul 16 16:53:07.707106 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:07.707055 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7982r" podStartSLOduration=3.753391624 podStartE2EDuration="25.707035235s" totalImagesPullingTime="21.953643611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:07.706096037 +0000 UTC m=+25.841710706" watchObservedRunningTime="2026-07-16 16:53:07.707035235 +0000 UTC m=+25.842649903" Jul 16 16:53:08.488599 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:08.488572 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:53:08.489201 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:08.489175 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:53:08.693124 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:08.693088 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:53:08.693545 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:08.693528 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qd6k7" Jul 16 16:53:09.470492 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.470305 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:09.470634 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.470330 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:09.470634 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:09.470538 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:09.470634 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.470352 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:09.470722 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:09.470689 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:09.470722 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:09.470597 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:09.697317 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.697289 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 16:53:09.698160 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.697701 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"f79b6483dce81170580f0268ed2a629d2f5267c5c81c37fd0930c63d45322dbf"} Jul 16 16:53:09.698160 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.697944 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:53:09.698160 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.698155 2560 scope.go:117] "RemoveContainer" containerID="757e4c4a5bcc136877ea8337b83047c9e04520332a16f7792162bfafd497c2f5" Jul 16 16:53:09.699625 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.699599 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b94d035-84c9-40a7-9b57-60a91d278a3b" containerID="6a03962f6fc6dfbafd9450dbec6cc48bf709315d12e332f6e079c2aafaa406d4" exitCode=0 Jul 16 16:53:09.699759 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.699674 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerDied","Data":"6a03962f6fc6dfbafd9450dbec6cc48bf709315d12e332f6e079c2aafaa406d4"} Jul 16 16:53:09.714779 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:09.714759 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:53:10.705108 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:10.705046 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 16:53:10.705470 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:10.705386 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" event={"ID":"605f0508-1200-4b51-abff-682d4a6ba04a","Type":"ContainerStarted","Data":"1896f744e885018b16bd571d6e9e2b0d37eecc34a70c489dd41177ab656c6f65"} Jul 16 16:53:10.705519 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:10.705480 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 16:53:10.705841 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:10.705808 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:53:10.720066 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:10.720049 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:53:10.730865 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:10.730828 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" podStartSLOduration=8.517784999 podStartE2EDuration="28.730815133s" totalImagesPullingTime="20.213030134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:10.730328644 +0000 UTC m=+28.865943312" watchObservedRunningTime="2026-07-16 16:53:10.730815133 +0000 UTC m=+28.866429823" Jul 16 16:53:11.465794 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.465764 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7bhhh"] Jul 16 16:53:11.465991 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.465906 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:11.466056 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:11.466026 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:11.469831 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.469808 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxtg5"] Jul 16 16:53:11.469946 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.469932 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:11.470059 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:11.470039 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:11.470119 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.470102 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:11.470233 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:11.470212 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:11.470471 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.470455 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m625q"] Jul 16 16:53:11.709611 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.709533 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b94d035-84c9-40a7-9b57-60a91d278a3b" containerID="8a138b73dfca232204efc6529a2f88519b50004897b6f25ab1772953316e8598" exitCode=0 Jul 16 16:53:11.709611 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.709589 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:11.710065 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.709611 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerDied","Data":"8a138b73dfca232204efc6529a2f88519b50004897b6f25ab1772953316e8598"} Jul 16 16:53:11.710065 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:11.709701 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:11.710065 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:11.709875 2560 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 16 16:53:12.178874 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:12.178802 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:53:12.714101 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:12.713901 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerStarted","Data":"7994fb061cf61202e423951748e284962ca991068b24b5a8975769dd5d331840"} Jul 16 16:53:13.469836 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:13.469763 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:13.469985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:13.469857 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:13.469985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:13.469863 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:13.469985 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:13.469881 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:13.469985 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:13.469940 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:13.470109 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:13.470016 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:13.717754 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:13.717723 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b94d035-84c9-40a7-9b57-60a91d278a3b" containerID="7994fb061cf61202e423951748e284962ca991068b24b5a8975769dd5d331840" exitCode=0 Jul 16 16:53:13.718125 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:13.717761 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerDied","Data":"7994fb061cf61202e423951748e284962ca991068b24b5a8975769dd5d331840"} Jul 16 16:53:15.043803 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:15.043769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:15.044491 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.043917 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:53:15.044491 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.044000 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:53:47.043979945 +0000 UTC m=+65.179594593 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:53:15.144398 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:15.144367 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:15.144536 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.144481 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:53:15.144594 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.144542 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret podName:91fc1288-02fd-4414-916c-734288b37cc6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:47.144524597 +0000 UTC m=+65.280139245 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret") pod "global-pull-secret-syncer-7bhhh" (UID: "91fc1288-02fd-4414-916c-734288b37cc6") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:53:15.245623 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:15.245590 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:15.245767 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.245742 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:53:15.245767 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.245763 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:53:15.245858 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.245774 2560 projected.go:196] Error preparing data for projected volume kube-api-access-mtnsb for pod openshift-network-diagnostics/network-check-target-m625q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:53:15.245858 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.245827 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb podName:47f541e4-4e7e-42d8-8532-3e922bd9bd0d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:47.245814598 +0000 UTC m=+65.381429243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mtnsb" (UniqueName: "kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb") pod "network-check-target-m625q" (UID: "47f541e4-4e7e-42d8-8532-3e922bd9bd0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:53:15.470323 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:15.470250 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:15.470488 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:15.470347 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:15.470488 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.470357 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:15.470488 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:15.470382 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:15.470617 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.470486 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:15.470617 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:15.470555 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:17.470104 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.470077 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:17.470597 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.470181 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:17.470597 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:17.470192 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7bhhh" podUID="91fc1288-02fd-4414-916c-734288b37cc6" Jul 16 16:53:17.470597 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:17.470277 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:53:17.470597 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.470310 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:17.470597 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:17.470355 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-m625q" podUID="47f541e4-4e7e-42d8-8532-3e922bd9bd0d" Jul 16 16:53:17.651405 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.651344 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-64.ec2.internal" event="NodeReady" Jul 16 16:53:17.651515 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.651447 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 16:53:17.693020 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.692994 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tqgfl"] Jul 16 16:53:17.722003 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.721975 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9c82j"] Jul 16 16:53:17.722143 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.722089 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.724445 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.724422 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 16:53:17.724445 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.724432 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 16:53:17.724445 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.724441 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hmppn\"" Jul 16 16:53:17.748521 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.748493 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqgfl"] Jul 16 16:53:17.748669 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.748540 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9c82j"] Jul 16 16:53:17.748669 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.748577 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9c82j" Jul 16 16:53:17.752812 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.752788 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 16:53:17.752977 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.752833 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6c76s\"" Jul 16 16:53:17.752977 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.752840 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 16:53:17.752977 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.752849 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 16:53:17.867677 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.867654 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-config-volume\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.867788 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.867694 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq5mn\" (UniqueName: \"kubernetes.io/projected/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-kube-api-access-gq5mn\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.867788 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.867717 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srtd2\" (UniqueName: \"kubernetes.io/projected/6b6a1bb0-b2e2-4291-a899-abe969c0aa7c-kube-api-access-srtd2\") pod \"ingress-canary-9c82j\" (UID: \"6b6a1bb0-b2e2-4291-a899-abe969c0aa7c\") " pod="openshift-ingress-canary/ingress-canary-9c82j" Jul 16 16:53:17.867902 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.867818 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.867902 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.867864 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-tmp-dir\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.867902 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.867890 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b6a1bb0-b2e2-4291-a899-abe969c0aa7c-cert\") pod \"ingress-canary-9c82j\" (UID: \"6b6a1bb0-b2e2-4291-a899-abe969c0aa7c\") " pod="openshift-ingress-canary/ingress-canary-9c82j" Jul 16 16:53:17.968392 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.968366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-tmp-dir\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.968488 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.968400 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b6a1bb0-b2e2-4291-a899-abe969c0aa7c-cert\") pod \"ingress-canary-9c82j\" (UID: \"6b6a1bb0-b2e2-4291-a899-abe969c0aa7c\") " pod="openshift-ingress-canary/ingress-canary-9c82j" Jul 16 16:53:17.968488 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.968435 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-config-volume\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.968672 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.968652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq5mn\" (UniqueName: \"kubernetes.io/projected/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-kube-api-access-gq5mn\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.968719 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.968684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srtd2\" (UniqueName: \"kubernetes.io/projected/6b6a1bb0-b2e2-4291-a899-abe969c0aa7c-kube-api-access-srtd2\") pod \"ingress-canary-9c82j\" (UID: \"6b6a1bb0-b2e2-4291-a899-abe969c0aa7c\") " pod="openshift-ingress-canary/ingress-canary-9c82j" Jul 16 16:53:17.968775 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.968725 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.968825 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.968799 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-tmp-dir\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.968872 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:17.968839 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:17.968914 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:17.968891 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:53:18.468871418 +0000 UTC m=+36.604486066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:53:17.969086 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.969071 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-config-volume\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.972399 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.972371 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b6a1bb0-b2e2-4291-a899-abe969c0aa7c-cert\") pod \"ingress-canary-9c82j\" (UID: \"6b6a1bb0-b2e2-4291-a899-abe969c0aa7c\") " pod="openshift-ingress-canary/ingress-canary-9c82j" Jul 16 16:53:17.976759 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.976725 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq5mn\" (UniqueName: \"kubernetes.io/projected/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-kube-api-access-gq5mn\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:17.976994 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:17.976954 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srtd2\" (UniqueName: \"kubernetes.io/projected/6b6a1bb0-b2e2-4291-a899-abe969c0aa7c-kube-api-access-srtd2\") pod \"ingress-canary-9c82j\" (UID: \"6b6a1bb0-b2e2-4291-a899-abe969c0aa7c\") " pod="openshift-ingress-canary/ingress-canary-9c82j" Jul 16 16:53:18.057257 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:18.057223 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9c82j" Jul 16 16:53:18.192543 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:18.192301 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9c82j"] Jul 16 16:53:18.195594 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:53:18.195570 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6a1bb0_b2e2_4291_a899_abe969c0aa7c.slice/crio-2d1a78ef4112540f97fe5d49ccd1f9ee447498f623a43820e61c362ac2793cd1 WatchSource:0}: Error finding container 2d1a78ef4112540f97fe5d49ccd1f9ee447498f623a43820e61c362ac2793cd1: Status 404 returned error can't find the container with id 2d1a78ef4112540f97fe5d49ccd1f9ee447498f623a43820e61c362ac2793cd1 Jul 16 16:53:18.473112 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:18.473036 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:18.473557 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:18.473171 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:18.473557 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:18.473224 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:53:19.47321039 +0000 UTC m=+37.608825039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:53:18.734099 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:18.734015 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b94d035-84c9-40a7-9b57-60a91d278a3b" containerID="15c6ad73871b1c96bee69bdde83f4cd5c6f0778348c9871be606b71434548d7d" exitCode=0 Jul 16 16:53:18.734244 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:18.734131 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerDied","Data":"15c6ad73871b1c96bee69bdde83f4cd5c6f0778348c9871be606b71434548d7d"} Jul 16 16:53:18.735635 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:18.735611 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9c82j" event={"ID":"6b6a1bb0-b2e2-4291-a899-abe969c0aa7c","Type":"ContainerStarted","Data":"2d1a78ef4112540f97fe5d49ccd1f9ee447498f623a43820e61c362ac2793cd1"} Jul 16 16:53:19.470167 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.470124 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:19.470353 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.470118 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:19.470353 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.470136 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:19.472608 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.472583 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 16:53:19.473450 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.473427 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjfzg\"" Jul 16 16:53:19.473894 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.473427 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6jw2c\"" Jul 16 16:53:19.473894 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.473460 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 16:53:19.473894 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.473526 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 16:53:19.473894 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.473526 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 16:53:19.481973 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.481937 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:19.482086 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:19.482064 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:19.482183 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:19.482131 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:53:21.48211115 +0000 UTC m=+39.617725802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:53:19.742160 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.742083 2560 generic.go:356] "Generic (PLEG): container finished" podID="2b94d035-84c9-40a7-9b57-60a91d278a3b" containerID="65ed35ff4bca0557158862dbb280453f66406d39b84311c04107276de039457a" exitCode=0 Jul 16 16:53:19.742287 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:19.742166 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerDied","Data":"65ed35ff4bca0557158862dbb280453f66406d39b84311c04107276de039457a"} Jul 16 16:53:20.747867 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:20.747627 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l5885" event={"ID":"2b94d035-84c9-40a7-9b57-60a91d278a3b","Type":"ContainerStarted","Data":"6e654222d4a1e33770da97529ff10eda22988d531efd300cf5b8d855221dc05a"} Jul 16 16:53:20.749071 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:20.749051 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9c82j" event={"ID":"6b6a1bb0-b2e2-4291-a899-abe969c0aa7c","Type":"ContainerStarted","Data":"b20de36d76aa1b16b104d4e714219d76736323b72f1d94c9473db86f9f47ca0f"} Jul 16 16:53:20.768445 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:20.768399 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l5885" podStartSLOduration=8.919830815 podStartE2EDuration="38.768387112s" totalImagesPullingTime="29.848556297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:20.767170664 +0000 UTC m=+38.902785330" watchObservedRunningTime="2026-07-16 16:53:20.768387112 +0000 UTC m=+38.904001778" Jul 16 16:53:20.780762 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:20.780717 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9c82j" podStartSLOduration=1.72939824 podStartE2EDuration="3.780702937s" totalImagesPullingTime="2.051304697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:20.780416328 +0000 UTC m=+38.916031005" watchObservedRunningTime="2026-07-16 16:53:20.780702937 +0000 UTC m=+38.916317606" Jul 16 16:53:21.495598 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:21.495554 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:21.495761 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:21.495702 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:21.495797 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:21.495765 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:53:25.495749662 +0000 UTC m=+43.631364312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:53:25.518613 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:25.518581 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:25.519079 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:25.518679 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:25.519079 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:25.518732 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:53:33.518719399 +0000 UTC m=+51.654334044 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:53:32.311116 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.311083 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp"] Jul 16 16:53:32.322712 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.322686 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:53:32.324086 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.324043 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp"] Jul 16 16:53:32.324894 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.324878 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qwvd5\"" Jul 16 16:53:32.325004 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.324896 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 16:53:32.325837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.325815 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 16:53:32.325936 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.325834 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 16:53:32.325936 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.325848 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 16:53:32.462948 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.462911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8fa9bba4-25cd-4b1c-8566-fd4981ddc98d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55df4f87d8-9gdcp\" (UID: \"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:53:32.463137 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.463003 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htkfs\" (UniqueName: \"kubernetes.io/projected/8fa9bba4-25cd-4b1c-8566-fd4981ddc98d-kube-api-access-htkfs\") pod \"managed-serviceaccount-addon-agent-55df4f87d8-9gdcp\" (UID: \"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:53:32.564066 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.563956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8fa9bba4-25cd-4b1c-8566-fd4981ddc98d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55df4f87d8-9gdcp\" (UID: \"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:53:32.564066 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.564043 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htkfs\" (UniqueName: \"kubernetes.io/projected/8fa9bba4-25cd-4b1c-8566-fd4981ddc98d-kube-api-access-htkfs\") pod \"managed-serviceaccount-addon-agent-55df4f87d8-9gdcp\" (UID: \"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:53:32.568209 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.568181 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8fa9bba4-25cd-4b1c-8566-fd4981ddc98d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55df4f87d8-9gdcp\" (UID: \"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:53:32.571798 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.571773 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htkfs\" (UniqueName: \"kubernetes.io/projected/8fa9bba4-25cd-4b1c-8566-fd4981ddc98d-kube-api-access-htkfs\") pod \"managed-serviceaccount-addon-agent-55df4f87d8-9gdcp\" (UID: \"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:53:32.645701 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.645667 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:53:32.773019 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:32.772989 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp"] Jul 16 16:53:32.777202 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:53:32.777177 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fa9bba4_25cd_4b1c_8566_fd4981ddc98d.slice/crio-d4a0b35213493d21ca09f2320a34561a82c0b1052b6434b495424bdd007c53cf WatchSource:0}: Error finding container d4a0b35213493d21ca09f2320a34561a82c0b1052b6434b495424bdd007c53cf: Status 404 returned error can't find the container with id d4a0b35213493d21ca09f2320a34561a82c0b1052b6434b495424bdd007c53cf Jul 16 16:53:33.570914 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:33.570869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:33.571374 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:33.571076 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:33.571374 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:33.571157 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:53:49.571134022 +0000 UTC m=+67.706748671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:53:33.780481 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:33.780448 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" event={"ID":"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d","Type":"ContainerStarted","Data":"d4a0b35213493d21ca09f2320a34561a82c0b1052b6434b495424bdd007c53cf"} Jul 16 16:53:36.789447 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:36.789415 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" event={"ID":"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d","Type":"ContainerStarted","Data":"fe15a76d7339123c0e94672f6d81f1e2c9fcacfc1483eb31ad8b00681011691a"} Jul 16 16:53:36.803796 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:36.803754 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" podStartSLOduration=1.72885608 podStartE2EDuration="4.803740507s" totalImagesPullingTime="3.074884427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:36.803460345 +0000 UTC m=+54.939075031" watchObservedRunningTime="2026-07-16 16:53:36.803740507 +0000 UTC m=+54.939355208" Jul 16 16:53:43.728479 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:43.728452 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gwnpv" Jul 16 16:53:47.068504 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.068469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:53:47.071100 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.071083 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 16:53:47.079063 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:47.079047 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 16:53:47.079112 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:47.079100 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:54:51.07908468 +0000 UTC m=+129.214699328 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : secret "metrics-daemon-secret" not found Jul 16 16:53:47.169065 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.169035 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:47.171272 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.171256 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 16:53:47.182156 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.182138 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/91fc1288-02fd-4414-916c-734288b37cc6-original-pull-secret\") pod \"global-pull-secret-syncer-7bhhh\" (UID: \"91fc1288-02fd-4414-916c-734288b37cc6\") " pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:47.270124 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.270101 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:47.272295 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.272278 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 16:53:47.282713 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.282698 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 16:53:47.293426 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.293401 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtnsb\" (UniqueName: \"kubernetes.io/projected/47f541e4-4e7e-42d8-8532-3e922bd9bd0d-kube-api-access-mtnsb\") pod \"network-check-target-m625q\" (UID: \"47f541e4-4e7e-42d8-8532-3e922bd9bd0d\") " pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:47.385007 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.384987 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6jw2c\"" Jul 16 16:53:47.388743 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.388729 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7bhhh" Jul 16 16:53:47.393483 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.393468 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:47.541772 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.541746 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-m625q"] Jul 16 16:53:47.544473 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:53:47.544450 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f541e4_4e7e_42d8_8532_3e922bd9bd0d.slice/crio-b8db99d849490d0f8e7c42630a75948dc5174965c748bc86288f41f098f016ed WatchSource:0}: Error finding container b8db99d849490d0f8e7c42630a75948dc5174965c748bc86288f41f098f016ed: Status 404 returned error can't find the container with id b8db99d849490d0f8e7c42630a75948dc5174965c748bc86288f41f098f016ed Jul 16 16:53:47.557021 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.556943 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7bhhh"] Jul 16 16:53:47.560085 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:53:47.560061 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91fc1288_02fd_4414_916c_734288b37cc6.slice/crio-f581d28b255fdb723fcae77c40cc541a7a940790b67d124c7a3a7421886401d3 WatchSource:0}: Error finding container f581d28b255fdb723fcae77c40cc541a7a940790b67d124c7a3a7421886401d3: Status 404 returned error can't find the container with id f581d28b255fdb723fcae77c40cc541a7a940790b67d124c7a3a7421886401d3 Jul 16 16:53:47.815035 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.814951 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m625q" event={"ID":"47f541e4-4e7e-42d8-8532-3e922bd9bd0d","Type":"ContainerStarted","Data":"b8db99d849490d0f8e7c42630a75948dc5174965c748bc86288f41f098f016ed"} Jul 16 16:53:47.816071 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:47.816047 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7bhhh" event={"ID":"91fc1288-02fd-4414-916c-734288b37cc6","Type":"ContainerStarted","Data":"f581d28b255fdb723fcae77c40cc541a7a940790b67d124c7a3a7421886401d3"} Jul 16 16:53:49.585735 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:49.585670 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:53:49.586219 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:49.585806 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:49.586219 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:53:49.585880 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:54:21.585858148 +0000 UTC m=+99.721472813 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:53:52.830762 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:52.830721 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7bhhh" event={"ID":"91fc1288-02fd-4414-916c-734288b37cc6","Type":"ContainerStarted","Data":"09e0b8648757a1a40d8a3adbea67f78e9dc78a17df57d9a652afaf44eaad4703"} Jul 16 16:53:52.832056 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:52.832029 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-m625q" event={"ID":"47f541e4-4e7e-42d8-8532-3e922bd9bd0d","Type":"ContainerStarted","Data":"c23f4561501eda87ffd91f486831ac8725cdad552cfa5f57c2e9722b6af270fd"} Jul 16 16:53:52.832174 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:52.832159 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:53:52.845564 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:52.845527 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7bhhh" podStartSLOduration=65.320566349 podStartE2EDuration="1m9.845510471s" totalImagesPullingTime="4.524944122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:52.845372448 +0000 UTC m=+70.980987131" watchObservedRunningTime="2026-07-16 16:53:52.845510471 +0000 UTC m=+70.981125139" Jul 16 16:53:52.858925 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:53:52.858887 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-m625q" podStartSLOduration=65.329967221 podStartE2EDuration="1m9.858874965s" totalImagesPullingTime="4.528907744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:52.858859572 +0000 UTC m=+70.994474250" watchObservedRunningTime="2026-07-16 16:53:52.858874965 +0000 UTC m=+70.994489632" Jul 16 16:54:21.601685 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:54:21.601643 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:54:21.602241 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:54:21.601771 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:54:21.602241 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:54:21.601861 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:55:25.601838105 +0000 UTC m=+163.737452770 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:54:23.836749 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:54:23.836719 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-m625q" Jul 16 16:54:51.099554 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:54:51.099522 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:54:51.100010 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:54:51.099618 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 16:54:51.100010 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:54:51.099672 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:56:53.099656453 +0000 UTC m=+251.235271099 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : secret "metrics-daemon-secret" not found Jul 16 16:55:20.731131 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:55:20.731096 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tqgfl" podUID="d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce" Jul 16 16:55:21.039471 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:55:21.039418 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqgfl" Jul 16 16:55:22.495124 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:55:22.495086 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:55:25.617338 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:55:25.617310 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:55:25.617688 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:55:25.617412 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:55:25.617688 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:55:25.617470 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls podName:d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce nodeName:}" failed. No retries permitted until 2026-07-16 16:57:27.617456346 +0000 UTC m=+285.753070991 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls") pod "dns-default-tqgfl" (UID: "d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce") : secret "dns-default-metrics-tls" not found Jul 16 16:55:34.470567 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:55:34.470478 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:55:36.073572 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:55:36.073545 2560 generic.go:356] "Generic (PLEG): container finished" podID="8fa9bba4-25cd-4b1c-8566-fd4981ddc98d" containerID="fe15a76d7339123c0e94672f6d81f1e2c9fcacfc1483eb31ad8b00681011691a" exitCode=255 Jul 16 16:55:36.073837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:55:36.073587 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" event={"ID":"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d","Type":"ContainerDied","Data":"fe15a76d7339123c0e94672f6d81f1e2c9fcacfc1483eb31ad8b00681011691a"} Jul 16 16:55:36.082733 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:55:36.082718 2560 scope.go:117] "RemoveContainer" containerID="fe15a76d7339123c0e94672f6d81f1e2c9fcacfc1483eb31ad8b00681011691a" Jul 16 16:55:37.078552 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:55:37.078519 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" event={"ID":"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d","Type":"ContainerStarted","Data":"c0f5475461c5152444dba00a19b801e874fd41d44da0144744dbaaca6073b236"} Jul 16 16:56:47.219407 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.219376 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8d998f5b4-2z78q"] Jul 16 16:56:47.221119 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.221102 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.224054 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.224002 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 16:56:47.224054 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.224031 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 16:56:47.226215 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.226189 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lkbf4\"" Jul 16 16:56:47.226888 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.226867 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 16:56:47.229900 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.229882 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 16:56:47.236261 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.236243 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8d998f5b4-2z78q"] Jul 16 16:56:47.308819 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.308797 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6"] Jul 16 16:56:47.310516 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.310502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6" Jul 16 16:56:47.312684 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.312669 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nc5hc\"" Jul 16 16:56:47.316387 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.316370 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm"] Jul 16 16:56:47.318163 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.318146 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-zl55z"] Jul 16 16:56:47.318283 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.318268 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.319939 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.319921 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j"] Jul 16 16:56:47.320050 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.320037 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.320403 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.320386 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2m9tv\"" Jul 16 16:56:47.320553 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.320538 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:56:47.320885 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.320868 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 16:56:47.320943 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.320868 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 16:56:47.320943 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.320900 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 16:56:47.322091 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.322076 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf"] Jul 16 16:56:47.322208 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.322193 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j" Jul 16 16:56:47.322390 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.322360 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 16:56:47.322646 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.322624 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:56:47.322646 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.322615 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 16:56:47.322777 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.322699 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 16:56:47.322847 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.322834 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k5plz\"" Jul 16 16:56:47.323878 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.323861 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6"] Jul 16 16:56:47.323988 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.323917 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.324508 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.324475 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:56:47.324807 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.324789 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 16:56:47.324807 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.324804 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-29hqz\"" Jul 16 16:56:47.327264 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.327240 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 16:56:47.327429 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.327408 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-r6wvm\"" Jul 16 16:56:47.327762 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.327744 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 16:56:47.328668 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.328453 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:56:47.328668 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.328622 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 16:56:47.329138 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.329114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.329224 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.329181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-installation-pull-secrets\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.329284 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.329222 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-bound-sa-token\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.330262 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.329259 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-certificates\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.330351 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.330292 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-image-registry-private-configuration\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.330351 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.330331 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-ca-trust-extracted\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.330574 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.330361 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd76d\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-kube-api-access-gd76d\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.330574 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.330459 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-trusted-ca\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.333277 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.333256 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm"] Jul 16 16:56:47.334883 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.334424 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf"] Jul 16 16:56:47.334883 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.334670 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 16:56:47.335355 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.335334 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-zl55z"] Jul 16 16:56:47.351209 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.351191 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j"] Jul 16 16:56:47.431123 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431100 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f136b0f-6094-4d13-aecd-654c18e48c1a-config\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.431216 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431126 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89876d54-0694-44d2-9d7e-4370eb79f0dc-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.431216 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431149 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-trusted-ca\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431216 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-installation-pull-secrets\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431216 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431197 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-bound-sa-token\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431363 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-ca-trust-extracted\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431363 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431250 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd76d\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-kube-api-access-gd76d\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431480 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431459 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-image-registry-private-configuration\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431616 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431517 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkg2l\" (UniqueName: \"kubernetes.io/projected/3f136b0f-6094-4d13-aecd-654c18e48c1a-kube-api-access-lkg2l\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.431717 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxlhh\" (UniqueName: \"kubernetes.io/projected/6ecb78ea-94cb-405c-8b35-4426b0ff1be2-kube-api-access-qxlhh\") pod \"network-check-source-869dcfcdcd-dc6m6\" (UID: \"6ecb78ea-94cb-405c-8b35-4426b0ff1be2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6" Jul 16 16:56:47.431717 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431655 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-ca-trust-extracted\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431717 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431663 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9zsq\" (UniqueName: \"kubernetes.io/projected/fb803c30-7fc8-4380-a7c9-4810eb56aef6-kube-api-access-q9zsq\") pod \"volume-data-source-validator-78495597f6-d2d9j\" (UID: \"fb803c30-7fc8-4380-a7c9-4810eb56aef6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j" Jul 16 16:56:47.431717 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zsmp\" (UniqueName: \"kubernetes.io/projected/89876d54-0694-44d2-9d7e-4370eb79f0dc-kube-api-access-9zsmp\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431735 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89876d54-0694-44d2-9d7e-4370eb79f0dc-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431761 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwm4\" (UniqueName: \"kubernetes.io/projected/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-kube-api-access-lgwm4\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431788 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-certificates\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431832 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-config\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431853 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-serving-cert\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:47.431866 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431877 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f136b0f-6094-4d13-aecd-654c18e48c1a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.431895 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:47.431881 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d998f5b4-2z78q: secret "image-registry-tls" not found Jul 16 16:56:47.432340 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.431975 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-trusted-ca\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.432340 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:47.431984 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls podName:b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:47.931951163 +0000 UTC m=+246.067565819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls") pod "image-registry-8d998f5b4-2z78q" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4") : secret "image-registry-tls" not found Jul 16 16:56:47.432340 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.432211 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-trusted-ca\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.432340 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.432222 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-certificates\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.433448 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.433428 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-installation-pull-secrets\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.433880 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.433863 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-image-registry-private-configuration\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.439543 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.439520 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd76d\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-kube-api-access-gd76d\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.440517 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.440502 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-bound-sa-token\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.532705 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532654 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkg2l\" (UniqueName: \"kubernetes.io/projected/3f136b0f-6094-4d13-aecd-654c18e48c1a-kube-api-access-lkg2l\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.532705 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532682 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxlhh\" (UniqueName: \"kubernetes.io/projected/6ecb78ea-94cb-405c-8b35-4426b0ff1be2-kube-api-access-qxlhh\") pod \"network-check-source-869dcfcdcd-dc6m6\" (UID: \"6ecb78ea-94cb-405c-8b35-4426b0ff1be2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6" Jul 16 16:56:47.532705 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9zsq\" (UniqueName: \"kubernetes.io/projected/fb803c30-7fc8-4380-a7c9-4810eb56aef6-kube-api-access-q9zsq\") pod \"volume-data-source-validator-78495597f6-d2d9j\" (UID: \"fb803c30-7fc8-4380-a7c9-4810eb56aef6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j" Jul 16 16:56:47.532892 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532722 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zsmp\" (UniqueName: \"kubernetes.io/projected/89876d54-0694-44d2-9d7e-4370eb79f0dc-kube-api-access-9zsmp\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.532892 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532745 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89876d54-0694-44d2-9d7e-4370eb79f0dc-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.532892 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwm4\" (UniqueName: \"kubernetes.io/projected/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-kube-api-access-lgwm4\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.532892 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-config\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.532892 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532875 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-serving-cert\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.533161 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532903 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f136b0f-6094-4d13-aecd-654c18e48c1a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.533161 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532941 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-trusted-ca\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.533161 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.532992 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f136b0f-6094-4d13-aecd-654c18e48c1a-config\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.533161 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.533016 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89876d54-0694-44d2-9d7e-4370eb79f0dc-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.533666 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.533640 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-config\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.533746 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.533676 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89876d54-0694-44d2-9d7e-4370eb79f0dc-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.533815 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.533794 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f136b0f-6094-4d13-aecd-654c18e48c1a-config\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.533872 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.533802 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-trusted-ca\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.534845 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.534824 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89876d54-0694-44d2-9d7e-4370eb79f0dc-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.535043 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.535027 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f136b0f-6094-4d13-aecd-654c18e48c1a-serving-cert\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.535124 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.535109 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-serving-cert\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.543562 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.543532 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zsmp\" (UniqueName: \"kubernetes.io/projected/89876d54-0694-44d2-9d7e-4370eb79f0dc-kube-api-access-9zsmp\") pod \"kube-storage-version-migrator-operator-799cb7f958-bbvrf\" (UID: \"89876d54-0694-44d2-9d7e-4370eb79f0dc\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.544014 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.543991 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9zsq\" (UniqueName: \"kubernetes.io/projected/fb803c30-7fc8-4380-a7c9-4810eb56aef6-kube-api-access-q9zsq\") pod \"volume-data-source-validator-78495597f6-d2d9j\" (UID: \"fb803c30-7fc8-4380-a7c9-4810eb56aef6\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j" Jul 16 16:56:47.544095 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.544074 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwm4\" (UniqueName: \"kubernetes.io/projected/eb1b82b0-9f6a-46f8-9e3a-506282b2be6e-kube-api-access-lgwm4\") pod \"console-operator-7866497494-zl55z\" (UID: \"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e\") " pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.544282 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.544262 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxlhh\" (UniqueName: \"kubernetes.io/projected/6ecb78ea-94cb-405c-8b35-4426b0ff1be2-kube-api-access-qxlhh\") pod \"network-check-source-869dcfcdcd-dc6m6\" (UID: \"6ecb78ea-94cb-405c-8b35-4426b0ff1be2\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6" Jul 16 16:56:47.544453 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.544434 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkg2l\" (UniqueName: \"kubernetes.io/projected/3f136b0f-6094-4d13-aecd-654c18e48c1a-kube-api-access-lkg2l\") pod \"service-ca-operator-7695fc6c8c-6vnnm\" (UID: \"3f136b0f-6094-4d13-aecd-654c18e48c1a\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.618373 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.618355 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6" Jul 16 16:56:47.630878 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.630856 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" Jul 16 16:56:47.638196 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.638175 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:47.645216 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.645197 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j" Jul 16 16:56:47.649216 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.649189 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" Jul 16 16:56:47.779564 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.779496 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6"] Jul 16 16:56:47.782887 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:56:47.782812 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ecb78ea_94cb_405c_8b35_4426b0ff1be2.slice/crio-13435f2bc6b07b8a342aeaa03ad7fb3122efaa3e68732e3777bcbe130e073770 WatchSource:0}: Error finding container 13435f2bc6b07b8a342aeaa03ad7fb3122efaa3e68732e3777bcbe130e073770: Status 404 returned error can't find the container with id 13435f2bc6b07b8a342aeaa03ad7fb3122efaa3e68732e3777bcbe130e073770 Jul 16 16:56:47.800345 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.800244 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm"] Jul 16 16:56:47.819088 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:56:47.819058 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f136b0f_6094_4d13_aecd_654c18e48c1a.slice/crio-dff1bfefee596f84ba139d353c81cdf9b0557da80d165929cd5be8e51a89aa9a WatchSource:0}: Error finding container dff1bfefee596f84ba139d353c81cdf9b0557da80d165929cd5be8e51a89aa9a: Status 404 returned error can't find the container with id dff1bfefee596f84ba139d353c81cdf9b0557da80d165929cd5be8e51a89aa9a Jul 16 16:56:47.843483 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.843463 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j"] Jul 16 16:56:47.845841 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:56:47.845819 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb803c30_7fc8_4380_a7c9_4810eb56aef6.slice/crio-60d6efaf59e1352dc467bdde3bc7e66738d4bbfaba43ce899a5ae24b6c797b2a WatchSource:0}: Error finding container 60d6efaf59e1352dc467bdde3bc7e66738d4bbfaba43ce899a5ae24b6c797b2a: Status 404 returned error can't find the container with id 60d6efaf59e1352dc467bdde3bc7e66738d4bbfaba43ce899a5ae24b6c797b2a Jul 16 16:56:47.936375 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:47.936344 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:47.936498 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:47.936482 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:56:47.936542 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:47.936500 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d998f5b4-2z78q: secret "image-registry-tls" not found Jul 16 16:56:47.936574 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:47.936545 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls podName:b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:48.936531033 +0000 UTC m=+247.072145678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls") pod "image-registry-8d998f5b4-2z78q" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4") : secret "image-registry-tls" not found Jul 16 16:56:48.023801 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.023773 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-zl55z"] Jul 16 16:56:48.025318 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.025268 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf"] Jul 16 16:56:48.026587 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:56:48.026562 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1b82b0_9f6a_46f8_9e3a_506282b2be6e.slice/crio-c08db5a63a5a0e8ddd2b221ae37eb25c59b60d6140514adedc83270034f441d7 WatchSource:0}: Error finding container c08db5a63a5a0e8ddd2b221ae37eb25c59b60d6140514adedc83270034f441d7: Status 404 returned error can't find the container with id c08db5a63a5a0e8ddd2b221ae37eb25c59b60d6140514adedc83270034f441d7 Jul 16 16:56:48.028709 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:56:48.028686 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89876d54_0694_44d2_9d7e_4370eb79f0dc.slice/crio-3dbb2fe4e67b9dd2f7fe7f516432a07b8178dc88aa48df14af1758d51f8a0bfe WatchSource:0}: Error finding container 3dbb2fe4e67b9dd2f7fe7f516432a07b8178dc88aa48df14af1758d51f8a0bfe: Status 404 returned error can't find the container with id 3dbb2fe4e67b9dd2f7fe7f516432a07b8178dc88aa48df14af1758d51f8a0bfe Jul 16 16:56:48.275160 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.275125 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" event={"ID":"89876d54-0694-44d2-9d7e-4370eb79f0dc","Type":"ContainerStarted","Data":"3dbb2fe4e67b9dd2f7fe7f516432a07b8178dc88aa48df14af1758d51f8a0bfe"} Jul 16 16:56:48.276795 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.276714 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6" event={"ID":"6ecb78ea-94cb-405c-8b35-4426b0ff1be2","Type":"ContainerStarted","Data":"8f092448e0a1d4648cf8d435e3ea4f375f921d9ab9508603f66641dcc52096c3"} Jul 16 16:56:48.276795 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.276765 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6" event={"ID":"6ecb78ea-94cb-405c-8b35-4426b0ff1be2","Type":"ContainerStarted","Data":"13435f2bc6b07b8a342aeaa03ad7fb3122efaa3e68732e3777bcbe130e073770"} Jul 16 16:56:48.278105 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.278082 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j" event={"ID":"fb803c30-7fc8-4380-a7c9-4810eb56aef6","Type":"ContainerStarted","Data":"60d6efaf59e1352dc467bdde3bc7e66738d4bbfaba43ce899a5ae24b6c797b2a"} Jul 16 16:56:48.279483 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.279448 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zl55z" event={"ID":"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e","Type":"ContainerStarted","Data":"c08db5a63a5a0e8ddd2b221ae37eb25c59b60d6140514adedc83270034f441d7"} Jul 16 16:56:48.280734 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.280699 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" event={"ID":"3f136b0f-6094-4d13-aecd-654c18e48c1a","Type":"ContainerStarted","Data":"dff1bfefee596f84ba139d353c81cdf9b0557da80d165929cd5be8e51a89aa9a"} Jul 16 16:56:48.291803 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.291757 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-dc6m6" podStartSLOduration=1.291738213 podStartE2EDuration="1.291738213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:56:48.291047805 +0000 UTC m=+246.426662470" watchObservedRunningTime="2026-07-16 16:56:48.291738213 +0000 UTC m=+246.427352880" Jul 16 16:56:48.943890 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:48.943864 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:48.944038 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:48.944023 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:56:48.944093 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:48.944041 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d998f5b4-2z78q: secret "image-registry-tls" not found Jul 16 16:56:48.944130 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:48.944095 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls podName:b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:50.94407612 +0000 UTC m=+249.079690767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls") pod "image-registry-8d998f5b4-2z78q" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4") : secret "image-registry-tls" not found Jul 16 16:56:49.285719 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:49.285659 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j" event={"ID":"fb803c30-7fc8-4380-a7c9-4810eb56aef6","Type":"ContainerStarted","Data":"9ce1962d39d7ebcdfa9b0ebf7c64dbfdec0dc919f65b55e5e8d8a6e8657ec8e7"} Jul 16 16:56:49.301822 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:49.301179 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-d2d9j" podStartSLOduration=1.29626011 podStartE2EDuration="2.30115936s" totalImagesPullingTime="1.00489925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:56:49.300682281 +0000 UTC m=+247.436296948" watchObservedRunningTime="2026-07-16 16:56:49.30115936 +0000 UTC m=+247.436774029" Jul 16 16:56:50.960487 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:50.960448 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:50.960901 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:50.960597 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:56:50.960901 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:50.960612 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d998f5b4-2z78q: secret "image-registry-tls" not found Jul 16 16:56:50.960901 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:50.960676 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls podName:b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:54.960656717 +0000 UTC m=+253.096271366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls") pod "image-registry-8d998f5b4-2z78q" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4") : secret "image-registry-tls" not found Jul 16 16:56:51.077745 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.077718 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-67sxj"] Jul 16 16:56:51.079947 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.079927 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.087719 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.087698 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 16:56:51.087814 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.087707 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 16:56:51.088081 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.088044 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 16:56:51.093271 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.093253 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 16:56:51.101287 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.101269 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hrrqf\"" Jul 16 16:56:51.123250 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.123227 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-67sxj"] Jul 16 16:56:51.161591 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.161571 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf0a3ccc-c694-439a-867b-99af8c4aa444-data-volume\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.161701 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.161627 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf0a3ccc-c694-439a-867b-99af8c4aa444-crio-socket\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.161701 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.161650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.161805 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.161708 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksb9h\" (UniqueName: \"kubernetes.io/projected/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-api-access-ksb9h\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.161857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.161810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.262677 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.262603 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.262817 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.262757 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf0a3ccc-c694-439a-867b-99af8c4aa444-data-volume\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.262881 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.262820 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf0a3ccc-c694-439a-867b-99af8c4aa444-crio-socket\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.262881 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.262838 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.262881 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.262858 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksb9h\" (UniqueName: \"kubernetes.io/projected/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-api-access-ksb9h\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.263067 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:51.262761 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:56:51.263067 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.262935 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cf0a3ccc-c694-439a-867b-99af8c4aa444-crio-socket\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.263067 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:51.262987 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:56:51.263067 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:51.262988 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:51.762951405 +0000 UTC m=+249.898566065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : secret "insights-runtime-extractor-tls" not found Jul 16 16:56:51.263067 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:51.263042 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:51.763033308 +0000 UTC m=+249.898647957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : configmap "kube-rbac-proxy" not found Jul 16 16:56:51.263291 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.263085 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf0a3ccc-c694-439a-867b-99af8c4aa444-data-volume\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.274616 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.274590 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksb9h\" (UniqueName: \"kubernetes.io/projected/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-api-access-ksb9h\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.299208 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.299179 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/0.log" Jul 16 16:56:51.299321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.299221 2560 generic.go:356] "Generic (PLEG): container finished" podID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" containerID="7bff07847cb32b2dd12b4880d737e32f5166d8d23f2ccf89404b9c5f548b98b9" exitCode=255 Jul 16 16:56:51.299321 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.299299 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zl55z" event={"ID":"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e","Type":"ContainerDied","Data":"7bff07847cb32b2dd12b4880d737e32f5166d8d23f2ccf89404b9c5f548b98b9"} Jul 16 16:56:51.299561 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.299545 2560 scope.go:117] "RemoveContainer" containerID="7bff07847cb32b2dd12b4880d737e32f5166d8d23f2ccf89404b9c5f548b98b9" Jul 16 16:56:51.301001 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.300920 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" event={"ID":"3f136b0f-6094-4d13-aecd-654c18e48c1a","Type":"ContainerStarted","Data":"7d44ab607e11da2292ca634ec11ea6abf638030075533795f62cc04a9b27f7b4"} Jul 16 16:56:51.767015 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.766975 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.767190 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:51.767047 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:56:51.767190 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:51.767050 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:51.767190 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:51.767118 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:52.767098299 +0000 UTC m=+250.902712946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : configmap "kube-rbac-proxy" not found Jul 16 16:56:51.767190 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:51.767150 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:56:51.767391 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:51.767198 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:52.767184188 +0000 UTC m=+250.902798836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : secret "insights-runtime-extractor-tls" not found Jul 16 16:56:52.305703 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.305672 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" event={"ID":"89876d54-0694-44d2-9d7e-4370eb79f0dc","Type":"ContainerStarted","Data":"bc6fbf02c77efc8f088bb5ddc28d84f805e2bc76d6e1a1afed1cc6cfb74255f9"} Jul 16 16:56:52.307151 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.307126 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/1.log" Jul 16 16:56:52.307523 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.307510 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/0.log" Jul 16 16:56:52.307578 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.307541 2560 generic.go:356] "Generic (PLEG): container finished" podID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" containerID="2b1fd789a5dc6f124d0f7627147ce9fdbc28197887d03274a93e2acf9764532d" exitCode=255 Jul 16 16:56:52.307613 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.307598 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zl55z" event={"ID":"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e","Type":"ContainerDied","Data":"2b1fd789a5dc6f124d0f7627147ce9fdbc28197887d03274a93e2acf9764532d"} Jul 16 16:56:52.307653 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.307641 2560 scope.go:117] "RemoveContainer" containerID="7bff07847cb32b2dd12b4880d737e32f5166d8d23f2ccf89404b9c5f548b98b9" Jul 16 16:56:52.307827 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.307812 2560 scope.go:117] "RemoveContainer" containerID="2b1fd789a5dc6f124d0f7627147ce9fdbc28197887d03274a93e2acf9764532d" Jul 16 16:56:52.307993 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:52.307955 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-zl55z_openshift-console-operator(eb1b82b0-9f6a-46f8-9e3a-506282b2be6e)\"" pod="openshift-console-operator/console-operator-7866497494-zl55z" podUID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" Jul 16 16:56:52.320347 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.320308 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" podStartSLOduration=2.684283581 podStartE2EDuration="5.320294725s" totalImagesPullingTime="2.636011144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:56:51.331781523 +0000 UTC m=+249.467396210" watchObservedRunningTime="2026-07-16 16:56:52.320294725 +0000 UTC m=+250.455909391" Jul 16 16:56:52.320927 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.320892 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" podStartSLOduration=1.408895061 podStartE2EDuration="5.320883083s" totalImagesPullingTime="3.911988022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:56:52.320542907 +0000 UTC m=+250.456157576" watchObservedRunningTime="2026-07-16 16:56:52.320883083 +0000 UTC m=+250.456497749" Jul 16 16:56:52.776093 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.776053 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:52.776269 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:52.776112 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:52.776269 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:52.776173 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:56:52.776269 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:52.776237 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:54.776222254 +0000 UTC m=+252.911836900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : configmap "kube-rbac-proxy" not found Jul 16 16:56:52.776430 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:52.776290 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:56:52.776430 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:52.776363 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:54.776342266 +0000 UTC m=+252.911956911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : secret "insights-runtime-extractor-tls" not found Jul 16 16:56:53.130769 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.130727 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6"] Jul 16 16:56:53.133846 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.133828 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" Jul 16 16:56:53.136076 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.136058 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 16:56:53.136188 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.136173 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 16:56:53.137080 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.137066 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r7qpg\"" Jul 16 16:56:53.145535 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.145513 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6"] Jul 16 16:56:53.180066 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.180044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:56:53.180151 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.180088 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjzcg\" (UniqueName: \"kubernetes.io/projected/737bf6d9-a4c3-446f-905b-8313b49b0a07-kube-api-access-qjzcg\") pod \"migrator-7f59b54f6c-sl7c6\" (UID: \"737bf6d9-a4c3-446f-905b-8313b49b0a07\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" Jul 16 16:56:53.180193 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:53.180136 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 16:56:53.180226 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:53.180203 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs podName:b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e nodeName:}" failed. No retries permitted until 2026-07-16 16:58:55.180185635 +0000 UTC m=+373.315800281 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs") pod "network-metrics-daemon-mxtg5" (UID: "b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e") : secret "metrics-daemon-secret" not found Jul 16 16:56:53.239018 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.238998 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pntcv_7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed/dns-node-resolver/0.log" Jul 16 16:56:53.281431 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.281413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjzcg\" (UniqueName: \"kubernetes.io/projected/737bf6d9-a4c3-446f-905b-8313b49b0a07-kube-api-access-qjzcg\") pod \"migrator-7f59b54f6c-sl7c6\" (UID: \"737bf6d9-a4c3-446f-905b-8313b49b0a07\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" Jul 16 16:56:53.290385 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.290368 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjzcg\" (UniqueName: \"kubernetes.io/projected/737bf6d9-a4c3-446f-905b-8313b49b0a07-kube-api-access-qjzcg\") pod \"migrator-7f59b54f6c-sl7c6\" (UID: \"737bf6d9-a4c3-446f-905b-8313b49b0a07\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" Jul 16 16:56:53.312179 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.312159 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/1.log" Jul 16 16:56:53.312491 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.312475 2560 scope.go:117] "RemoveContainer" containerID="2b1fd789a5dc6f124d0f7627147ce9fdbc28197887d03274a93e2acf9764532d" Jul 16 16:56:53.312656 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:53.312638 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-zl55z_openshift-console-operator(eb1b82b0-9f6a-46f8-9e3a-506282b2be6e)\"" pod="openshift-console-operator/console-operator-7866497494-zl55z" podUID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" Jul 16 16:56:53.442022 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.441972 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" Jul 16 16:56:53.562843 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:53.562813 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6"] Jul 16 16:56:53.565442 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:56:53.565410 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737bf6d9_a4c3_446f_905b_8313b49b0a07.slice/crio-930927ba8967e3253510766c07301f40d02cbda246b6cbb97434cff9219fa3f6 WatchSource:0}: Error finding container 930927ba8967e3253510766c07301f40d02cbda246b6cbb97434cff9219fa3f6: Status 404 returned error can't find the container with id 930927ba8967e3253510766c07301f40d02cbda246b6cbb97434cff9219fa3f6 Jul 16 16:56:54.237284 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:54.237260 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vws6z_6f0efdf0-3149-4aa4-b377-9a8a5c804294/node-ca/0.log" Jul 16 16:56:54.317317 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:54.317282 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" event={"ID":"737bf6d9-a4c3-446f-905b-8313b49b0a07","Type":"ContainerStarted","Data":"930927ba8967e3253510766c07301f40d02cbda246b6cbb97434cff9219fa3f6"} Jul 16 16:56:54.635749 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:54.635718 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9c82j_6b6a1bb0-b2e2-4291-a899-abe969c0aa7c/serve-healthcheck-canary/0.log" Jul 16 16:56:54.792351 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:54.792321 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:54.792455 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:54.792380 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:54.792455 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:54.792425 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:56:54.792559 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:54.792476 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:58.792460328 +0000 UTC m=+256.928074976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : configmap "kube-rbac-proxy" not found Jul 16 16:56:54.792559 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:54.792513 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:56:54.792643 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:54.792569 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:56:58.792553775 +0000 UTC m=+256.928168438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : secret "insights-runtime-extractor-tls" not found Jul 16 16:56:54.993237 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:54.993183 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:56:54.993364 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:54.993344 2560 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 16:56:54.993426 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:54.993368 2560 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d998f5b4-2z78q: secret "image-registry-tls" not found Jul 16 16:56:54.993426 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:54.993424 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls podName:b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:02.993404684 +0000 UTC m=+261.129019352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls") pod "image-registry-8d998f5b4-2z78q" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4") : secret "image-registry-tls" not found Jul 16 16:56:55.321900 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:55.321840 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" event={"ID":"737bf6d9-a4c3-446f-905b-8313b49b0a07","Type":"ContainerStarted","Data":"9531c32ba027f3c91d83fee06f6c193e03f3fa26bf9df872e1617f62228617bb"} Jul 16 16:56:55.321900 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:55.321886 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" event={"ID":"737bf6d9-a4c3-446f-905b-8313b49b0a07","Type":"ContainerStarted","Data":"389bd388448988f82cfbf7657ec8035f841d42e35e9362f254ac73f91362dc61"} Jul 16 16:56:57.639032 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:57.639007 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:57.639381 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:57.639082 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:56:57.639416 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:57.639383 2560 scope.go:117] "RemoveContainer" containerID="2b1fd789a5dc6f124d0f7627147ce9fdbc28197887d03274a93e2acf9764532d" Jul 16 16:56:57.639530 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:57.639512 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-zl55z_openshift-console-operator(eb1b82b0-9f6a-46f8-9e3a-506282b2be6e)\"" pod="openshift-console-operator/console-operator-7866497494-zl55z" podUID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" Jul 16 16:56:58.825620 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:58.825583 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:58.826015 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:56:58.825636 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:56:58.826015 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:58.825698 2560 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:56:58.826015 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:58.825719 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:56:58.826015 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:58.825756 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:06.825741553 +0000 UTC m=+264.961356203 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : configmap "kube-rbac-proxy" not found Jul 16 16:56:58.826015 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:56:58.825774 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:06.825768241 +0000 UTC m=+264.961382886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : secret "insights-runtime-extractor-tls" not found Jul 16 16:57:03.060199 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.060167 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:57:03.062432 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.062415 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"image-registry-8d998f5b4-2z78q\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:57:03.130588 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.130552 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:57:03.265214 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.265145 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-sl7c6" podStartSLOduration=9.102347944 podStartE2EDuration="10.265123841s" totalImagesPullingTime="1.162775897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:56:55.340664896 +0000 UTC m=+253.476279677" watchObservedRunningTime="2026-07-16 16:57:03.265123841 +0000 UTC m=+261.400738509" Jul 16 16:57:03.265428 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.265409 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8d998f5b4-2z78q"] Jul 16 16:57:03.270841 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:57:03.270809 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb468c3ff_8c78_4358_a2ef_ed5c5d0be5f4.slice/crio-8e076a66215e23a8d9562bec03776e20925b28700bc84f77d1c82a201ba107e9 WatchSource:0}: Error finding container 8e076a66215e23a8d9562bec03776e20925b28700bc84f77d1c82a201ba107e9: Status 404 returned error can't find the container with id 8e076a66215e23a8d9562bec03776e20925b28700bc84f77d1c82a201ba107e9 Jul 16 16:57:03.346696 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.346667 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" event={"ID":"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4","Type":"ContainerStarted","Data":"5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453"} Jul 16 16:57:03.346794 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.346718 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" event={"ID":"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4","Type":"ContainerStarted","Data":"8e076a66215e23a8d9562bec03776e20925b28700bc84f77d1c82a201ba107e9"} Jul 16 16:57:03.346794 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.346737 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:57:03.364672 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:03.364635 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" podStartSLOduration=16.364623149 podStartE2EDuration="16.364623149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:03.363571436 +0000 UTC m=+261.499186102" watchObservedRunningTime="2026-07-16 16:57:03.364623149 +0000 UTC m=+261.500237816" Jul 16 16:57:06.887746 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:06.887674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:57:06.887746 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:06.887723 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:57:06.888234 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:06.887840 2560 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:57:06.888234 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:06.887888 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls podName:cf0a3ccc-c694-439a-867b-99af8c4aa444 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:22.88787594 +0000 UTC m=+281.023490586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls") pod "insights-runtime-extractor-67sxj" (UID: "cf0a3ccc-c694-439a-867b-99af8c4aa444") : secret "insights-runtime-extractor-tls" not found Jul 16 16:57:06.888349 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:06.888319 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cf0a3ccc-c694-439a-867b-99af8c4aa444-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:57:12.471381 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:12.471354 2560 scope.go:117] "RemoveContainer" containerID="2b1fd789a5dc6f124d0f7627147ce9fdbc28197887d03274a93e2acf9764532d" Jul 16 16:57:13.200184 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.200148 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8d998f5b4-2z78q"] Jul 16 16:57:13.229222 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.229197 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bdd5b6d6-f9vzd"] Jul 16 16:57:13.232429 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.232408 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.245761 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.245740 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bdd5b6d6-f9vzd"] Jul 16 16:57:13.333934 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.333908 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-ca-trust-extracted\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.333934 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.333935 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7tnl\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-kube-api-access-v7tnl\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.334098 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.333956 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-trusted-ca\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.334098 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.334068 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-installation-pull-secrets\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.334180 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.334115 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-bound-sa-token\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.334180 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.334146 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-image-registry-private-configuration\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.334243 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.334181 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-registry-certificates\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.334243 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.334219 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-registry-tls\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.379040 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.379021 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 16:57:13.379401 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.379384 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/1.log" Jul 16 16:57:13.379489 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.379427 2560 generic.go:356] "Generic (PLEG): container finished" podID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" containerID="449656285ad09de772c26c4be62754b97bea40c1509bdbe59b55c05e9adf7cbf" exitCode=255 Jul 16 16:57:13.379489 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.379465 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zl55z" event={"ID":"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e","Type":"ContainerDied","Data":"449656285ad09de772c26c4be62754b97bea40c1509bdbe59b55c05e9adf7cbf"} Jul 16 16:57:13.379597 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.379514 2560 scope.go:117] "RemoveContainer" containerID="2b1fd789a5dc6f124d0f7627147ce9fdbc28197887d03274a93e2acf9764532d" Jul 16 16:57:13.379835 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.379811 2560 scope.go:117] "RemoveContainer" containerID="449656285ad09de772c26c4be62754b97bea40c1509bdbe59b55c05e9adf7cbf" Jul 16 16:57:13.379986 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:13.379952 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-zl55z_openshift-console-operator(eb1b82b0-9f6a-46f8-9e3a-506282b2be6e)\"" pod="openshift-console-operator/console-operator-7866497494-zl55z" podUID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" Jul 16 16:57:13.434556 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.434536 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-installation-pull-secrets\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.434656 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.434585 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-bound-sa-token\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.434656 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.434608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-image-registry-private-configuration\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.434656 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.434626 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-registry-certificates\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.434656 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.434647 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-registry-tls\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.434854 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.434672 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-ca-trust-extracted\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.434854 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.434688 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7tnl\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-kube-api-access-v7tnl\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.434854 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.434705 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-trusted-ca\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.435300 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.435276 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-ca-trust-extracted\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.435556 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.435535 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-registry-certificates\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.435738 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.435720 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-trusted-ca\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.436929 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.436905 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-installation-pull-secrets\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.437287 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.437270 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-image-registry-private-configuration\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.437471 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.437451 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-registry-tls\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.443407 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.443384 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-bound-sa-token\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.443933 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.443917 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7tnl\" (UniqueName: \"kubernetes.io/projected/d7f0faec-c7c1-4013-8495-72d8eb44dcb2-kube-api-access-v7tnl\") pod \"image-registry-5bdd5b6d6-f9vzd\" (UID: \"d7f0faec-c7c1-4013-8495-72d8eb44dcb2\") " pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.540545 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.540493 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:13.665284 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:13.665191 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bdd5b6d6-f9vzd"] Jul 16 16:57:13.667710 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:57:13.667674 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7f0faec_c7c1_4013_8495_72d8eb44dcb2.slice/crio-689c15588ca7996df5ff8683cf86875494929bee45da6b79024f832ea18f7857 WatchSource:0}: Error finding container 689c15588ca7996df5ff8683cf86875494929bee45da6b79024f832ea18f7857: Status 404 returned error can't find the container with id 689c15588ca7996df5ff8683cf86875494929bee45da6b79024f832ea18f7857 Jul 16 16:57:14.384188 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:14.384148 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" event={"ID":"d7f0faec-c7c1-4013-8495-72d8eb44dcb2","Type":"ContainerStarted","Data":"edf0cda16f5e1ca81fa721e2e624b981198a1cc4a1366ba8ca9d4b64853b5dc8"} Jul 16 16:57:14.384382 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:14.384208 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:14.384382 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:14.384227 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" event={"ID":"d7f0faec-c7c1-4013-8495-72d8eb44dcb2","Type":"ContainerStarted","Data":"689c15588ca7996df5ff8683cf86875494929bee45da6b79024f832ea18f7857"} Jul 16 16:57:14.385529 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:14.385508 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 16:57:14.403399 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:14.403351 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" podStartSLOduration=1.403337077 podStartE2EDuration="1.403337077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:14.402407208 +0000 UTC m=+272.538021874" watchObservedRunningTime="2026-07-16 16:57:14.403337077 +0000 UTC m=+272.538951744" Jul 16 16:57:17.638777 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:17.638743 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:57:17.639306 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:17.638814 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:57:17.639306 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:17.639173 2560 scope.go:117] "RemoveContainer" containerID="449656285ad09de772c26c4be62754b97bea40c1509bdbe59b55c05e9adf7cbf" Jul 16 16:57:17.639422 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:17.639341 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-zl55z_openshift-console-operator(eb1b82b0-9f6a-46f8-9e3a-506282b2be6e)\"" pod="openshift-console-operator/console-operator-7866497494-zl55z" podUID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" Jul 16 16:57:22.904980 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:22.904938 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:57:22.907305 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:22.907272 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cf0a3ccc-c694-439a-867b-99af8c4aa444-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-67sxj\" (UID: \"cf0a3ccc-c694-439a-867b-99af8c4aa444\") " pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:57:23.190361 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:23.190287 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-67sxj" Jul 16 16:57:23.205887 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:23.205857 2560 patch_prober.go:28] interesting pod/image-registry-8d998f5b4-2z78q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 16:57:23.206017 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:23.205913 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" podUID="b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 16:57:23.329639 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:23.329611 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-67sxj"] Jul 16 16:57:23.332665 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:57:23.332643 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf0a3ccc_c694_439a_867b_99af8c4aa444.slice/crio-d8aa2b653a1bb161d77dd6ebf35b2d315100ca54c7fa6a5dcc979314805a5e5f WatchSource:0}: Error finding container d8aa2b653a1bb161d77dd6ebf35b2d315100ca54c7fa6a5dcc979314805a5e5f: Status 404 returned error can't find the container with id d8aa2b653a1bb161d77dd6ebf35b2d315100ca54c7fa6a5dcc979314805a5e5f Jul 16 16:57:23.414856 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:23.414834 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67sxj" event={"ID":"cf0a3ccc-c694-439a-867b-99af8c4aa444","Type":"ContainerStarted","Data":"d8aa2b653a1bb161d77dd6ebf35b2d315100ca54c7fa6a5dcc979314805a5e5f"} Jul 16 16:57:24.040449 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:24.040419 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-tqgfl" podUID="d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce" Jul 16 16:57:24.420197 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:24.420062 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqgfl" Jul 16 16:57:27.642688 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:27.642657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:57:27.645134 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:27.645105 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce-metrics-tls\") pod \"dns-default-tqgfl\" (UID: \"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce\") " pod="openshift-dns/dns-default-tqgfl" Jul 16 16:57:27.723242 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:27.723211 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hmppn\"" Jul 16 16:57:27.731899 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:27.731881 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tqgfl" Jul 16 16:57:28.517699 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:28.517678 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tqgfl"] Jul 16 16:57:28.521743 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:57:28.521719 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1be16d2_e82e_4b98_b3c2_6a206e9cd2ce.slice/crio-4716add86424d2f61c01480a388bab7011d694ff8cacaa8d709fb9d511ff8903 WatchSource:0}: Error finding container 4716add86424d2f61c01480a388bab7011d694ff8cacaa8d709fb9d511ff8903: Status 404 returned error can't find the container with id 4716add86424d2f61c01480a388bab7011d694ff8cacaa8d709fb9d511ff8903 Jul 16 16:57:29.439133 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:29.439096 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67sxj" event={"ID":"cf0a3ccc-c694-439a-867b-99af8c4aa444","Type":"ContainerStarted","Data":"0d507aa3d22387776e62ba666a347058ac97e218b12960169fbbdf8d6127bd51"} Jul 16 16:57:29.440249 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:29.440217 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqgfl" event={"ID":"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce","Type":"ContainerStarted","Data":"4716add86424d2f61c01480a388bab7011d694ff8cacaa8d709fb9d511ff8903"} Jul 16 16:57:30.412205 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.412173 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gmps7"] Jul 16 16:57:30.415488 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.415472 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.417538 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.417520 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 16:57:30.417538 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.417528 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 16:57:30.417882 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.417864 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 16:57:30.417971 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.417910 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 16:57:30.417971 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.417937 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 16:57:30.418702 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.418684 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 16:57:30.418758 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.418689 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-trp6s\"" Jul 16 16:57:30.566861 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.566838 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk5b9\" (UniqueName: \"kubernetes.io/projected/0c522721-072e-4956-95c7-a9fd96dd99c8-kube-api-access-kk5b9\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.567181 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.566865 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-textfile\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.567181 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.566888 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-tls\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.567181 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.566910 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c522721-072e-4956-95c7-a9fd96dd99c8-metrics-client-ca\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.567181 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.566992 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.567181 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.567021 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-root\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.567181 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.567042 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-sys\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.567181 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.567065 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-wtmp\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.567181 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.567121 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667728 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667678 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667728 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-root\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667889 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-sys\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667889 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667758 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-wtmp\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667889 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667889 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667800 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk5b9\" (UniqueName: \"kubernetes.io/projected/0c522721-072e-4956-95c7-a9fd96dd99c8-kube-api-access-kk5b9\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667889 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667809 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-root\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667889 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667813 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-sys\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.667889 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667816 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-textfile\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.668223 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667897 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-wtmp\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.668223 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667899 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-tls\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.668223 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.667946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c522721-072e-4956-95c7-a9fd96dd99c8-metrics-client-ca\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.668223 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:30.667983 2560 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 16:57:30.668223 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:30.668039 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-tls podName:0c522721-072e-4956-95c7-a9fd96dd99c8 nodeName:}" failed. No retries permitted until 2026-07-16 16:57:31.168020467 +0000 UTC m=+289.303635112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-tls") pod "node-exporter-gmps7" (UID: "0c522721-072e-4956-95c7-a9fd96dd99c8") : secret "node-exporter-tls" not found Jul 16 16:57:30.668469 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.668260 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-textfile\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.668469 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.668458 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c522721-072e-4956-95c7-a9fd96dd99c8-metrics-client-ca\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.668556 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.668491 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-accelerators-collector-config\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.669857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.669837 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:30.677672 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:30.677647 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk5b9\" (UniqueName: \"kubernetes.io/projected/0c522721-072e-4956-95c7-a9fd96dd99c8-kube-api-access-kk5b9\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:31.171568 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:31.171333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-tls\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:31.174498 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:31.174442 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0c522721-072e-4956-95c7-a9fd96dd99c8-node-exporter-tls\") pod \"node-exporter-gmps7\" (UID: \"0c522721-072e-4956-95c7-a9fd96dd99c8\") " pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:31.325338 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:31.325168 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gmps7" Jul 16 16:57:31.341371 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:57:31.341338 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c522721_072e_4956_95c7_a9fd96dd99c8.slice/crio-6ec1ac112c1c829eb4ba3ed1b4782965920cfc1be1286b989053f590d6b9c890 WatchSource:0}: Error finding container 6ec1ac112c1c829eb4ba3ed1b4782965920cfc1be1286b989053f590d6b9c890: Status 404 returned error can't find the container with id 6ec1ac112c1c829eb4ba3ed1b4782965920cfc1be1286b989053f590d6b9c890 Jul 16 16:57:31.447837 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:31.447771 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmps7" event={"ID":"0c522721-072e-4956-95c7-a9fd96dd99c8","Type":"ContainerStarted","Data":"6ec1ac112c1c829eb4ba3ed1b4782965920cfc1be1286b989053f590d6b9c890"} Jul 16 16:57:32.480141 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.480116 2560 scope.go:117] "RemoveContainer" containerID="449656285ad09de772c26c4be62754b97bea40c1509bdbe59b55c05e9adf7cbf" Jul 16 16:57:32.480561 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:32.480286 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-zl55z_openshift-console-operator(eb1b82b0-9f6a-46f8-9e3a-506282b2be6e)\"" pod="openshift-console-operator/console-operator-7866497494-zl55z" podUID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" Jul 16 16:57:32.522523 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.522494 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-bf488698c-jqxpp"] Jul 16 16:57:32.533173 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.533152 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.535547 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.535524 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 16:57:32.535685 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.535662 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ni5qrmru4rot\"" Jul 16 16:57:32.535802 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.535725 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 16:57:32.535927 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.535907 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 16:57:32.536040 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.535985 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 16:57:32.536090 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.536059 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 16:57:32.536090 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.536058 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9fgr4\"" Jul 16 16:57:32.545856 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.545835 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bf488698c-jqxpp"] Jul 16 16:57:32.583257 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.583218 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrhbx\" (UniqueName: \"kubernetes.io/projected/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-kube-api-access-mrhbx\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.583365 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.583269 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-tls\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.583365 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.583306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-grpc-tls\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.583365 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.583360 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-metrics-client-ca\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.583584 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.583395 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.583584 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.583430 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.583584 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.583472 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.583584 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.583528 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.684600 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.684570 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.684749 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.684607 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.684749 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.684652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.684749 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.684691 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrhbx\" (UniqueName: \"kubernetes.io/projected/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-kube-api-access-mrhbx\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.684749 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.684716 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-tls\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.684749 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.684742 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-grpc-tls\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.685041 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.684778 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-metrics-client-ca\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.685041 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.684809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.685770 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.685720 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-metrics-client-ca\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.687686 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.687660 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.687786 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.687705 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.688178 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.688127 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.688178 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.688142 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-tls\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.688178 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.688157 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.688604 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.688586 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-secret-grpc-tls\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.693028 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.692997 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrhbx\" (UniqueName: \"kubernetes.io/projected/c28fca72-1bd5-4a0f-8407-c576a4d2eaa3-kube-api-access-mrhbx\") pod \"thanos-querier-bf488698c-jqxpp\" (UID: \"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3\") " pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:32.843898 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:32.843823 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:33.206220 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:33.206182 2560 patch_prober.go:28] interesting pod/image-registry-8d998f5b4-2z78q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 16:57:33.206403 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:33.206244 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" podUID="b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 16:57:33.545421 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:33.545340 2560 patch_prober.go:28] interesting pod/image-registry-5bdd5b6d6-f9vzd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 16:57:33.545421 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:33.545399 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" podUID="d7f0faec-c7c1-4013-8495-72d8eb44dcb2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 16:57:34.487376 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.487289 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-bf488698c-jqxpp"] Jul 16 16:57:34.491289 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:57:34.491257 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28fca72_1bd5_4a0f_8407_c576a4d2eaa3.slice/crio-979b90b0d23d413e4a4fc13d4e7693ec096653262730f0c328a220884d1c5a9c WatchSource:0}: Error finding container 979b90b0d23d413e4a4fc13d4e7693ec096653262730f0c328a220884d1c5a9c: Status 404 returned error can't find the container with id 979b90b0d23d413e4a4fc13d4e7693ec096653262730f0c328a220884d1c5a9c Jul 16 16:57:34.699671 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.699648 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5979b877f4-5mxmp"] Jul 16 16:57:34.701649 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.701633 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.704069 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.704040 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 16 16:57:34.704069 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.704063 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 16 16:57:34.704219 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.704085 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 16 16:57:34.704219 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.704162 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 16 16:57:34.704633 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.704615 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g4z66\"" Jul 16 16:57:34.704713 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.704651 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-en43379g9i63q\"" Jul 16 16:57:34.718486 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.718468 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5979b877f4-5mxmp"] Jul 16 16:57:34.802211 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.802187 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-secret-metrics-server-tls\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.802295 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.802224 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6de1eac-87fe-47ec-ad8a-6de919292e9a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.802295 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.802245 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6de1eac-87fe-47ec-ad8a-6de919292e9a-metrics-server-audit-profiles\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.802418 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.802398 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvjv7\" (UniqueName: \"kubernetes.io/projected/a6de1eac-87fe-47ec-ad8a-6de919292e9a-kube-api-access-vvjv7\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.802455 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.802435 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-secret-metrics-server-client-certs\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.802492 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.802463 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6de1eac-87fe-47ec-ad8a-6de919292e9a-audit-log\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.802532 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.802503 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-client-ca-bundle\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.903646 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.903592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvjv7\" (UniqueName: \"kubernetes.io/projected/a6de1eac-87fe-47ec-ad8a-6de919292e9a-kube-api-access-vvjv7\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.903646 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.903625 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-secret-metrics-server-client-certs\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.903646 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.903642 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6de1eac-87fe-47ec-ad8a-6de919292e9a-audit-log\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.903826 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.903662 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-client-ca-bundle\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.903884 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.903792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-secret-metrics-server-tls\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.903942 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.903882 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6de1eac-87fe-47ec-ad8a-6de919292e9a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.903942 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.903921 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6de1eac-87fe-47ec-ad8a-6de919292e9a-metrics-server-audit-profiles\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.904059 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.904042 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a6de1eac-87fe-47ec-ad8a-6de919292e9a-audit-log\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.904667 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.904642 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6de1eac-87fe-47ec-ad8a-6de919292e9a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.905020 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.904924 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a6de1eac-87fe-47ec-ad8a-6de919292e9a-metrics-server-audit-profiles\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.906324 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.906304 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-client-ca-bundle\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.906401 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.906387 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-secret-metrics-server-client-certs\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.906503 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.906483 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a6de1eac-87fe-47ec-ad8a-6de919292e9a-secret-metrics-server-tls\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:34.912010 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:34.911988 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvjv7\" (UniqueName: \"kubernetes.io/projected/a6de1eac-87fe-47ec-ad8a-6de919292e9a-kube-api-access-vvjv7\") pod \"metrics-server-5979b877f4-5mxmp\" (UID: \"a6de1eac-87fe-47ec-ad8a-6de919292e9a\") " pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:35.010216 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.010188 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:35.160690 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.160609 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5979b877f4-5mxmp"] Jul 16 16:57:35.163612 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:57:35.163579 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6de1eac_87fe_47ec_ad8a_6de919292e9a.slice/crio-8c6043e4c0e6cfffa062630c9051e65b5d7f23edb62c9bca599558689a6e18af WatchSource:0}: Error finding container 8c6043e4c0e6cfffa062630c9051e65b5d7f23edb62c9bca599558689a6e18af: Status 404 returned error can't find the container with id 8c6043e4c0e6cfffa062630c9051e65b5d7f23edb62c9bca599558689a6e18af Jul 16 16:57:35.394548 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.394517 2560 patch_prober.go:28] interesting pod/image-registry-5bdd5b6d6-f9vzd container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 16:57:35.394694 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.394569 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" podUID="d7f0faec-c7c1-4013-8495-72d8eb44dcb2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 16:57:35.463811 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.463732 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" event={"ID":"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3","Type":"ContainerStarted","Data":"979b90b0d23d413e4a4fc13d4e7693ec096653262730f0c328a220884d1c5a9c"} Jul 16 16:57:35.465495 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.465465 2560 generic.go:356] "Generic (PLEG): container finished" podID="0c522721-072e-4956-95c7-a9fd96dd99c8" containerID="fc7eb20a1b78061af3f7354f84375944091c5e4c3053773407b31209204e9d1a" exitCode=0 Jul 16 16:57:35.465633 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.465505 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmps7" event={"ID":"0c522721-072e-4956-95c7-a9fd96dd99c8","Type":"ContainerDied","Data":"fc7eb20a1b78061af3f7354f84375944091c5e4c3053773407b31209204e9d1a"} Jul 16 16:57:35.466819 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.466786 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" event={"ID":"a6de1eac-87fe-47ec-ad8a-6de919292e9a","Type":"ContainerStarted","Data":"8c6043e4c0e6cfffa062630c9051e65b5d7f23edb62c9bca599558689a6e18af"} Jul 16 16:57:35.469089 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.469059 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67sxj" event={"ID":"cf0a3ccc-c694-439a-867b-99af8c4aa444","Type":"ContainerStarted","Data":"1b6b76a39f42b1b58a4f7ae573dda06bf4a921f31bd52b061a36c4810ba81dcc"} Jul 16 16:57:35.470953 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.470931 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqgfl" event={"ID":"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce","Type":"ContainerStarted","Data":"3635cb34e4263881238d18fc8129f137445e1f54b038feb3072ca6c9e9fcdded"} Jul 16 16:57:35.471056 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.470990 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tqgfl" event={"ID":"d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce","Type":"ContainerStarted","Data":"f0a0aa933e26b275092a31c2f50a08116c15b5b071a59f70edb83963853d899b"} Jul 16 16:57:35.471130 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.471112 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tqgfl" Jul 16 16:57:35.508987 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.508929 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tqgfl" podStartSLOduration=252.587319198 podStartE2EDuration="4m18.508908917s" totalImagesPullingTime="5.921589719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:35.507760863 +0000 UTC m=+293.643375555" watchObservedRunningTime="2026-07-16 16:57:35.508908917 +0000 UTC m=+293.644523586" Jul 16 16:57:35.618150 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.618122 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55bb47794f-qdm9z"] Jul 16 16:57:35.620855 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.620813 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.623165 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.623144 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 16 16:57:35.623383 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.623269 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 16 16:57:35.623383 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.623322 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 16 16:57:35.623775 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.623534 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-j2lj5\"" Jul 16 16:57:35.623775 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.623606 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 16 16:57:35.623975 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.623944 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 16 16:57:35.629364 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.629339 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 16 16:57:35.636132 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.636114 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55bb47794f-qdm9z"] Jul 16 16:57:35.711477 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.711445 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-serving-certs-ca-bundle\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.711842 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.711486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-secret-telemeter-client\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.711842 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.711527 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-metrics-client-ca\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.711842 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.711566 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.711842 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.711667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brgv4\" (UniqueName: \"kubernetes.io/projected/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-kube-api-access-brgv4\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.711842 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.711697 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-telemeter-client-tls\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.711842 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.711726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-federate-client-tls\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.711842 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.711786 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.812598 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.812241 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brgv4\" (UniqueName: \"kubernetes.io/projected/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-kube-api-access-brgv4\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.812598 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.812392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-telemeter-client-tls\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.812598 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.812428 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-federate-client-tls\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.812598 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.812460 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.812598 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.812493 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-serving-certs-ca-bundle\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.812598 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.812515 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-secret-telemeter-client\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.812947 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.812604 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-metrics-client-ca\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.812947 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.812644 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.813864 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.813712 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.813864 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.813791 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-metrics-client-ca\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.813864 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.813795 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-serving-certs-ca-bundle\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.816254 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.815541 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.816874 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.816822 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-federate-client-tls\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.816989 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.816911 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-telemeter-client-tls\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.816989 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.816915 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-secret-telemeter-client\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.827189 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.827146 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brgv4\" (UniqueName: \"kubernetes.io/projected/3bd558c8-f9b6-479d-9610-3f95a2b5aaf0-kube-api-access-brgv4\") pod \"telemeter-client-55bb47794f-qdm9z\" (UID: \"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0\") " pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:35.933285 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:35.933261 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" Jul 16 16:57:36.086811 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:36.086784 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55bb47794f-qdm9z"] Jul 16 16:57:36.090288 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:57:36.090257 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd558c8_f9b6_479d_9610_3f95a2b5aaf0.slice/crio-9f70faf3c3e75d0c649c8929e0b52fcecf5bb515fd9ab5eedb39384bf9e07745 WatchSource:0}: Error finding container 9f70faf3c3e75d0c649c8929e0b52fcecf5bb515fd9ab5eedb39384bf9e07745: Status 404 returned error can't find the container with id 9f70faf3c3e75d0c649c8929e0b52fcecf5bb515fd9ab5eedb39384bf9e07745 Jul 16 16:57:36.477542 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:36.477506 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" event={"ID":"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0","Type":"ContainerStarted","Data":"9f70faf3c3e75d0c649c8929e0b52fcecf5bb515fd9ab5eedb39384bf9e07745"} Jul 16 16:57:36.479980 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:36.479941 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmps7" event={"ID":"0c522721-072e-4956-95c7-a9fd96dd99c8","Type":"ContainerStarted","Data":"6c66f8d413a236ce3ef07fe61216659a82693e0f8d22f07abbe3e88fb54129e3"} Jul 16 16:57:36.480119 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:36.480004 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gmps7" event={"ID":"0c522721-072e-4956-95c7-a9fd96dd99c8","Type":"ContainerStarted","Data":"a49bea7877a2afbec6a3997ceefefbb8b3a09fefe59adcc0a3810a0a726e2916"} Jul 16 16:57:36.501242 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:36.501193 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gmps7" podStartSLOduration=3.327302723 podStartE2EDuration="6.5011749s" totalImagesPullingTime="3.099973168s" totalInitContainerRuntime="73.899009ms" isStatefulPod=true podCreationTimestamp="2026-07-16 16:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:36.499321651 +0000 UTC m=+294.634936356" watchObservedRunningTime="2026-07-16 16:57:36.5011749 +0000 UTC m=+294.636789565" Jul 16 16:57:37.471634 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:37.471594 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mxtg5" podUID="b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e" Jul 16 16:57:37.486834 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:37.486805 2560 generic.go:356] "Generic (PLEG): container finished" podID="8fa9bba4-25cd-4b1c-8566-fd4981ddc98d" containerID="c0f5475461c5152444dba00a19b801e874fd41d44da0144744dbaaca6073b236" exitCode=255 Jul 16 16:57:37.486982 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:37.486887 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" event={"ID":"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d","Type":"ContainerDied","Data":"c0f5475461c5152444dba00a19b801e874fd41d44da0144744dbaaca6073b236"} Jul 16 16:57:37.486982 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:37.486972 2560 scope.go:117] "RemoveContainer" containerID="fe15a76d7339123c0e94672f6d81f1e2c9fcacfc1483eb31ad8b00681011691a" Jul 16 16:57:37.494139 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:37.494121 2560 scope.go:117] "RemoveContainer" containerID="c0f5475461c5152444dba00a19b801e874fd41d44da0144744dbaaca6073b236" Jul 16 16:57:37.494328 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:37.494306 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-55df4f87d8-9gdcp_open-cluster-management-agent-addon(8fa9bba4-25cd-4b1c-8566-fd4981ddc98d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" podUID="8fa9bba4-25cd-4b1c-8566-fd4981ddc98d" Jul 16 16:57:38.219496 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.219457 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" podUID="b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" containerName="registry" containerID="cri-o://5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453" gracePeriod=30 Jul 16 16:57:38.475163 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.475138 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:57:38.493087 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.492598 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-67sxj" event={"ID":"cf0a3ccc-c694-439a-867b-99af8c4aa444","Type":"ContainerStarted","Data":"4713989d76a27fa599baed262bdacbf064df4b8beb1ac8354a0ea5f3bfbf4819"} Jul 16 16:57:38.502020 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.501986 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" event={"ID":"a6de1eac-87fe-47ec-ad8a-6de919292e9a","Type":"ContainerStarted","Data":"c9199a2c0e51a87e088c998a3009ae794ceb7ace2ea57a09fe378f91424e6550"} Jul 16 16:57:38.505172 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.505147 2560 generic.go:356] "Generic (PLEG): container finished" podID="b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" containerID="5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453" exitCode=0 Jul 16 16:57:38.505271 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.505175 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" event={"ID":"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4","Type":"ContainerDied","Data":"5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453"} Jul 16 16:57:38.505271 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.505216 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" event={"ID":"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4","Type":"ContainerDied","Data":"8e076a66215e23a8d9562bec03776e20925b28700bc84f77d1c82a201ba107e9"} Jul 16 16:57:38.505271 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.505215 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d998f5b4-2z78q" Jul 16 16:57:38.505271 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.505232 2560 scope.go:117] "RemoveContainer" containerID="5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453" Jul 16 16:57:38.512606 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.512567 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-67sxj" podStartSLOduration=32.827877471 podStartE2EDuration="47.512550009s" totalImagesPullingTime="14.684672538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:56:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:38.510929357 +0000 UTC m=+296.646544025" watchObservedRunningTime="2026-07-16 16:57:38.512550009 +0000 UTC m=+296.648164677" Jul 16 16:57:38.514512 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.514486 2560 scope.go:117] "RemoveContainer" containerID="5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453" Jul 16 16:57:38.514772 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:38.514749 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453\": container with ID starting with 5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453 not found: ID does not exist" containerID="5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453" Jul 16 16:57:38.514873 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.514777 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453"} err="failed to get container status \"5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453\": rpc error: code = NotFound desc = could not find container \"5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453\": container with ID starting with 5cbd1ce0f6d3c6dbcf12553b71ebbcb0951212c7b1ce78bd9df0c863a9112453 not found: ID does not exist" Jul 16 16:57:38.527904 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.527864 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" podStartSLOduration=1.570220095 podStartE2EDuration="4.52785351s" totalImagesPullingTime="2.957633415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:38.526089174 +0000 UTC m=+296.661703845" watchObservedRunningTime="2026-07-16 16:57:38.52785351 +0000 UTC m=+296.663468155" Jul 16 16:57:38.539162 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539139 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-installation-pull-secrets\") pod \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " Jul 16 16:57:38.539255 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539180 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-ca-trust-extracted\") pod \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " Jul 16 16:57:38.539364 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539326 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd76d\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-kube-api-access-gd76d\") pod \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " Jul 16 16:57:38.539412 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539368 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-trusted-ca\") pod \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " Jul 16 16:57:38.539412 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539399 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-certificates\") pod \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " Jul 16 16:57:38.539480 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539443 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-bound-sa-token\") pod \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " Jul 16 16:57:38.539480 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539470 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-image-registry-private-configuration\") pod \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " Jul 16 16:57:38.539565 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539526 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") pod \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\" (UID: \"b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4\") " Jul 16 16:57:38.540586 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539838 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:57:38.540586 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.539894 2560 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-certificates\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 16:57:38.540586 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.540278 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:57:38.541926 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.541882 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:57:38.543033 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.542992 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:57:38.543238 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.543202 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-kube-api-access-gd76d" (OuterVolumeSpecName: "kube-api-access-gd76d") pod "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4"). InnerVolumeSpecName "kube-api-access-gd76d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:57:38.543238 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.543219 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:57:38.543377 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.543282 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:57:38.550190 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.550165 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" (UID: "b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:57:38.640486 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.640456 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd76d\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-kube-api-access-gd76d\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 16:57:38.640486 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.640482 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-trusted-ca\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 16:57:38.640486 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.640491 2560 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-bound-sa-token\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 16:57:38.640649 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.640500 2560 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-image-registry-private-configuration\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 16:57:38.640649 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.640508 2560 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-registry-tls\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 16:57:38.640649 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.640516 2560 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-installation-pull-secrets\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 16:57:38.640649 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.640524 2560 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4-ca-trust-extracted\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 16:57:38.828203 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.828174 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8d998f5b4-2z78q"] Jul 16 16:57:38.831287 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:38.831186 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8d998f5b4-2z78q"] Jul 16 16:57:40.474830 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:40.474758 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" path="/var/lib/kubelet/pods/b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4/volumes" Jul 16 16:57:40.514842 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:40.514794 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" event={"ID":"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3","Type":"ContainerStarted","Data":"034f19591fc6d6caba19c65f52c7c31b0536adb53035e4c9613bea998b26bb72"} Jul 16 16:57:40.515000 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:40.514866 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" event={"ID":"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3","Type":"ContainerStarted","Data":"459065630f4ac1b63be3302da48cef14d046496d70cda8da2e2acb5b694520e5"} Jul 16 16:57:40.515000 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:40.514896 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" event={"ID":"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3","Type":"ContainerStarted","Data":"71c04f6b9af65a7ebb6ccff196577755819070dac38e9b6e33e4dca077e19d92"} Jul 16 16:57:40.516148 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:40.516127 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" event={"ID":"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0","Type":"ContainerStarted","Data":"9cdbcb7a4c4f80e3b4452d59321c9ddfd17f335f29363bd07e7c71d7a8c270cf"} Jul 16 16:57:41.522682 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:41.522609 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" event={"ID":"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3","Type":"ContainerStarted","Data":"ec99309d0e35999ee4f4cebcaafdac0d059bdc918ed8cbb3e31311f5905a0833"} Jul 16 16:57:41.522682 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:41.522675 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" event={"ID":"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3","Type":"ContainerStarted","Data":"39d1ffb0519af915f64fe5558757996f42d717ddfb2a43bf83b8f8bb68d69d00"} Jul 16 16:57:41.523106 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:41.522719 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" event={"ID":"c28fca72-1bd5-4a0f-8407-c576a4d2eaa3","Type":"ContainerStarted","Data":"19701435b68d0811b4563f16044ec9b7b4fa993aa91d38b3717a197f52ae99ef"} Jul 16 16:57:41.523106 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:41.522763 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:41.524612 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:41.524587 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" event={"ID":"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0","Type":"ContainerStarted","Data":"c2736dfa7e97ba32be02210a53b5872a01c4bd8539567200d427c482f6623ee5"} Jul 16 16:57:41.524717 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:41.524643 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" event={"ID":"3bd558c8-f9b6-479d-9610-3f95a2b5aaf0","Type":"ContainerStarted","Data":"d16ae7a859baba0d66b39d1c4769f05861bd62ce0a6b2f5f30df01b63108a5d7"} Jul 16 16:57:41.543984 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:41.543923 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" podStartSLOduration=2.991946859 podStartE2EDuration="9.543906148s" totalImagesPullingTime="6.551959289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:41.542673429 +0000 UTC m=+299.678288106" watchObservedRunningTime="2026-07-16 16:57:41.543906148 +0000 UTC m=+299.679520820" Jul 16 16:57:41.562522 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:41.562479 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55bb47794f-qdm9z" podStartSLOduration=1.506415584 podStartE2EDuration="6.562465458s" totalImagesPullingTime="5.056049874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:41.56126911 +0000 UTC m=+299.696883796" watchObservedRunningTime="2026-07-16 16:57:41.562465458 +0000 UTC m=+299.698080124" Jul 16 16:57:42.290179 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:42.290154 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 16:57:42.294307 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:42.294290 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 16:57:42.294738 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:42.294721 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 16:57:42.299096 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:42.299072 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 16:57:42.300862 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:42.300838 2560 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 16:57:42.645892 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:42.645862 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" Jul 16 16:57:42.651542 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:42.651525 2560 scope.go:117] "RemoveContainer" containerID="c0f5475461c5152444dba00a19b801e874fd41d44da0144744dbaaca6073b236" Jul 16 16:57:42.651676 ip-10-0-130-64 kubenswrapper[2560]: E0716 16:57:42.651659 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-55df4f87d8-9gdcp_open-cluster-management-agent-addon(8fa9bba4-25cd-4b1c-8566-fd4981ddc98d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" podUID="8fa9bba4-25cd-4b1c-8566-fd4981ddc98d" Jul 16 16:57:43.544641 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:43.544614 2560 patch_prober.go:28] interesting pod/image-registry-5bdd5b6d6-f9vzd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 16:57:43.544857 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:43.544657 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" podUID="d7f0faec-c7c1-4013-8495-72d8eb44dcb2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 16:57:45.393334 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:45.393303 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bdd5b6d6-f9vzd" Jul 16 16:57:45.482242 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:45.482217 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tqgfl" Jul 16 16:57:47.470554 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:47.470528 2560 scope.go:117] "RemoveContainer" containerID="449656285ad09de772c26c4be62754b97bea40c1509bdbe59b55c05e9adf7cbf" Jul 16 16:57:47.533529 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:47.533511 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-bf488698c-jqxpp" Jul 16 16:57:47.547310 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:47.547283 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 16:57:47.547399 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:47.547383 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-zl55z" event={"ID":"eb1b82b0-9f6a-46f8-9e3a-506282b2be6e","Type":"ContainerStarted","Data":"75b1be3f3a5306ece936c9ca43e4f0abf7be618a5abe00fea1244fe20f576e16"} Jul 16 16:57:47.547671 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:47.547650 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:57:47.548650 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:47.548633 2560 patch_prober.go:28] interesting pod/console-operator-7866497494-zl55z container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.133.0.12:8443/readyz\": dial tcp 10.133.0.12:8443: connect: connection refused" start-of-body= Jul 16 16:57:47.548738 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:47.548665 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7866497494-zl55z" podUID="eb1b82b0-9f6a-46f8-9e3a-506282b2be6e" containerName="console-operator" probeResult="failure" output="Get \"https://10.133.0.12:8443/readyz\": dial tcp 10.133.0.12:8443: connect: connection refused" Jul 16 16:57:47.588863 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:47.588807 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-zl55z" podStartSLOduration=58.159885922 podStartE2EDuration="1m0.588794061s" totalImagesPullingTime="2.428908139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:47.587664431 +0000 UTC m=+305.723279113" watchObservedRunningTime="2026-07-16 16:57:47.588794061 +0000 UTC m=+305.724408728" Jul 16 16:57:48.554161 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:48.554131 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-zl55z" Jul 16 16:57:51.470423 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:51.470392 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:57:54.470193 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:54.470169 2560 scope.go:117] "RemoveContainer" containerID="c0f5475461c5152444dba00a19b801e874fd41d44da0144744dbaaca6073b236" Jul 16 16:57:55.010870 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:55.010838 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:55.011054 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:55.010891 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:57:55.576861 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:57:55.576819 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55df4f87d8-9gdcp" event={"ID":"8fa9bba4-25cd-4b1c-8566-fd4981ddc98d","Type":"ContainerStarted","Data":"825ca58413dd4fdfca050bb4bc8b78a7bbc097aa2a88f932f899cc7e6ea5686f"} Jul 16 16:58:03.605972 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:03.605927 2560 generic.go:356] "Generic (PLEG): container finished" podID="89876d54-0694-44d2-9d7e-4370eb79f0dc" containerID="bc6fbf02c77efc8f088bb5ddc28d84f805e2bc76d6e1a1afed1cc6cfb74255f9" exitCode=0 Jul 16 16:58:03.606327 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:03.606005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" event={"ID":"89876d54-0694-44d2-9d7e-4370eb79f0dc","Type":"ContainerDied","Data":"bc6fbf02c77efc8f088bb5ddc28d84f805e2bc76d6e1a1afed1cc6cfb74255f9"} Jul 16 16:58:03.606327 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:03.606296 2560 scope.go:117] "RemoveContainer" containerID="bc6fbf02c77efc8f088bb5ddc28d84f805e2bc76d6e1a1afed1cc6cfb74255f9" Jul 16 16:58:04.611839 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:04.611802 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-bbvrf" event={"ID":"89876d54-0694-44d2-9d7e-4370eb79f0dc","Type":"ContainerStarted","Data":"4f5026845cc44e80ed210c29543a527a5485613fb903ad4bb01ae89958aecb81"} Jul 16 16:58:15.016154 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:15.016124 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:58:15.019850 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:15.019823 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5979b877f4-5mxmp" Jul 16 16:58:16.656471 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:16.656440 2560 generic.go:356] "Generic (PLEG): container finished" podID="3f136b0f-6094-4d13-aecd-654c18e48c1a" containerID="7d44ab607e11da2292ca634ec11ea6abf638030075533795f62cc04a9b27f7b4" exitCode=0 Jul 16 16:58:16.656823 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:16.656518 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" event={"ID":"3f136b0f-6094-4d13-aecd-654c18e48c1a","Type":"ContainerDied","Data":"7d44ab607e11da2292ca634ec11ea6abf638030075533795f62cc04a9b27f7b4"} Jul 16 16:58:16.656875 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:16.656830 2560 scope.go:117] "RemoveContainer" containerID="7d44ab607e11da2292ca634ec11ea6abf638030075533795f62cc04a9b27f7b4" Jul 16 16:58:17.662037 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:17.662005 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-6vnnm" event={"ID":"3f136b0f-6094-4d13-aecd-654c18e48c1a","Type":"ContainerStarted","Data":"bbcd8f76deee1bb47a0c00394088f9ab4463ccd940c124e3f34e82623eddc9cd"} Jul 16 16:58:55.277672 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:55.277592 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:58:55.279847 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:55.279828 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e-metrics-certs\") pod \"network-metrics-daemon-mxtg5\" (UID: \"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e\") " pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:58:55.374077 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:55.374043 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jjfzg\"" Jul 16 16:58:55.382020 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:55.381996 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxtg5" Jul 16 16:58:55.506254 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:55.506219 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxtg5"] Jul 16 16:58:55.509400 ip-10-0-130-64 kubenswrapper[2560]: W0716 16:58:55.509372 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5f61b52_2c4d_4d59_a71b_ca54dcb8e35e.slice/crio-9ab6a20fdc0c713f97a57e365b482d29cacd258bb79756a21ebd8e3b5ef1130f WatchSource:0}: Error finding container 9ab6a20fdc0c713f97a57e365b482d29cacd258bb79756a21ebd8e3b5ef1130f: Status 404 returned error can't find the container with id 9ab6a20fdc0c713f97a57e365b482d29cacd258bb79756a21ebd8e3b5ef1130f Jul 16 16:58:55.511346 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:55.511329 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 16:58:55.803844 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:55.803811 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxtg5" event={"ID":"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e","Type":"ContainerStarted","Data":"9ab6a20fdc0c713f97a57e365b482d29cacd258bb79756a21ebd8e3b5ef1130f"} Jul 16 16:58:56.809934 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:56.809852 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxtg5" event={"ID":"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e","Type":"ContainerStarted","Data":"7641c96181ee1e077f837ba382733eceecdc322fa50dcdfd1bf9f2075d652180"} Jul 16 16:58:56.809934 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:56.809908 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxtg5" event={"ID":"b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e","Type":"ContainerStarted","Data":"acb6c1c26416b6deb9d3e4e24ce5edd48b93b21dbdf57a27bad3323fe15a42cf"} Jul 16 16:58:56.826707 ip-10-0-130-64 kubenswrapper[2560]: I0716 16:58:56.826658 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mxtg5" podStartSLOduration=373.933639332 podStartE2EDuration="6m14.826643619s" totalImagesPullingTime="893.004287ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:58:56.825707771 +0000 UTC m=+374.961322438" watchObservedRunningTime="2026-07-16 16:58:56.826643619 +0000 UTC m=+374.962258286" Jul 16 17:00:43.635320 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.635287 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7"] Jul 16 17:00:43.635765 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.635565 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" containerName="registry" Jul 16 17:00:43.635765 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.635576 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" containerName="registry" Jul 16 17:00:43.635765 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.635635 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="b468c3ff-8c78-4358-a2ef-ed5c5d0be5f4" containerName="registry" Jul 16 17:00:43.638242 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.638227 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:43.640949 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.640921 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-x4r6p\"" Jul 16 17:00:43.640949 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.640936 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 16 17:00:43.640949 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.640922 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 16 17:00:43.641172 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.641101 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 16 17:00:43.656641 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.656620 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7"] Jul 16 17:00:43.689747 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.689721 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1ab650ce-48ce-4234-bb45-513474882ca1-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7\" (UID: \"1ab650ce-48ce-4234-bb45-513474882ca1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:43.689855 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.689763 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hftf\" (UniqueName: \"kubernetes.io/projected/1ab650ce-48ce-4234-bb45-513474882ca1-kube-api-access-5hftf\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7\" (UID: \"1ab650ce-48ce-4234-bb45-513474882ca1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:43.790754 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.790726 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1ab650ce-48ce-4234-bb45-513474882ca1-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7\" (UID: \"1ab650ce-48ce-4234-bb45-513474882ca1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:43.790892 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.790770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hftf\" (UniqueName: \"kubernetes.io/projected/1ab650ce-48ce-4234-bb45-513474882ca1-kube-api-access-5hftf\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7\" (UID: \"1ab650ce-48ce-4234-bb45-513474882ca1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:43.792781 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.792761 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/1ab650ce-48ce-4234-bb45-513474882ca1-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7\" (UID: \"1ab650ce-48ce-4234-bb45-513474882ca1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:43.803769 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.803748 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hftf\" (UniqueName: \"kubernetes.io/projected/1ab650ce-48ce-4234-bb45-513474882ca1-kube-api-access-5hftf\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7\" (UID: \"1ab650ce-48ce-4234-bb45-513474882ca1\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:43.947484 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:43.947430 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:44.073628 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:44.073569 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7"] Jul 16 17:00:44.075908 ip-10-0-130-64 kubenswrapper[2560]: W0716 17:00:44.075880 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab650ce_48ce_4234_bb45_513474882ca1.slice/crio-8fe3d76254036b8873a558117244f01dae7afc14ae17fae937870c98cc9a31ce WatchSource:0}: Error finding container 8fe3d76254036b8873a558117244f01dae7afc14ae17fae937870c98cc9a31ce: Status 404 returned error can't find the container with id 8fe3d76254036b8873a558117244f01dae7afc14ae17fae937870c98cc9a31ce Jul 16 17:00:44.210651 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:44.210580 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" event={"ID":"1ab650ce-48ce-4234-bb45-513474882ca1","Type":"ContainerStarted","Data":"8fe3d76254036b8873a558117244f01dae7afc14ae17fae937870c98cc9a31ce"} Jul 16 17:00:51.241803 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:51.241766 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" event={"ID":"1ab650ce-48ce-4234-bb45-513474882ca1","Type":"ContainerStarted","Data":"6d1ca9cd9bb1ee8da74eb2c5704485da4209d018379aa25e30a916c351044e83"} Jul 16 17:00:51.242191 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:51.241849 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:00:51.263366 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:00:51.263319 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" podStartSLOduration=1.8059930789999998 podStartE2EDuration="8.263305862s" totalImagesPullingTime="6.457312783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:00:51.262375553 +0000 UTC m=+489.397990241" watchObservedRunningTime="2026-07-16 17:00:51.263305862 +0000 UTC m=+489.398920529" Jul 16 17:01:12.248326 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:12.248297 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2hkz7" Jul 16 17:01:54.089124 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.089045 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-rc68t"] Jul 16 17:01:54.091182 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.091167 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:54.093655 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.093633 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 16 17:01:54.095118 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.095099 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-gzq7z\"" Jul 16 17:01:54.095209 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.095148 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 16 17:01:54.095209 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.095192 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 16 17:01:54.096730 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.096710 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/623dbb86-0376-46ba-8e6d-4d5b523000f9-cert\") pod \"kserve-controller-manager-d55957fc4-rc68t\" (UID: \"623dbb86-0376-46ba-8e6d-4d5b523000f9\") " pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:54.096842 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.096758 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgcmw\" (UniqueName: \"kubernetes.io/projected/623dbb86-0376-46ba-8e6d-4d5b523000f9-kube-api-access-dgcmw\") pod \"kserve-controller-manager-d55957fc4-rc68t\" (UID: \"623dbb86-0376-46ba-8e6d-4d5b523000f9\") " pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:54.117422 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.117393 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-rc68t"] Jul 16 17:01:54.155593 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.155567 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-6thk8"] Jul 16 17:01:54.157732 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.157712 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:01:54.159907 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.159889 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 16 17:01:54.160015 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.159893 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-kqph4\"" Jul 16 17:01:54.179786 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.179760 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-6thk8"] Jul 16 17:01:54.197545 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.197524 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgcmw\" (UniqueName: \"kubernetes.io/projected/623dbb86-0376-46ba-8e6d-4d5b523000f9-kube-api-access-dgcmw\") pod \"kserve-controller-manager-d55957fc4-rc68t\" (UID: \"623dbb86-0376-46ba-8e6d-4d5b523000f9\") " pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:54.197693 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.197608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/623dbb86-0376-46ba-8e6d-4d5b523000f9-cert\") pod \"kserve-controller-manager-d55957fc4-rc68t\" (UID: \"623dbb86-0376-46ba-8e6d-4d5b523000f9\") " pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:54.199971 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.199938 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/623dbb86-0376-46ba-8e6d-4d5b523000f9-cert\") pod \"kserve-controller-manager-d55957fc4-rc68t\" (UID: \"623dbb86-0376-46ba-8e6d-4d5b523000f9\") " pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:54.209881 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.209861 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgcmw\" (UniqueName: \"kubernetes.io/projected/623dbb86-0376-46ba-8e6d-4d5b523000f9-kube-api-access-dgcmw\") pod \"kserve-controller-manager-d55957fc4-rc68t\" (UID: \"623dbb86-0376-46ba-8e6d-4d5b523000f9\") " pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:54.298499 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.298465 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts29t\" (UniqueName: \"kubernetes.io/projected/2d784a02-86cf-4a65-91b9-7c80c8b808dd-kube-api-access-ts29t\") pod \"seaweedfs-64568bcd49-6thk8\" (UID: \"2d784a02-86cf-4a65-91b9-7c80c8b808dd\") " pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:01:54.298605 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.298546 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d784a02-86cf-4a65-91b9-7c80c8b808dd-data\") pod \"seaweedfs-64568bcd49-6thk8\" (UID: \"2d784a02-86cf-4a65-91b9-7c80c8b808dd\") " pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:01:54.399022 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.399000 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d784a02-86cf-4a65-91b9-7c80c8b808dd-data\") pod \"seaweedfs-64568bcd49-6thk8\" (UID: \"2d784a02-86cf-4a65-91b9-7c80c8b808dd\") " pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:01:54.399146 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.399044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts29t\" (UniqueName: \"kubernetes.io/projected/2d784a02-86cf-4a65-91b9-7c80c8b808dd-kube-api-access-ts29t\") pod \"seaweedfs-64568bcd49-6thk8\" (UID: \"2d784a02-86cf-4a65-91b9-7c80c8b808dd\") " pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:01:54.399342 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.399325 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2d784a02-86cf-4a65-91b9-7c80c8b808dd-data\") pod \"seaweedfs-64568bcd49-6thk8\" (UID: \"2d784a02-86cf-4a65-91b9-7c80c8b808dd\") " pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:01:54.401003 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.400986 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:54.409337 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.409316 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts29t\" (UniqueName: \"kubernetes.io/projected/2d784a02-86cf-4a65-91b9-7c80c8b808dd-kube-api-access-ts29t\") pod \"seaweedfs-64568bcd49-6thk8\" (UID: \"2d784a02-86cf-4a65-91b9-7c80c8b808dd\") " pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:01:54.466087 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.466056 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:01:54.538535 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.538505 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-rc68t"] Jul 16 17:01:54.541439 ip-10-0-130-64 kubenswrapper[2560]: W0716 17:01:54.541408 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623dbb86_0376_46ba_8e6d_4d5b523000f9.slice/crio-06cbbc8d1a79e3481e6509ffc27b55b3c51922b9dd630d49c59b3660a15ee56c WatchSource:0}: Error finding container 06cbbc8d1a79e3481e6509ffc27b55b3c51922b9dd630d49c59b3660a15ee56c: Status 404 returned error can't find the container with id 06cbbc8d1a79e3481e6509ffc27b55b3c51922b9dd630d49c59b3660a15ee56c Jul 16 17:01:54.598657 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:54.598636 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-6thk8"] Jul 16 17:01:54.601202 ip-10-0-130-64 kubenswrapper[2560]: W0716 17:01:54.601176 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d784a02_86cf_4a65_91b9_7c80c8b808dd.slice/crio-5b807b6783b070edb4574344b78fb9529580f0bd57af4b4da07d9860c818e100 WatchSource:0}: Error finding container 5b807b6783b070edb4574344b78fb9529580f0bd57af4b4da07d9860c818e100: Status 404 returned error can't find the container with id 5b807b6783b070edb4574344b78fb9529580f0bd57af4b4da07d9860c818e100 Jul 16 17:01:55.496396 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:55.496356 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-6thk8" event={"ID":"2d784a02-86cf-4a65-91b9-7c80c8b808dd","Type":"ContainerStarted","Data":"5b807b6783b070edb4574344b78fb9529580f0bd57af4b4da07d9860c818e100"} Jul 16 17:01:55.497313 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:55.497290 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" event={"ID":"623dbb86-0376-46ba-8e6d-4d5b523000f9","Type":"ContainerStarted","Data":"06cbbc8d1a79e3481e6509ffc27b55b3c51922b9dd630d49c59b3660a15ee56c"} Jul 16 17:01:57.507767 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:57.507702 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" event={"ID":"623dbb86-0376-46ba-8e6d-4d5b523000f9","Type":"ContainerStarted","Data":"5c917edf1fa7a39b4c7a0a26c9d3f9934a873b3463136fa7d91278873fd9fcb7"} Jul 16 17:01:57.508097 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:57.507828 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:01:57.524778 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:57.524737 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" podStartSLOduration=0.632958347 podStartE2EDuration="3.524723905s" totalImagesPullingTime="2.891765558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:01:57.523727385 +0000 UTC m=+555.659342072" watchObservedRunningTime="2026-07-16 17:01:57.524723905 +0000 UTC m=+555.660338600" Jul 16 17:01:58.514162 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:58.514124 2560 generic.go:356] "Generic (PLEG): container finished" podID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerID="5c917edf1fa7a39b4c7a0a26c9d3f9934a873b3463136fa7d91278873fd9fcb7" exitCode=1 Jul 16 17:01:58.514634 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:58.514219 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" event={"ID":"623dbb86-0376-46ba-8e6d-4d5b523000f9","Type":"ContainerDied","Data":"5c917edf1fa7a39b4c7a0a26c9d3f9934a873b3463136fa7d91278873fd9fcb7"} Jul 16 17:01:58.514634 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:01:58.514462 2560 scope.go:117] "RemoveContainer" containerID="5c917edf1fa7a39b4c7a0a26c9d3f9934a873b3463136fa7d91278873fd9fcb7" Jul 16 17:02:00.523828 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:00.523741 2560 generic.go:356] "Generic (PLEG): container finished" podID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerID="1a8967c94f9348ea4ab536d844e7b8ec7c4e96605d7f30eade862be45b9bd672" exitCode=1 Jul 16 17:02:00.524275 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:00.523831 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" event={"ID":"623dbb86-0376-46ba-8e6d-4d5b523000f9","Type":"ContainerDied","Data":"1a8967c94f9348ea4ab536d844e7b8ec7c4e96605d7f30eade862be45b9bd672"} Jul 16 17:02:00.524275 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:00.523895 2560 scope.go:117] "RemoveContainer" containerID="5c917edf1fa7a39b4c7a0a26c9d3f9934a873b3463136fa7d91278873fd9fcb7" Jul 16 17:02:00.524275 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:00.524126 2560 scope.go:117] "RemoveContainer" containerID="1a8967c94f9348ea4ab536d844e7b8ec7c4e96605d7f30eade862be45b9bd672" Jul 16 17:02:00.524386 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:00.524347 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-rc68t_kserve(623dbb86-0376-46ba-8e6d-4d5b523000f9)\"" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" Jul 16 17:02:00.525316 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:00.525297 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-6thk8" event={"ID":"2d784a02-86cf-4a65-91b9-7c80c8b808dd","Type":"ContainerStarted","Data":"229486cb68a6fdde4d0ef02a90b1f2364dbd4ff6fff76a935796be15dab3ee75"} Jul 16 17:02:00.525428 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:00.525404 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:02:00.564142 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:00.564079 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-6thk8" podStartSLOduration=0.877918193 podStartE2EDuration="6.564062696s" totalImagesPullingTime="5.686144503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:01:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:02:00.563535674 +0000 UTC m=+558.699150342" watchObservedRunningTime="2026-07-16 17:02:00.564062696 +0000 UTC m=+558.699677421" Jul 16 17:02:01.530778 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:01.530753 2560 scope.go:117] "RemoveContainer" containerID="1a8967c94f9348ea4ab536d844e7b8ec7c4e96605d7f30eade862be45b9bd672" Jul 16 17:02:01.531124 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:01.530888 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-rc68t_kserve(623dbb86-0376-46ba-8e6d-4d5b523000f9)\"" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" Jul 16 17:02:02.508116 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:02.508083 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:02:02.534064 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:02.534042 2560 scope.go:117] "RemoveContainer" containerID="1a8967c94f9348ea4ab536d844e7b8ec7c4e96605d7f30eade862be45b9bd672" Jul 16 17:02:02.534377 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:02.534181 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-rc68t_kserve(623dbb86-0376-46ba-8e6d-4d5b523000f9)\"" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" Jul 16 17:02:04.401605 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:04.401577 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:02:04.401979 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:04.401932 2560 scope.go:117] "RemoveContainer" containerID="1a8967c94f9348ea4ab536d844e7b8ec7c4e96605d7f30eade862be45b9bd672" Jul 16 17:02:04.402123 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:04.402098 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-rc68t_kserve(623dbb86-0376-46ba-8e6d-4d5b523000f9)\"" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" Jul 16 17:02:06.532803 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:06.532775 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-6thk8" Jul 16 17:02:17.470870 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:17.470840 2560 scope.go:117] "RemoveContainer" containerID="1a8967c94f9348ea4ab536d844e7b8ec7c4e96605d7f30eade862be45b9bd672" Jul 16 17:02:23.615090 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:23.615059 2560 generic.go:356] "Generic (PLEG): container finished" podID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerID="0859892f43b675dea19e4a0b74389ac00cbbfb5ea00b269bbd49319c08ff06c7" exitCode=1 Jul 16 17:02:23.615532 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:23.615137 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" event={"ID":"623dbb86-0376-46ba-8e6d-4d5b523000f9","Type":"ContainerDied","Data":"0859892f43b675dea19e4a0b74389ac00cbbfb5ea00b269bbd49319c08ff06c7"} Jul 16 17:02:23.615532 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:23.615210 2560 scope.go:117] "RemoveContainer" containerID="1a8967c94f9348ea4ab536d844e7b8ec7c4e96605d7f30eade862be45b9bd672" Jul 16 17:02:23.615532 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:23.615496 2560 scope.go:117] "RemoveContainer" containerID="0859892f43b675dea19e4a0b74389ac00cbbfb5ea00b269bbd49319c08ff06c7" Jul 16 17:02:23.615685 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:23.615667 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-rc68t_kserve(623dbb86-0376-46ba-8e6d-4d5b523000f9)\"" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" Jul 16 17:02:24.401408 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:24.401375 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:02:24.621337 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:24.621306 2560 scope.go:117] "RemoveContainer" containerID="0859892f43b675dea19e4a0b74389ac00cbbfb5ea00b269bbd49319c08ff06c7" Jul 16 17:02:24.621678 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:24.621551 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-rc68t_kserve(623dbb86-0376-46ba-8e6d-4d5b523000f9)\"" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" Jul 16 17:02:27.508036 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:27.508002 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:02:27.508487 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:27.508329 2560 scope.go:117] "RemoveContainer" containerID="0859892f43b675dea19e4a0b74389ac00cbbfb5ea00b269bbd49319c08ff06c7" Jul 16 17:02:27.508529 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:27.508480 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-rc68t_kserve(623dbb86-0376-46ba-8e6d-4d5b523000f9)\"" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" Jul 16 17:02:29.145561 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.145527 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-rc68t"] Jul 16 17:02:29.173206 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.173175 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-ptczb"] Jul 16 17:02:29.177990 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.177942 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:29.185910 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.185878 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-ptczb"] Jul 16 17:02:29.253420 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.253375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/792f8ebc-1087-4773-8c31-6bff50977a02-cert\") pod \"kserve-controller-manager-d55957fc4-ptczb\" (UID: \"792f8ebc-1087-4773-8c31-6bff50977a02\") " pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:29.253576 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.253485 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w5cl\" (UniqueName: \"kubernetes.io/projected/792f8ebc-1087-4773-8c31-6bff50977a02-kube-api-access-4w5cl\") pod \"kserve-controller-manager-d55957fc4-ptczb\" (UID: \"792f8ebc-1087-4773-8c31-6bff50977a02\") " pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:29.282225 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.282201 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:02:29.353979 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.353926 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgcmw\" (UniqueName: \"kubernetes.io/projected/623dbb86-0376-46ba-8e6d-4d5b523000f9-kube-api-access-dgcmw\") pod \"623dbb86-0376-46ba-8e6d-4d5b523000f9\" (UID: \"623dbb86-0376-46ba-8e6d-4d5b523000f9\") " Jul 16 17:02:29.354175 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.354038 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/623dbb86-0376-46ba-8e6d-4d5b523000f9-cert\") pod \"623dbb86-0376-46ba-8e6d-4d5b523000f9\" (UID: \"623dbb86-0376-46ba-8e6d-4d5b523000f9\") " Jul 16 17:02:29.354175 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.354143 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w5cl\" (UniqueName: \"kubernetes.io/projected/792f8ebc-1087-4773-8c31-6bff50977a02-kube-api-access-4w5cl\") pod \"kserve-controller-manager-d55957fc4-ptczb\" (UID: \"792f8ebc-1087-4773-8c31-6bff50977a02\") " pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:29.354287 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.354182 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/792f8ebc-1087-4773-8c31-6bff50977a02-cert\") pod \"kserve-controller-manager-d55957fc4-ptczb\" (UID: \"792f8ebc-1087-4773-8c31-6bff50977a02\") " pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:29.356212 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.356179 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/623dbb86-0376-46ba-8e6d-4d5b523000f9-cert" (OuterVolumeSpecName: "cert") pod "623dbb86-0376-46ba-8e6d-4d5b523000f9" (UID: "623dbb86-0376-46ba-8e6d-4d5b523000f9"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 17:02:29.356327 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.356230 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/623dbb86-0376-46ba-8e6d-4d5b523000f9-kube-api-access-dgcmw" (OuterVolumeSpecName: "kube-api-access-dgcmw") pod "623dbb86-0376-46ba-8e6d-4d5b523000f9" (UID: "623dbb86-0376-46ba-8e6d-4d5b523000f9"). InnerVolumeSpecName "kube-api-access-dgcmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:02:29.356367 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.356324 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/792f8ebc-1087-4773-8c31-6bff50977a02-cert\") pod \"kserve-controller-manager-d55957fc4-ptczb\" (UID: \"792f8ebc-1087-4773-8c31-6bff50977a02\") " pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:29.362155 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.362131 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w5cl\" (UniqueName: \"kubernetes.io/projected/792f8ebc-1087-4773-8c31-6bff50977a02-kube-api-access-4w5cl\") pod \"kserve-controller-manager-d55957fc4-ptczb\" (UID: \"792f8ebc-1087-4773-8c31-6bff50977a02\") " pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:29.454986 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.454879 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgcmw\" (UniqueName: \"kubernetes.io/projected/623dbb86-0376-46ba-8e6d-4d5b523000f9-kube-api-access-dgcmw\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 17:02:29.454986 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.454916 2560 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/623dbb86-0376-46ba-8e6d-4d5b523000f9-cert\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 17:02:29.488943 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.488916 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:29.614910 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.614884 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-ptczb"] Jul 16 17:02:29.617236 ip-10-0-130-64 kubenswrapper[2560]: W0716 17:02:29.617213 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792f8ebc_1087_4773_8c31_6bff50977a02.slice/crio-72aa0b7287d767b2977119d447cbc4f66c126446cc2613bb195bc7ca02ada403 WatchSource:0}: Error finding container 72aa0b7287d767b2977119d447cbc4f66c126446cc2613bb195bc7ca02ada403: Status 404 returned error can't find the container with id 72aa0b7287d767b2977119d447cbc4f66c126446cc2613bb195bc7ca02ada403 Jul 16 17:02:29.643859 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.643842 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" Jul 16 17:02:29.643995 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.643840 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-rc68t" event={"ID":"623dbb86-0376-46ba-8e6d-4d5b523000f9","Type":"ContainerDied","Data":"06cbbc8d1a79e3481e6509ffc27b55b3c51922b9dd630d49c59b3660a15ee56c"} Jul 16 17:02:29.644061 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.643994 2560 scope.go:117] "RemoveContainer" containerID="0859892f43b675dea19e4a0b74389ac00cbbfb5ea00b269bbd49319c08ff06c7" Jul 16 17:02:29.644966 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.644934 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" event={"ID":"792f8ebc-1087-4773-8c31-6bff50977a02","Type":"ContainerStarted","Data":"72aa0b7287d767b2977119d447cbc4f66c126446cc2613bb195bc7ca02ada403"} Jul 16 17:02:29.668403 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.668376 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-rc68t"] Jul 16 17:02:29.672802 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:29.672783 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-rc68t"] Jul 16 17:02:30.475358 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:30.475326 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" path="/var/lib/kubelet/pods/623dbb86-0376-46ba-8e6d-4d5b523000f9/volumes" Jul 16 17:02:31.660252 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:31.660215 2560 generic.go:356] "Generic (PLEG): container finished" podID="792f8ebc-1087-4773-8c31-6bff50977a02" containerID="649c1a600a5ed5e2b2d26b6c0d7ab8f7bdb8af4fedd74eacbec016374bb6d2cc" exitCode=1 Jul 16 17:02:31.660612 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:31.660277 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" event={"ID":"792f8ebc-1087-4773-8c31-6bff50977a02","Type":"ContainerDied","Data":"649c1a600a5ed5e2b2d26b6c0d7ab8f7bdb8af4fedd74eacbec016374bb6d2cc"} Jul 16 17:02:31.660612 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:31.660492 2560 scope.go:117] "RemoveContainer" containerID="649c1a600a5ed5e2b2d26b6c0d7ab8f7bdb8af4fedd74eacbec016374bb6d2cc" Jul 16 17:02:32.667196 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:32.667153 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" event={"ID":"792f8ebc-1087-4773-8c31-6bff50977a02","Type":"ContainerStarted","Data":"d0de0aa3dd23c30bc8daaef9bc1a69a688c99a1fdfce13a3c9d0203c1b335c6a"} Jul 16 17:02:32.667572 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:32.667247 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:32.685119 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:32.685072 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podStartSLOduration=1.360432198 podStartE2EDuration="3.685056772s" totalImagesPullingTime="2.324624574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:02:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:02:32.683911905 +0000 UTC m=+590.819526571" watchObservedRunningTime="2026-07-16 17:02:32.685056772 +0000 UTC m=+590.820671439" Jul 16 17:02:33.673257 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:33.673224 2560 generic.go:356] "Generic (PLEG): container finished" podID="792f8ebc-1087-4773-8c31-6bff50977a02" containerID="d0de0aa3dd23c30bc8daaef9bc1a69a688c99a1fdfce13a3c9d0203c1b335c6a" exitCode=1 Jul 16 17:02:33.673672 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:33.673260 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" event={"ID":"792f8ebc-1087-4773-8c31-6bff50977a02","Type":"ContainerDied","Data":"d0de0aa3dd23c30bc8daaef9bc1a69a688c99a1fdfce13a3c9d0203c1b335c6a"} Jul 16 17:02:33.673672 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:33.673321 2560 scope.go:117] "RemoveContainer" containerID="649c1a600a5ed5e2b2d26b6c0d7ab8f7bdb8af4fedd74eacbec016374bb6d2cc" Jul 16 17:02:33.673672 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:33.673509 2560 scope.go:117] "RemoveContainer" containerID="d0de0aa3dd23c30bc8daaef9bc1a69a688c99a1fdfce13a3c9d0203c1b335c6a" Jul 16 17:02:33.673785 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:33.673671 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:02:34.679141 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:34.679110 2560 scope.go:117] "RemoveContainer" containerID="d0de0aa3dd23c30bc8daaef9bc1a69a688c99a1fdfce13a3c9d0203c1b335c6a" Jul 16 17:02:34.679486 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:34.679275 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:02:39.489568 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:39.489535 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:39.489903 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:39.489819 2560 scope.go:117] "RemoveContainer" containerID="d0de0aa3dd23c30bc8daaef9bc1a69a688c99a1fdfce13a3c9d0203c1b335c6a" Jul 16 17:02:39.489988 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:39.489951 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:02:42.316839 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:42.316810 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 17:02:42.319078 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:42.319058 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 17:02:42.321538 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:42.321522 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 17:02:42.323569 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:42.323552 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 17:02:53.471004 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:53.470980 2560 scope.go:117] "RemoveContainer" containerID="d0de0aa3dd23c30bc8daaef9bc1a69a688c99a1fdfce13a3c9d0203c1b335c6a" Jul 16 17:02:54.763456 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:54.763429 2560 generic.go:356] "Generic (PLEG): container finished" podID="792f8ebc-1087-4773-8c31-6bff50977a02" containerID="ef0379a9b856798ff7053f0371382af0b024c37c7d3ddbaa91b633b7ac70ee5e" exitCode=1 Jul 16 17:02:54.763746 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:54.763483 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" event={"ID":"792f8ebc-1087-4773-8c31-6bff50977a02","Type":"ContainerDied","Data":"ef0379a9b856798ff7053f0371382af0b024c37c7d3ddbaa91b633b7ac70ee5e"} Jul 16 17:02:54.763746 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:54.763526 2560 scope.go:117] "RemoveContainer" containerID="d0de0aa3dd23c30bc8daaef9bc1a69a688c99a1fdfce13a3c9d0203c1b335c6a" Jul 16 17:02:54.763835 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:54.763803 2560 scope.go:117] "RemoveContainer" containerID="ef0379a9b856798ff7053f0371382af0b024c37c7d3ddbaa91b633b7ac70ee5e" Jul 16 17:02:54.764008 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:54.763985 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:02:57.668078 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:57.668043 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:57.668449 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:57.668361 2560 scope.go:117] "RemoveContainer" containerID="ef0379a9b856798ff7053f0371382af0b024c37c7d3ddbaa91b633b7ac70ee5e" Jul 16 17:02:57.668532 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:57.668513 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:02:59.489455 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:59.489421 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:02:59.489905 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:02:59.489697 2560 scope.go:117] "RemoveContainer" containerID="ef0379a9b856798ff7053f0371382af0b024c37c7d3ddbaa91b633b7ac70ee5e" Jul 16 17:02:59.489905 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:02:59.489837 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:03:13.470439 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:13.470366 2560 scope.go:117] "RemoveContainer" containerID="ef0379a9b856798ff7053f0371382af0b024c37c7d3ddbaa91b633b7ac70ee5e" Jul 16 17:03:13.470783 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:03:13.470523 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:03:24.470937 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:24.470909 2560 scope.go:117] "RemoveContainer" containerID="ef0379a9b856798ff7053f0371382af0b024c37c7d3ddbaa91b633b7ac70ee5e" Jul 16 17:03:25.890018 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:25.889988 2560 generic.go:356] "Generic (PLEG): container finished" podID="792f8ebc-1087-4773-8c31-6bff50977a02" containerID="22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c" exitCode=1 Jul 16 17:03:25.890441 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:25.890046 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" event={"ID":"792f8ebc-1087-4773-8c31-6bff50977a02","Type":"ContainerDied","Data":"22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c"} Jul 16 17:03:25.890441 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:25.890095 2560 scope.go:117] "RemoveContainer" containerID="ef0379a9b856798ff7053f0371382af0b024c37c7d3ddbaa91b633b7ac70ee5e" Jul 16 17:03:25.890441 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:25.890364 2560 scope.go:117] "RemoveContainer" containerID="22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c" Jul 16 17:03:25.890592 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:03:25.890548 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:03:27.667696 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:27.667643 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:03:27.668142 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:27.668123 2560 scope.go:117] "RemoveContainer" containerID="22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c" Jul 16 17:03:27.668364 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:03:27.668342 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:03:29.489250 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:29.489203 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:03:29.489642 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:29.489603 2560 scope.go:117] "RemoveContainer" containerID="22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c" Jul 16 17:03:29.489823 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:03:29.489802 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:03:43.470819 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:43.470783 2560 scope.go:117] "RemoveContainer" containerID="22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c" Jul 16 17:03:43.471392 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:03:43.471054 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:03:57.471115 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:03:57.471086 2560 scope.go:117] "RemoveContainer" containerID="22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c" Jul 16 17:03:57.471607 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:03:57.471260 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:04:11.470469 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:11.470441 2560 scope.go:117] "RemoveContainer" containerID="22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c" Jul 16 17:04:11.470891 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:11.470717 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:04:13.088320 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:13.088290 2560 generic.go:356] "Generic (PLEG): container finished" podID="792f8ebc-1087-4773-8c31-6bff50977a02" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" exitCode=1 Jul 16 17:04:13.088772 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:13.088357 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" event={"ID":"792f8ebc-1087-4773-8c31-6bff50977a02","Type":"ContainerDied","Data":"db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d"} Jul 16 17:04:13.088772 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:13.088413 2560 scope.go:117] "RemoveContainer" containerID="22138f365af0bb9d3d2c3c2aed4b6dad6600e4aa304146d71ba1a781c692910c" Jul 16 17:04:13.088772 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:13.088707 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:04:13.089013 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:04:13.088938 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:04:17.667306 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:17.667271 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:04:17.667747 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:17.667553 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:04:17.667747 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:04:17.667717 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:04:19.489920 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:19.489890 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:04:19.490328 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:19.490183 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:04:19.490370 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:04:19.490339 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:04:33.470620 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:33.470591 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:04:33.471124 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:04:33.470774 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:04:48.470402 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:04:48.470324 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:04:48.470842 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:04:48.470529 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:05:00.470402 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:00.470372 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:05:00.470822 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:05:00.470533 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:05:14.476077 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:14.471038 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:05:14.476077 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:05:14.471320 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:05:27.470370 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:27.470341 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:05:27.470918 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:05:27.470499 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:05:40.470607 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:40.470576 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:05:41.447806 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:41.447779 2560 generic.go:356] "Generic (PLEG): container finished" podID="792f8ebc-1087-4773-8c31-6bff50977a02" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" exitCode=1 Jul 16 17:05:41.447955 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:41.447834 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" event={"ID":"792f8ebc-1087-4773-8c31-6bff50977a02","Type":"ContainerDied","Data":"f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789"} Jul 16 17:05:41.447955 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:41.447881 2560 scope.go:117] "RemoveContainer" containerID="db52dee56c877f83880fc0b73730d0d9c04ce15bda4655056c667b2a3696e63d" Jul 16 17:05:41.448167 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:41.448150 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:05:41.448351 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:05:41.448330 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:05:42.668073 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:42.668043 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:05:42.668407 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:42.668347 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:05:42.668518 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:05:42.668495 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:05:49.489543 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:49.489514 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" Jul 16 17:05:49.490021 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:05:49.489820 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:05:49.490021 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:05:49.489994 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:06:02.472056 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:06:02.472024 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:06:02.472427 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:06:02.472172 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:06:15.471277 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:06:15.471198 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:06:15.471675 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:06:15.471369 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:06:27.470029 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:06:27.470003 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:06:27.470493 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:06:27.470150 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:06:39.471077 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:06:39.471040 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:06:39.471465 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:06:39.471246 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:06:53.470470 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:06:53.470442 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:06:53.470839 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:06:53.470592 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:07:07.470998 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:07.470946 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:07:07.471464 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:07:07.471155 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:07:18.471128 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:18.471099 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:07:18.471568 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:07:18.471269 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:07:30.470771 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:30.470738 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:07:30.471256 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:07:30.471009 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:07:34.677283 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677201 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kwtjz/must-gather-zgvbp"] Jul 16 17:07:34.677659 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677533 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.677659 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677545 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.677659 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677566 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.677659 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677572 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.677659 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677621 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.677659 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677632 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.678060 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677709 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.678060 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677721 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.678060 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.677775 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="623dbb86-0376-46ba-8e6d-4d5b523000f9" containerName="manager" Jul 16 17:07:34.680799 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.680785 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:07:34.683284 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.683261 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwtjz\"/\"openshift-service-ca.crt\"" Jul 16 17:07:34.683398 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.683280 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kwtjz\"/\"default-dockercfg-zst8s\"" Jul 16 17:07:34.683398 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.683284 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kwtjz\"/\"kube-root-ca.crt\"" Jul 16 17:07:34.710817 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.710794 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwtjz/must-gather-zgvbp"] Jul 16 17:07:34.774380 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.774354 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb597501-d8be-436e-8649-56a8c6f56bae-must-gather-output\") pod \"must-gather-zgvbp\" (UID: \"fb597501-d8be-436e-8649-56a8c6f56bae\") " pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:07:34.774471 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.774422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqzlt\" (UniqueName: \"kubernetes.io/projected/fb597501-d8be-436e-8649-56a8c6f56bae-kube-api-access-lqzlt\") pod \"must-gather-zgvbp\" (UID: \"fb597501-d8be-436e-8649-56a8c6f56bae\") " pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:07:34.875390 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.875369 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqzlt\" (UniqueName: \"kubernetes.io/projected/fb597501-d8be-436e-8649-56a8c6f56bae-kube-api-access-lqzlt\") pod \"must-gather-zgvbp\" (UID: \"fb597501-d8be-436e-8649-56a8c6f56bae\") " pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:07:34.875479 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.875399 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb597501-d8be-436e-8649-56a8c6f56bae-must-gather-output\") pod \"must-gather-zgvbp\" (UID: \"fb597501-d8be-436e-8649-56a8c6f56bae\") " pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:07:34.875691 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.875660 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb597501-d8be-436e-8649-56a8c6f56bae-must-gather-output\") pod \"must-gather-zgvbp\" (UID: \"fb597501-d8be-436e-8649-56a8c6f56bae\") " pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:07:34.882855 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:34.882830 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqzlt\" (UniqueName: \"kubernetes.io/projected/fb597501-d8be-436e-8649-56a8c6f56bae-kube-api-access-lqzlt\") pod \"must-gather-zgvbp\" (UID: \"fb597501-d8be-436e-8649-56a8c6f56bae\") " pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:07:35.002634 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:35.002575 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:07:35.133563 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:35.133539 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kwtjz/must-gather-zgvbp"] Jul 16 17:07:35.135865 ip-10-0-130-64 kubenswrapper[2560]: W0716 17:07:35.135836 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb597501_d8be_436e_8649_56a8c6f56bae.slice/crio-4d21a05d5d9967a29cc17460977f6aaf7f72b0e1fb742ea96e3a3f056a5e6343 WatchSource:0}: Error finding container 4d21a05d5d9967a29cc17460977f6aaf7f72b0e1fb742ea96e3a3f056a5e6343: Status 404 returned error can't find the container with id 4d21a05d5d9967a29cc17460977f6aaf7f72b0e1fb742ea96e3a3f056a5e6343 Jul 16 17:07:35.934443 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:35.934406 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" event={"ID":"fb597501-d8be-436e-8649-56a8c6f56bae","Type":"ContainerStarted","Data":"4d21a05d5d9967a29cc17460977f6aaf7f72b0e1fb742ea96e3a3f056a5e6343"} Jul 16 17:07:41.968824 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:41.968786 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" event={"ID":"fb597501-d8be-436e-8649-56a8c6f56bae","Type":"ContainerStarted","Data":"2c80364636a53da6ea9b4ab798a8e0f35dc794284e510d55fb02dd1e19c78919"} Jul 16 17:07:41.968824 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:41.968828 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" event={"ID":"fb597501-d8be-436e-8649-56a8c6f56bae","Type":"ContainerStarted","Data":"252a4d1f5d0f69e49762c966452c9e57deba500a19bd75bbae0a8607b6a9d710"} Jul 16 17:07:41.997393 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:41.997342 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" podStartSLOduration=2.061132221 podStartE2EDuration="7.997324457s" totalImagesPullingTime="5.936192236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:07:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:07:41.995265913 +0000 UTC m=+900.130880584" watchObservedRunningTime="2026-07-16 17:07:41.997324457 +0000 UTC m=+900.132939124" Jul 16 17:07:42.351094 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:42.351064 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 17:07:42.351691 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:42.351666 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 17:07:42.356453 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:42.356430 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 17:07:42.356837 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:42.356818 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 17:07:45.471084 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:45.471054 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:07:45.471450 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:07:45.471273 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:07:54.028074 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:54.028045 2560 generic.go:356] "Generic (PLEG): container finished" podID="fb597501-d8be-436e-8649-56a8c6f56bae" containerID="252a4d1f5d0f69e49762c966452c9e57deba500a19bd75bbae0a8607b6a9d710" exitCode=0 Jul 16 17:07:54.028493 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:54.028123 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" event={"ID":"fb597501-d8be-436e-8649-56a8c6f56bae","Type":"ContainerDied","Data":"252a4d1f5d0f69e49762c966452c9e57deba500a19bd75bbae0a8607b6a9d710"} Jul 16 17:07:54.028493 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:54.028416 2560 scope.go:117] "RemoveContainer" containerID="252a4d1f5d0f69e49762c966452c9e57deba500a19bd75bbae0a8607b6a9d710" Jul 16 17:07:54.521977 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:54.521937 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kwtjz_must-gather-zgvbp_fb597501-d8be-436e-8649-56a8c6f56bae/gather/0.log" Jul 16 17:07:58.562594 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:58.562541 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7bhhh_91fc1288-02fd-4414-916c-734288b37cc6/global-pull-secret-syncer/0.log" Jul 16 17:07:58.687499 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:58.687465 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qd6k7_8170ec8a-46c8-4685-b342-bf12c1919111/konnectivity-agent/0.log" Jul 16 17:07:58.719394 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:58.719371 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-64.ec2.internal_d7195bd60e889079b94ab3446c3676a9/haproxy/0.log" Jul 16 17:07:59.470183 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:59.470158 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:07:59.470339 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:07:59.470299 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:07:59.864497 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:59.864467 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-kwtjz/must-gather-zgvbp"] Jul 16 17:07:59.864863 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:59.864625 2560 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" containerName="copy" containerID="cri-o://2c80364636a53da6ea9b4ab798a8e0f35dc794284e510d55fb02dd1e19c78919" gracePeriod=2 Jul 16 17:07:59.871923 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:07:59.871899 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-kwtjz/must-gather-zgvbp"] Jul 16 17:07:59.875998 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:07:59.875940 2560 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"fb597501-d8be-436e-8649-56a8c6f56bae\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-kwtjz\"/\"must-gather-zgvbp\": pods \"must-gather-zgvbp\" not found" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:08:00.056194 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.056168 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kwtjz_must-gather-zgvbp_fb597501-d8be-436e-8649-56a8c6f56bae/copy/0.log" Jul 16 17:08:00.056559 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.056536 2560 generic.go:356] "Generic (PLEG): container finished" podID="fb597501-d8be-436e-8649-56a8c6f56bae" containerID="2c80364636a53da6ea9b4ab798a8e0f35dc794284e510d55fb02dd1e19c78919" exitCode=143 Jul 16 17:08:00.087791 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.087774 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kwtjz_must-gather-zgvbp_fb597501-d8be-436e-8649-56a8c6f56bae/copy/0.log" Jul 16 17:08:00.089380 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.089364 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:08:00.091100 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:08:00.091077 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-zgvbp\" is forbidden: User \"system:node:ip-10-0-130-64.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-kwtjz\": no relationship found between node 'ip-10-0-130-64.ec2.internal' and this object" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:08:00.170591 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.170545 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb597501-d8be-436e-8649-56a8c6f56bae-must-gather-output\") pod \"fb597501-d8be-436e-8649-56a8c6f56bae\" (UID: \"fb597501-d8be-436e-8649-56a8c6f56bae\") " Jul 16 17:08:00.170661 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.170589 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqzlt\" (UniqueName: \"kubernetes.io/projected/fb597501-d8be-436e-8649-56a8c6f56bae-kube-api-access-lqzlt\") pod \"fb597501-d8be-436e-8649-56a8c6f56bae\" (UID: \"fb597501-d8be-436e-8649-56a8c6f56bae\") " Jul 16 17:08:00.170950 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.170924 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb597501-d8be-436e-8649-56a8c6f56bae-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "fb597501-d8be-436e-8649-56a8c6f56bae" (UID: "fb597501-d8be-436e-8649-56a8c6f56bae"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 17:08:00.172538 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.172514 2560 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb597501-d8be-436e-8649-56a8c6f56bae-kube-api-access-lqzlt" (OuterVolumeSpecName: "kube-api-access-lqzlt") pod "fb597501-d8be-436e-8649-56a8c6f56bae" (UID: "fb597501-d8be-436e-8649-56a8c6f56bae"). InnerVolumeSpecName "kube-api-access-lqzlt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 17:08:00.271857 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.271834 2560 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/fb597501-d8be-436e-8649-56a8c6f56bae-must-gather-output\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 17:08:00.271938 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.271860 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqzlt\" (UniqueName: \"kubernetes.io/projected/fb597501-d8be-436e-8649-56a8c6f56bae-kube-api-access-lqzlt\") on node \"ip-10-0-130-64.ec2.internal\" DevicePath \"\"" Jul 16 17:08:00.481101 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:00.481039 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" path="/var/lib/kubelet/pods/fb597501-d8be-436e-8649-56a8c6f56bae/volumes" Jul 16 17:08:01.061683 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:01.061661 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-kwtjz_must-gather-zgvbp_fb597501-d8be-436e-8649-56a8c6f56bae/copy/0.log" Jul 16 17:08:01.062111 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:01.062055 2560 scope.go:117] "RemoveContainer" containerID="2c80364636a53da6ea9b4ab798a8e0f35dc794284e510d55fb02dd1e19c78919" Jul 16 17:08:01.062111 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:01.062100 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kwtjz/must-gather-zgvbp" Jul 16 17:08:01.070813 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:01.070790 2560 scope.go:117] "RemoveContainer" containerID="252a4d1f5d0f69e49762c966452c9e57deba500a19bd75bbae0a8607b6a9d710" Jul 16 17:08:02.509410 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:02.509383 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5979b877f4-5mxmp_a6de1eac-87fe-47ec-ad8a-6de919292e9a/metrics-server/0.log" Jul 16 17:08:02.619276 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:02.619250 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gmps7_0c522721-072e-4956-95c7-a9fd96dd99c8/node-exporter/0.log" Jul 16 17:08:02.668056 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:02.668028 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gmps7_0c522721-072e-4956-95c7-a9fd96dd99c8/kube-rbac-proxy/0.log" Jul 16 17:08:02.699525 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:02.699503 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gmps7_0c522721-072e-4956-95c7-a9fd96dd99c8/init-textfile/0.log" Jul 16 17:08:03.506211 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.506185 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bb47794f-qdm9z_3bd558c8-f9b6-479d-9610-3f95a2b5aaf0/telemeter-client/0.log" Jul 16 17:08:03.540774 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.540744 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bb47794f-qdm9z_3bd558c8-f9b6-479d-9610-3f95a2b5aaf0/reload/0.log" Jul 16 17:08:03.567160 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.567140 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55bb47794f-qdm9z_3bd558c8-f9b6-479d-9610-3f95a2b5aaf0/kube-rbac-proxy/0.log" Jul 16 17:08:03.608191 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.608168 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf488698c-jqxpp_c28fca72-1bd5-4a0f-8407-c576a4d2eaa3/thanos-query/0.log" Jul 16 17:08:03.638015 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.637996 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf488698c-jqxpp_c28fca72-1bd5-4a0f-8407-c576a4d2eaa3/kube-rbac-proxy-web/0.log" Jul 16 17:08:03.677853 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.677829 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf488698c-jqxpp_c28fca72-1bd5-4a0f-8407-c576a4d2eaa3/kube-rbac-proxy/0.log" Jul 16 17:08:03.710543 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.710524 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf488698c-jqxpp_c28fca72-1bd5-4a0f-8407-c576a4d2eaa3/prom-label-proxy/0.log" Jul 16 17:08:03.741740 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.741718 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf488698c-jqxpp_c28fca72-1bd5-4a0f-8407-c576a4d2eaa3/kube-rbac-proxy-rules/0.log" Jul 16 17:08:03.769943 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:03.769894 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-bf488698c-jqxpp_c28fca72-1bd5-4a0f-8407-c576a4d2eaa3/kube-rbac-proxy-metrics/0.log" Jul 16 17:08:05.780562 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:05.780535 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/2.log" Jul 16 17:08:05.787865 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:05.787842 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-zl55z_eb1b82b0-9f6a-46f8-9e3a-506282b2be6e/console-operator/3.log" Jul 16 17:08:06.869151 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:06.869121 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-d2d9j_fb803c30-7fc8-4380-a7c9-4810eb56aef6/volume-data-source-validator/0.log" Jul 16 17:08:07.327180 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.327112 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v"] Jul 16 17:08:07.327402 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.327391 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" containerName="gather" Jul 16 17:08:07.327446 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.327405 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" containerName="gather" Jul 16 17:08:07.327446 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.327431 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" containerName="copy" Jul 16 17:08:07.327446 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.327436 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" containerName="copy" Jul 16 17:08:07.327531 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.327479 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" containerName="gather" Jul 16 17:08:07.327531 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.327485 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb597501-d8be-436e-8649-56a8c6f56bae" containerName="copy" Jul 16 17:08:07.330733 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.330718 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.333455 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.333438 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tp7ql\"/\"kube-root-ca.crt\"" Jul 16 17:08:07.334128 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.334110 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tp7ql\"/\"openshift-service-ca.crt\"" Jul 16 17:08:07.334226 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.334128 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tp7ql\"/\"default-dockercfg-cf5js\"" Jul 16 17:08:07.337301 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.337267 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v"] Jul 16 17:08:07.421548 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.421521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-podres\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.421673 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.421554 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmsn4\" (UniqueName: \"kubernetes.io/projected/c064778d-d233-42b3-83e0-b53e26b6dac8-kube-api-access-fmsn4\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.421673 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.421646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-proc\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.421673 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.421670 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-sys\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.421767 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.421690 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-lib-modules\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522488 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522465 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-proc\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522488 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522490 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-sys\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522652 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522509 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-lib-modules\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522652 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522544 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-podres\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522652 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522565 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmsn4\" (UniqueName: \"kubernetes.io/projected/c064778d-d233-42b3-83e0-b53e26b6dac8-kube-api-access-fmsn4\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522652 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522586 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-proc\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522652 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522594 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-sys\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522652 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522649 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-podres\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.522825 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.522663 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c064778d-d233-42b3-83e0-b53e26b6dac8-lib-modules\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.535226 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.535204 2560 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmsn4\" (UniqueName: \"kubernetes.io/projected/c064778d-d233-42b3-83e0-b53e26b6dac8-kube-api-access-fmsn4\") pod \"perf-node-gather-daemonset-ml94v\" (UID: \"c064778d-d233-42b3-83e0-b53e26b6dac8\") " pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.640836 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.640820 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:07.764613 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:07.764588 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v"] Jul 16 17:08:07.767089 ip-10-0-130-64 kubenswrapper[2560]: W0716 17:08:07.767062 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc064778d_d233_42b3_83e0_b53e26b6dac8.slice/crio-74826c52948970b18f0468dac8bb432d102b62bf268565676fc001436a41d5a0 WatchSource:0}: Error finding container 74826c52948970b18f0468dac8bb432d102b62bf268565676fc001436a41d5a0: Status 404 returned error can't find the container with id 74826c52948970b18f0468dac8bb432d102b62bf268565676fc001436a41d5a0 Jul 16 17:08:08.031866 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.031843 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqgfl_d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce/dns/0.log" Jul 16 17:08:08.060112 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.060096 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tqgfl_d1be16d2-e82e-4b98-b3c2-6a206e9cd2ce/kube-rbac-proxy/0.log" Jul 16 17:08:08.099065 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.099034 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" event={"ID":"c064778d-d233-42b3-83e0-b53e26b6dac8","Type":"ContainerStarted","Data":"92ccc0822656ccbde4d30b6b7c2a10752a08cddb7a1acde8df8d8d4ae87a41c2"} Jul 16 17:08:08.099204 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.099159 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:08.099204 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.099177 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" event={"ID":"c064778d-d233-42b3-83e0-b53e26b6dac8","Type":"ContainerStarted","Data":"74826c52948970b18f0468dac8bb432d102b62bf268565676fc001436a41d5a0"} Jul 16 17:08:08.121917 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.121881 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" podStartSLOduration=1.121864155 podStartE2EDuration="1.121864155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:08:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:08:08.121782976 +0000 UTC m=+926.257397643" watchObservedRunningTime="2026-07-16 17:08:08.121864155 +0000 UTC m=+926.257478875" Jul 16 17:08:08.232375 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.232316 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pntcv_7e54a8a9-b9fe-4d40-b68f-2e1e9222f1ed/dns-node-resolver/0.log" Jul 16 17:08:08.785238 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.785191 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5bdd5b6d6-f9vzd_d7f0faec-c7c1-4013-8495-72d8eb44dcb2/registry/0.log" Jul 16 17:08:08.884473 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:08.884449 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vws6z_6f0efdf0-3149-4aa4-b377-9a8a5c804294/node-ca/0.log" Jul 16 17:08:10.130007 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:10.129952 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9c82j_6b6a1bb0-b2e2-4291-a899-abe969c0aa7c/serve-healthcheck-canary/0.log" Jul 16 17:08:10.706542 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:10.706514 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67sxj_cf0a3ccc-c694-439a-867b-99af8c4aa444/kube-rbac-proxy/0.log" Jul 16 17:08:10.735468 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:10.735443 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67sxj_cf0a3ccc-c694-439a-867b-99af8c4aa444/exporter/0.log" Jul 16 17:08:10.764338 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:10.764318 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-67sxj_cf0a3ccc-c694-439a-867b-99af8c4aa444/extractor/0.log" Jul 16 17:08:11.470351 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:11.470327 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789" Jul 16 17:08:11.470730 ip-10-0-130-64 kubenswrapper[2560]: E0716 17:08:11.470476 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-ptczb_kserve(792f8ebc-1087-4773-8c31-6bff50977a02)\"" pod="kserve/kserve-controller-manager-d55957fc4-ptczb" podUID="792f8ebc-1087-4773-8c31-6bff50977a02" Jul 16 17:08:12.944076 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:12.944053 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-d55957fc4-ptczb_792f8ebc-1087-4773-8c31-6bff50977a02/manager/5.log" Jul 16 17:08:12.946526 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:12.946504 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-d55957fc4-ptczb_792f8ebc-1087-4773-8c31-6bff50977a02/manager/5.log" Jul 16 17:08:13.007421 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:13.007402 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-6thk8_2d784a02-86cf-4a65-91b9-7c80c8b808dd/seaweedfs/0.log" Jul 16 17:08:14.115209 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:14.115182 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tp7ql/perf-node-gather-daemonset-ml94v" Jul 16 17:08:17.614759 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:17.614728 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-sl7c6_737bf6d9-a4c3-446f-905b-8313b49b0a07/migrator/0.log" Jul 16 17:08:17.639010 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:17.638988 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-sl7c6_737bf6d9-a4c3-446f-905b-8313b49b0a07/graceful-termination/0.log" Jul 16 17:08:18.040524 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:18.040440 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bbvrf_89876d54-0694-44d2-9d7e-4370eb79f0dc/kube-storage-version-migrator-operator/1.log" Jul 16 17:08:18.041834 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:18.041814 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-bbvrf_89876d54-0694-44d2-9d7e-4370eb79f0dc/kube-storage-version-migrator-operator/0.log" Jul 16 17:08:19.385668 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:19.385637 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5885_2b94d035-84c9-40a7-9b57-60a91d278a3b/kube-multus-additional-cni-plugins/0.log" Jul 16 17:08:19.416776 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:19.416755 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5885_2b94d035-84c9-40a7-9b57-60a91d278a3b/egress-router-binary-copy/0.log" Jul 16 17:08:19.447659 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:19.447638 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5885_2b94d035-84c9-40a7-9b57-60a91d278a3b/cni-plugins/0.log" Jul 16 17:08:19.477607 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:19.477586 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5885_2b94d035-84c9-40a7-9b57-60a91d278a3b/bond-cni-plugin/0.log" Jul 16 17:08:19.505832 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:19.505810 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5885_2b94d035-84c9-40a7-9b57-60a91d278a3b/routeoverride-cni/0.log" Jul 16 17:08:19.532559 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:19.532541 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5885_2b94d035-84c9-40a7-9b57-60a91d278a3b/whereabouts-cni-bincopy/0.log" Jul 16 17:08:19.556486 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:19.556471 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l5885_2b94d035-84c9-40a7-9b57-60a91d278a3b/whereabouts-cni/0.log" Jul 16 17:08:19.808087 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:19.808011 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cjtlh_f339eebd-e2df-404a-9090-c02dfd645115/kube-multus/0.log" Jul 16 17:08:20.048700 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:20.048673 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mxtg5_b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e/network-metrics-daemon/0.log" Jul 16 17:08:20.076230 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:20.076173 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mxtg5_b5f61b52-2c4d-4d59-a71b-ca54dcb8e35e/kube-rbac-proxy/0.log" Jul 16 17:08:21.005605 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.005574 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-controller/0.log" Jul 16 17:08:21.027311 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.027288 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/0.log" Jul 16 17:08:21.027430 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.027324 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovn-acl-logging/1.log" Jul 16 17:08:21.054381 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.054355 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/kube-rbac-proxy-node/0.log" Jul 16 17:08:21.084444 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.084424 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 17:08:21.103912 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.103882 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/northd/0.log" Jul 16 17:08:21.129036 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.129012 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/nbdb/0.log" Jul 16 17:08:21.162486 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.162462 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/sbdb/0.log" Jul 16 17:08:21.222932 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:21.222910 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gwnpv_605f0508-1200-4b51-abff-682d4a6ba04a/ovnkube-controller/0.log" Jul 16 17:08:22.936434 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:22.936407 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-dc6m6_6ecb78ea-94cb-405c-8b35-4426b0ff1be2/check-endpoints/0.log" Jul 16 17:08:23.007548 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:23.007518 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-m625q_47f541e4-4e7e-42d8-8532-3e922bd9bd0d/network-check-target-container/0.log" Jul 16 17:08:23.470295 ip-10-0-130-64 kubenswrapper[2560]: I0716 17:08:23.470269 2560 scope.go:117] "RemoveContainer" containerID="f0258f88ef397301a6e29fbaa91e3d1fd5859da3e4607944f033ce3796cf2789"