Jul 07 16:44:16.129872 ip-10-0-137-198 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 16:44:16.129884 ip-10-0-137-198 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 16:44:16.129891 ip-10-0-137-198 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 16:44:16.130102 ip-10-0-137-198 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 16:44:26.241211 ip-10-0-137-198 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 16:44:26.241225 ip-10-0-137-198 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5792aa087e9e4830a9b9e964e848e888 -- Jul 07 16:46:00.097948 ip-10-0-137-198 systemd[1]: Starting Kubernetes Kubelet... Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.514209 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519130 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519142 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519146 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519149 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519152 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519155 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519158 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:00.521123 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519161 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519164 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519167 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519169 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519171 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519174 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519176 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519180 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519186 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519189 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519192 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519195 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519205 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519208 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519211 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519214 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519216 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519220 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519222 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519225 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:00.525006 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519228 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519231 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519233 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519236 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519238 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519241 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519244 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519246 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519249 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519253 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519256 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519258 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519261 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519264 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519266 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519269 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519272 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519274 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519277 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:00.547206 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519279 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519282 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519284 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519287 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519289 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519292 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519295 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519297 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519300 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519302 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519305 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519308 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519311 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519320 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519323 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519327 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519329 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519332 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519335 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519337 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:00.551188 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519339 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519343 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519346 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519348 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519351 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519355 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519358 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519361 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519364 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519366 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519369 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519372 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519375 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519378 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519381 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519384 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519388 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519391 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:00.554911 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519394 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519397 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519400 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519402 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519405 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519407 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519409 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519412 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519414 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519417 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519419 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519421 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519424 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519426 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.519429 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520120 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520126 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520129 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520132 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520135 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:00.557831 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520138 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520141 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520143 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520146 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520149 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520152 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520155 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520157 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520160 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520162 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520165 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520168 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520171 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520174 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520178 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520180 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520183 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520186 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520190 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:00.561473 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520194 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520196 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520199 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520202 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520204 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520207 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520209 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520212 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520216 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520218 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520221 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520224 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520226 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520229 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520232 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520234 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520237 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520239 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520242 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520245 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:00.573690 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520247 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520250 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520252 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520255 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520258 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520261 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520264 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520266 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520269 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520272 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520275 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520278 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520280 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520283 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520286 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520288 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520290 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520293 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520296 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520298 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:00.576981 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520301 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520304 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520307 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520310 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520312 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520315 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520318 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520320 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520328 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520330 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520333 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520335 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520338 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520341 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520343 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520346 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520350 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520353 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520356 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:00.580334 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520358 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520361 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520365 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520368 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520372 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520375 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520378 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520381 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520384 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520387 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520390 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520392 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520395 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520397 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520400 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520403 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520787 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520792 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520795 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520798 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:00.585021 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520800 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520805 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520807 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520810 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520814 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520818 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520820 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520822 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520825 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520828 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520830 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520833 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520836 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520838 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520842 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520844 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520847 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520849 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520852 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:00.592657 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520855 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520857 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520860 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520862 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520865 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520867 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520870 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520872 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520875 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520877 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520880 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520883 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520885 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520888 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520893 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520897 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520900 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520903 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520906 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:00.597594 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520909 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520911 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520914 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520918 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520920 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520923 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520925 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520928 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520930 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520934 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520937 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520939 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520942 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520945 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520947 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520950 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520952 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520955 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520957 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520960 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:00.605611 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520963 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520965 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520968 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520971 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520973 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520976 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520979 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520983 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520986 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520988 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520991 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520993 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520996 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.520998 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521001 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521003 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521006 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521009 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521011 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521014 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:00.610839 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521016 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:00.608689 ip-10-0-137-198 systemd[1]: Started Kubernetes Kubelet. Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521019 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521022 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521025 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521028 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521030 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521032 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521035 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521037 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521040 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521042 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521045 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521047 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521050 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521052 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521056 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521059 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521134 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521141 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521147 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 16:46:00.624427 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521151 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521156 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521159 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521163 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521166 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521170 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521173 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521177 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521180 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521183 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521186 2572 flags.go:64] FLAG: --cgroup-root="" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521189 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521192 2572 flags.go:64] FLAG: --client-ca-file="" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521195 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521197 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521202 2572 flags.go:64] FLAG: --cluster-domain="" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521205 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521208 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521211 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521214 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521217 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521220 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521223 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 16:46:00.629794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521226 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521229 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521232 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521235 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521238 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521241 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521245 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521248 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521253 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521256 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521259 2572 flags.go:64] FLAG: --enable-server="true" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521261 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521265 2572 flags.go:64] FLAG: --event-burst="100" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521268 2572 flags.go:64] FLAG: --event-qps="50" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521271 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521274 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521277 2572 flags.go:64] FLAG: --eviction-hard="" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521281 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521283 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521286 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521289 2572 flags.go:64] FLAG: --eviction-soft="" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521292 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521295 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521298 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521301 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 16:46:00.640967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521304 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521307 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521310 2572 flags.go:64] FLAG: --feature-gates="" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521314 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521317 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521320 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521323 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521325 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521328 2572 flags.go:64] FLAG: --help="false" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521331 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-137-198.ec2.internal" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521334 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521337 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521340 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521343 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521347 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521350 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521353 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521357 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521360 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521363 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521366 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521368 2572 flags.go:64] FLAG: --kube-reserved="" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521371 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521374 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 16:46:00.646717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521377 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521379 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521382 2572 flags.go:64] FLAG: --lock-file="" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521385 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521388 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521391 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521396 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521398 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521401 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521404 2572 flags.go:64] FLAG: --logging-format="text" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521407 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521411 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521413 2572 flags.go:64] FLAG: --manifest-url="" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521416 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521420 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521423 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521427 2572 flags.go:64] FLAG: --max-pods="110" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521430 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521432 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521435 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521438 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521441 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521444 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521448 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521455 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 16:46:00.802953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521458 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521462 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521465 2572 flags.go:64] FLAG: --pod-cidr="" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521468 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521473 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521476 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521479 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521482 2572 flags.go:64] FLAG: --port="10250" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521485 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521488 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02f02e61de174dce8" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521491 2572 flags.go:64] FLAG: --qos-reserved="" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521494 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521497 2572 flags.go:64] FLAG: --register-node="true" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521500 2572 flags.go:64] FLAG: --register-with-taints="" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521503 2572 flags.go:64] FLAG: --registry-burst="10" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521506 2572 flags.go:64] FLAG: --registry-qps="5" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521509 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521512 2572 flags.go:64] FLAG: --reserved-memory="" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521516 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521518 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521521 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521524 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521527 2572 flags.go:64] FLAG: --runonce="false" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521529 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521532 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 16:46:00.821770 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521535 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521538 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521540 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521543 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521546 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521549 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521553 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521556 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521561 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521564 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521567 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521570 2572 flags.go:64] FLAG: --system-cgroups="" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521572 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521577 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521580 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521583 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521587 2572 flags.go:64] FLAG: --tls-min-version="" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521589 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521592 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521595 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521598 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521601 2572 flags.go:64] FLAG: --v="2" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521605 2572 flags.go:64] FLAG: --version="false" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521608 2572 flags.go:64] FLAG: --vmodule="" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521612 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 16:46:00.826213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.521616 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521740 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521744 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521748 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521750 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521753 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521755 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521758 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521761 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521764 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521766 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521770 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521773 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521778 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521781 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521786 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521788 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521791 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521794 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521796 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:00.827860 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521799 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521801 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521804 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521806 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521809 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521811 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521814 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521816 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521818 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521821 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521823 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521826 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521828 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521831 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521834 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521836 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521839 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521842 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521844 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521847 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:00.829886 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521849 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521852 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521854 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521857 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521860 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521863 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521866 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521870 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521872 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521875 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521877 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521880 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521882 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521885 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521887 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521890 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521892 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521895 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521897 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521899 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:00.830658 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521902 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521904 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521908 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521912 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521914 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521917 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521920 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521922 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521925 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521927 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521929 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521932 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521934 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521937 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521939 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521942 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521944 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521948 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521950 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:00.833928 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521954 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521956 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521959 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521961 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521964 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521967 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521969 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521973 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521976 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521979 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521982 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521985 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521988 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521991 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521993 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521996 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.521999 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.522002 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.522004 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:00.835095 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.522007 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.522010 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.522820 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.531855 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.531870 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.532781 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.532788 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532892 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532897 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532901 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532904 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532907 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532911 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532914 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532917 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:00.837126 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532923 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532926 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532929 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532931 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532934 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532937 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532940 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532943 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532945 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532948 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532950 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532953 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532956 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532961 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532964 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532967 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532970 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532973 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532977 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532980 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:00.837948 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532983 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532986 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532989 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532991 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.532995 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533004 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533008 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533011 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533013 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533016 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533019 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533022 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533025 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533027 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533030 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533033 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533037 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533043 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533047 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:00.839163 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533050 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533052 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533055 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533058 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533060 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533063 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533066 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533069 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533071 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533074 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533077 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533082 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533086 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533088 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533091 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533094 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533097 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533100 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533103 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533106 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:00.839960 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533108 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533111 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533114 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533120 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533124 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533127 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533130 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533132 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533135 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533138 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533141 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533144 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533146 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533149 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533152 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533161 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533163 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533166 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533169 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:00.841584 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533172 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533175 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533181 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533183 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533186 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533189 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533192 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533196 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533203 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533206 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533209 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533212 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533215 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.533220 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:46:00.842432 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533435 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533442 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533446 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533449 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533452 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533454 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533457 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533461 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533465 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533468 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533470 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533473 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533479 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533482 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533487 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533490 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533492 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533495 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533499 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533501 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:46:00.844023 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533506 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533508 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533511 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533514 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533516 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533519 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533525 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533527 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533530 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533533 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533536 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533538 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533541 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533543 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533546 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533549 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533551 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533554 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533556 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:46:00.844847 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533562 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533564 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533567 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533569 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533572 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533574 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533577 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533580 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533582 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533585 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533589 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533593 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533599 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533603 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533606 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533609 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533612 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533615 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533617 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:46:00.846073 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533621 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533623 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533626 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533629 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533631 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533637 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533639 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533642 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533645 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533647 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533650 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533653 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533656 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533658 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533661 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533663 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533684 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533689 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533693 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533696 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:46:00.846884 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533698 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533701 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533704 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533707 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533709 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533712 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533716 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533719 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533722 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533724 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533729 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533732 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533734 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533737 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533740 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533743 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533746 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533748 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533751 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:46:00.847705 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533754 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:00.533758 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.533764 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.533913 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.536548 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.538226 2572 server.go:1019] "Starting client certificate rotation" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.538331 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.538437 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.547588 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.551027 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.569910 2572 log.go:25] "Validated CRI v1 runtime API" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.572630 2572 log.go:25] "Validated CRI v1 image API" Jul 07 16:46:00.848495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.573508 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 16:46:00.848926 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.577780 2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9bc58fc2-7f9e-4883-84c4-ce26a83df18f:/dev/nvme0n1p4 c70a6022-cef9-4bb4-a935-88165410809b:/dev/nvme0n1p3] Jul 07 16:46:00.848926 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.577794 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 16:46:00.848926 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.584598 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.584443 2572 manager.go:216] Machine: {Timestamp:2026-07-07 16:46:00.582229067 +0000 UTC m=+0.376584200 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3083184 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f8e6576348bf85c3327e0320d50c SystemUUID:ec24f8e6-5763-48bf-85c3-327e0320d50c BootID:5792aa08-7e9e-4830-a9b9-e964e848e888 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e0:04:db:64:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e0:04:db:64:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:78:f9:13:0c:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.584764 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.584895 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.586022 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.586048 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-198.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.587535 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.587546 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.587554 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.588283 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.590008 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.593398 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.593534 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.593567 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.593586 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.593608 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.593619 2572 kubelet.go:398] "Adding apiserver pod source" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.593629 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 16:46:00.850101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.594324 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.594356 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.596793 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.599481 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.599508 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.600874 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.601514 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602103 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602117 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602132 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602143 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602157 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602166 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602178 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602187 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602206 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.602215 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.604020 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.604048 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.605937 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f65mc" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.606877 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-198.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.607749 2572 server.go:1268] "Started kubelet" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.607805 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.608086 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.608175 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.609648 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.609647 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.611441 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-198.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.611463 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.616130 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-f65mc" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.616852 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.618131 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-198.ec2.internal.18c00fbddf43ec8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-198.ec2.internal,UID:ip-10-0-137-198.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-198.ec2.internal,},FirstTimestamp:2026-07-07 16:46:00.607722637 +0000 UTC m=+0.402077769,LastTimestamp:2026-07-07 16:46:00.607722637 +0000 UTC m=+0.402077769,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-198.ec2.internal,}" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.620869 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.621180 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.621461 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622329 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622536 2572 factory.go:153] Registering CRI-O factory Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622549 2572 factory.go:223] Registration of the crio container factory successfully Jul 07 16:46:00.850973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622600 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622609 2572 factory.go:55] Registering systemd factory Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622617 2572 factory.go:223] Registration of the systemd container factory successfully Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622637 2572 factory.go:103] Registering Raw factory Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622649 2572 manager.go:1196] Started watching for new ooms in manager Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622906 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.622924 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.623031 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.623037 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.624660 2572 manager.go:349] Starting recovery of all containers Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.631086 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.641519 2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-198.ec2.internal\" not found" node="ip-10-0-137-198.ec2.internal" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.650079 2572 manager.go:354] Recovery completed Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.657971 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.659781 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.659810 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.659823 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.660358 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.660371 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.660369 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.660438 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.661046 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.661072 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.661083 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.661923 2572 policy_none.go:49] "None policy: Start" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.661936 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.661946 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.663217 2572 policy_none.go:47] "Start" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.696268 2572 manager.go:337] "Starting Device Plugin manager" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.696298 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.696306 2572 server.go:87] "Starting device plugin registration server" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.696550 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.696564 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.696659 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.696751 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.696760 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.698830 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.698890 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.743199 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.744453 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.744484 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.744508 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.744545 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.747384 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.797375 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.798294 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.798323 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.798333 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.798358 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-198.ec2.internal" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:00.806620 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-198.ec2.internal" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.806638 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-198.ec2.internal\": node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:00.855372 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:00.822869 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:02.858380 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:02.858357 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:02.858720 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.858396 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal"] Jul 07 16:46:02.858720 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.858482 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:02.858720 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.858409 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 16:46:02.858720 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.858673 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:46:02.858720 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.858686 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:46:02.859656 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.859640 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:02.859730 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.859675 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:02.859730 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.859691 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:02.861018 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861002 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:02.861138 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861107 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:02.861188 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861142 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:02.861779 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861758 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:02.861878 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861785 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:02.861878 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861794 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:02.861878 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861847 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:02.861878 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861866 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:02.861878 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.861876 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:02.862874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.862814 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" Jul 07 16:46:02.862874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.862856 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:46:02.867899 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.867885 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:46:02.867978 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.867914 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:46:02.867978 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.867927 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:46:02.877351 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:02.877336 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-198.ec2.internal\" not found" node="ip-10-0-137-198.ec2.internal" Jul 07 16:46:02.883009 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:02.882994 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-198.ec2.internal\" not found" node="ip-10-0-137-198.ec2.internal" Jul 07 16:46:02.888685 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.888670 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:02.898217 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.898190 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:41:01 +0000 UTC" deadline="2028-02-25 01:30:33.322453002 +0000 UTC" Jul 07 16:46:02.898217 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.898211 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14336h44m30.424244641s" Jul 07 16:46:02.959332 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:02.959296 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:02.959332 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.959331 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eb399c6f3875cdd0d3f494f486968b8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-198.ec2.internal\" (UID: \"4eb399c6f3875cdd0d3f494f486968b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" Jul 07 16:46:02.959578 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.959357 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e791ab086a91ee920b2829c487f6c72f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"e791ab086a91ee920b2829c487f6c72f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:02.959578 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:02.959375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e791ab086a91ee920b2829c487f6c72f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"e791ab086a91ee920b2829c487f6c72f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.059433 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:03.059393 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:03.059625 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.059511 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eb399c6f3875cdd0d3f494f486968b8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-198.ec2.internal\" (UID: \"4eb399c6f3875cdd0d3f494f486968b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.059625 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.059539 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e791ab086a91ee920b2829c487f6c72f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"e791ab086a91ee920b2829c487f6c72f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.059625 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.059563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e791ab086a91ee920b2829c487f6c72f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"e791ab086a91ee920b2829c487f6c72f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.059743 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.059624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eb399c6f3875cdd0d3f494f486968b8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-198.ec2.internal\" (UID: \"4eb399c6f3875cdd0d3f494f486968b8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.059743 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.059689 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e791ab086a91ee920b2829c487f6c72f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"e791ab086a91ee920b2829c487f6c72f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.059743 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.059688 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e791ab086a91ee920b2829c487f6c72f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal\" (UID: \"e791ab086a91ee920b2829c487f6c72f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.159893 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:03.159782 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:03.179947 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.179926 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.185955 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.185937 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.260290 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:03.260267 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:03.360864 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:03.360815 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-198.ec2.internal\" not found" Jul 07 16:46:03.425269 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.425211 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:03.498355 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.498334 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.511531 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.511513 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:46:03.512502 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.512491 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" Jul 07 16:46:03.522104 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.522088 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:46:03.753701 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:03.753670 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb399c6f3875cdd0d3f494f486968b8.slice/crio-43097eedc5c34bcaec1262324a2322db6bcb965d55439f91d29b1754df075f07 WatchSource:0}: Error finding container 43097eedc5c34bcaec1262324a2322db6bcb965d55439f91d29b1754df075f07: Status 404 returned error can't find the container with id 43097eedc5c34bcaec1262324a2322db6bcb965d55439f91d29b1754df075f07 Jul 07 16:46:03.754140 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:03.754118 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode791ab086a91ee920b2829c487f6c72f.slice/crio-3abd4f314d8f4d52b01242d132208a611da78ac15e51e051809811e0c8fe7529 WatchSource:0}: Error finding container 3abd4f314d8f4d52b01242d132208a611da78ac15e51e051809811e0c8fe7529: Status 404 returned error can't find the container with id 3abd4f314d8f4d52b01242d132208a611da78ac15e51e051809811e0c8fe7529 Jul 07 16:46:03.760297 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.760283 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:46:03.871086 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.871061 2572 apiserver.go:52] "Watching apiserver" Jul 07 16:46:03.880100 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.880077 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 16:46:03.880465 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.880445 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-r8wcc","openshift-network-diagnostics/network-check-target-27zsg","openshift-network-operator/iptables-alerter-z49ss","kube-system/global-pull-secret-syncer-6bcch","kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4ts7d","openshift-image-registry/node-ca-v2qtj","openshift-multus/multus-additional-cni-plugins-vd598","openshift-ovn-kubernetes/ovnkube-node-k2br8","kube-system/konnectivity-agent-m4hbp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b","openshift-dns/node-resolver-rwnxl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal","openshift-multus/multus-jnnfz"] Jul 07 16:46:03.882696 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.882679 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:03.883916 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.883897 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.885478 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.885456 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 16:46:03.885478 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.885471 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 16:46:03.885623 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.885461 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6s7cq\"" Jul 07 16:46:03.885623 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.885464 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 16:46:03.886296 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.886283 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:03.886742 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.886719 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 16:46:03.886742 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.886732 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 16:46:03.886933 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.886750 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hjmkd\"" Jul 07 16:46:03.886933 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.886769 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 16:46:03.886933 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.886776 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 16:46:03.886933 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.886732 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 16:46:03.887641 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.887623 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:03.887733 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:03.887691 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:03.888906 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.888885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:03.889034 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:03.888985 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:03.889126 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.889108 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 16:46:03.889195 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.889124 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 16:46:03.889195 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.889145 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m4drx\"" Jul 07 16:46:03.889312 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.889108 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:46:03.890468 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.890451 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.892808 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.892783 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:46:03.892919 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.892871 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.893020 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.893005 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h2hv9\"" Jul 07 16:46:03.893020 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.893014 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 16:46:03.894391 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.894374 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.895258 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.895238 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4w7jn\"" Jul 07 16:46:03.895532 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.895515 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 16:46:03.895584 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.895519 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 16:46:03.896407 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.896176 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 16:46:03.896407 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.896251 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 16:46:03.896594 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.896475 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:03.897135 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.897115 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 16:46:03.897244 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:03.897221 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:03.898302 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.898270 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 16:46:03.898640 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.898611 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hkp9n\"" Jul 07 16:46:03.898771 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.898748 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:03.899614 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.899596 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 16:46:03.900778 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.900761 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:03.901353 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.901340 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 16:46:03.902048 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.902032 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8w826\"" Jul 07 16:46:03.902138 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.902073 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 16:46:03.902200 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.902161 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 16:46:03.902324 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.902300 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:03.903186 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.903169 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 16:46:03.903307 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.903282 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 16:46:03.903307 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.903291 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rhppj\"" Jul 07 16:46:03.903556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.903543 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 16:46:03.904744 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.904726 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 16:46:03.905744 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.905725 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p979k\"" Jul 07 16:46:03.905834 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.905781 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 16:46:03.915545 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.915530 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:46:03.963366 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.963345 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nb8hv" Jul 07 16:46:03.964799 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964784 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-system-cni-dir\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.964882 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj6wr\" (UniqueName: \"kubernetes.io/projected/81e98332-3036-480c-973b-8be7e53d1c72-kube-api-access-jj6wr\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:03.964882 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964842 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-kubernetes\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.964882 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964857 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-node-log\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.964882 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de21d14f-46c5-4141-94e1-e70c13420d37-ovn-node-metrics-cert\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.965042 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964912 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8blx\" (UniqueName: \"kubernetes.io/projected/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-kube-api-access-b8blx\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.965042 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964932 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:03.965042 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964950 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-socket-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:03.965042 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.964990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-lib-modules\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.965042 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-cni-netd\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.965279 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965060 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-systemd\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.965279 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965089 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.965279 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965117 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-os-release\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.965279 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965142 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-device-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:03.965279 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965179 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-dbus\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:03.965279 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81e98332-3036-480c-973b-8be7e53d1c72-host-slash\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:03.965279 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965235 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-log-socket\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.965279 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-hostroot\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965291 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-tuned\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-slash\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965344 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-cnibin\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965369 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-daemon-config\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965410 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81e98332-3036-480c-973b-8be7e53d1c72-iptables-alerter-script\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965428 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysconfig\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysctl-conf\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965471 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-var-lib-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965494 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-os-release\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.965550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965527 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9g4m\" (UniqueName: \"kubernetes.io/projected/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-kube-api-access-r9g4m\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysctl-d\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965615 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965638 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-ovnkube-config\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-env-overrides\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965696 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-kubelet\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-conf-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-multus-certs\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j45fw\" (UniqueName: \"kubernetes.io/projected/2f264771-1d1b-4010-af77-e6e4f848f6f1-kube-api-access-j45fw\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31d6878e-778c-440b-b24a-29625b07f363-agent-certs\") pod \"konnectivity-agent-m4hbp\" (UID: \"31d6878e-778c-440b-b24a-29625b07f363\") " pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965831 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cnibin\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965859 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-modprobe-d\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965883 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c46dc\" (UniqueName: \"kubernetes.io/projected/de21d14f-46c5-4141-94e1-e70c13420d37-kube-api-access-c46dc\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965916 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-k8s-cni-cncf-io\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965939 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-netns\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965965 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.965988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-ovn\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966025 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-socket-dir-parent\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-var-lib-kubelet\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966056 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7901c631-4fe6-459a-9ee3-da2a1d110921-tmp\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966074 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-cni-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-cni-bin\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966112 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966132 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-run\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966147 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-sys\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966164 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-kubelet\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966189 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-etc-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966223 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31d6878e-778c-440b-b24a-29625b07f363-konnectivity-ca\") pod \"konnectivity-agent-m4hbp\" (UID: \"31d6878e-778c-440b-b24a-29625b07f363\") " pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966254 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cb3613a-561f-44b4-81e0-979f9c4d70d7-host\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966280 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966305 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-systemd\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966328 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-cni-binary-copy\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.966667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-cni-multus\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0cb3613a-561f-44b4-81e0-979f9c4d70d7-serviceca\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966400 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jsr6\" (UniqueName: \"kubernetes.io/projected/7901c631-4fe6-459a-9ee3-da2a1d110921-kube-api-access-9jsr6\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966421 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-cni-bin\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966462 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-system-cni-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966489 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-sys-fs\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966515 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m57d6\" (UniqueName: \"kubernetes.io/projected/0cb3613a-561f-44b4-81e0-979f9c4d70d7-kube-api-access-m57d6\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966578 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966607 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-registration-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966631 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-kubelet-config\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966660 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966700 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-host\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966722 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-etc-kubernetes\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966738 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7b4d\" (UniqueName: \"kubernetes.io/projected/0013c995-6334-4215-875b-694d671f8a29-kube-api-access-q7b4d\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966770 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-systemd-units\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.967208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966789 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-run-netns\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.967671 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.966802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-ovnkube-script-lib\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:03.972347 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.972331 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nb8hv" Jul 07 16:46:03.999322 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:03.999263 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 16:46:04.024403 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.024365 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" event={"ID":"e791ab086a91ee920b2829c487f6c72f","Type":"ContainerStarted","Data":"3abd4f314d8f4d52b01242d132208a611da78ac15e51e051809811e0c8fe7529"} Jul 07 16:46:04.025355 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.025337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" event={"ID":"4eb399c6f3875cdd0d3f494f486968b8","Type":"ContainerStarted","Data":"43097eedc5c34bcaec1262324a2322db6bcb965d55439f91d29b1754df075f07"} Jul 07 16:46:04.031080 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.031065 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:04.067359 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067334 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-daemon-config\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.067453 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.067453 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067379 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81e98332-3036-480c-973b-8be7e53d1c72-iptables-alerter-script\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:04.067453 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067395 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysconfig\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.067556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysconfig\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.067556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067487 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.067556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067531 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysctl-conf\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.067667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067557 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-var-lib-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.067667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067573 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.067667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067597 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-os-release\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.067667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067619 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.067667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067705 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysctl-conf\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067733 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-os-release\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9g4m\" (UniqueName: \"kubernetes.io/projected/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-kube-api-access-r9g4m\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067767 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysctl-d\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067809 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067852 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-ovnkube-config\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067851 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-run-ovn-kubernetes\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067858 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-var-lib-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-env-overrides\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067906 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-kubelet\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067921 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-sysctl-d\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.067925 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-conf-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-multus-certs\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067982 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j45fw\" (UniqueName: \"kubernetes.io/projected/2f264771-1d1b-4010-af77-e6e4f848f6f1-kube-api-access-j45fw\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.067990 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-kubelet\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31d6878e-778c-440b-b24a-29625b07f363-agent-certs\") pod \"konnectivity-agent-m4hbp\" (UID: \"31d6878e-778c-440b-b24a-29625b07f363\") " pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068028 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cnibin\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068035 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-multus-certs\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068053 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-modprobe-d\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46dc\" (UniqueName: \"kubernetes.io/projected/de21d14f-46c5-4141-94e1-e70c13420d37-kube-api-access-c46dc\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068082 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-conf-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068093 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/81e98332-3036-480c-973b-8be7e53d1c72-iptables-alerter-script\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-k8s-cni-cncf-io\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-netns\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cnibin\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068092 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-daemon-config\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068242 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-netns\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.068556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068302 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-modprobe-d\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068338 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-run-k8s-cni-cncf-io\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068341 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-env-overrides\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068367 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-ovn\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068396 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42be081f-532a-4903-853a-542bf86fef99-hosts-file\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-socket-dir-parent\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068442 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-ovn\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-var-lib-kubelet\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7901c631-4fe6-459a-9ee3-da2a1d110921-tmp\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068529 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42be081f-532a-4903-853a-542bf86fef99-tmp-dir\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068530 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-ovnkube-config\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068563 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068563 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-socket-dir-parent\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068552 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-cni-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-cni-bin\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068651 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068670 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-run\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068678 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-multus-cni-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.069321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-sys\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068709 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-kubelet\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068724 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-cni-bin\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068732 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-etc-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31d6878e-778c-440b-b24a-29625b07f363-konnectivity-ca\") pod \"konnectivity-agent-m4hbp\" (UID: \"31d6878e-778c-440b-b24a-29625b07f363\") " pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cb3613a-561f-44b4-81e0-979f9c4d70d7-host\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.068798 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068803 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068841 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-run\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068848 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-systemd\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068861 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cni-binary-copy\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xltm\" (UniqueName: \"kubernetes.io/projected/42be081f-532a-4903-853a-542bf86fef99-kube-api-access-7xltm\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.068891 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs podName:0013c995-6334-4215-875b-694d671f8a29 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:04.568870655 +0000 UTC m=+3.087073984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs") pod "network-metrics-daemon-r8wcc" (UID: "0013c995-6334-4215-875b-694d671f8a29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068752 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-sys\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068908 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-var-lib-kubelet\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068913 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-kubelet\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068949 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-run-systemd\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.070065 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068959 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cb3613a-561f-44b4-81e0-979f9c4d70d7-host\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-etc-openvswitch\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.068992 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-cni-binary-copy\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-cni-multus\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0cb3613a-561f-44b4-81e0-979f9c4d70d7-serviceca\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-host-var-lib-cni-multus\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jsr6\" (UniqueName: \"kubernetes.io/projected/7901c631-4fe6-459a-9ee3-da2a1d110921-kube-api-access-9jsr6\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069423 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/31d6878e-778c-440b-b24a-29625b07f363-konnectivity-ca\") pod \"konnectivity-agent-m4hbp\" (UID: \"31d6878e-778c-440b-b24a-29625b07f363\") " pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-cni-bin\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069509 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-cni-binary-copy\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069516 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069532 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-cni-bin\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-system-cni-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069575 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-sys-fs\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069608 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-system-cni-dir\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069638 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069640 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-sys-fs\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.069698 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:04.070874 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069777 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0cb3613a-561f-44b4-81e0-979f9c4d70d7-serviceca\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.069798 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret podName:10b5f4cc-d157-4e0e-bd7d-089cecbe76c9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:04.569783245 +0000 UTC m=+3.087986570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret") pod "global-pull-secret-syncer-6bcch" (UID: "10b5f4cc-d157-4e0e-bd7d-089cecbe76c9") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m57d6\" (UniqueName: \"kubernetes.io/projected/0cb3613a-561f-44b4-81e0-979f9c4d70d7-kube-api-access-m57d6\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069861 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-registration-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069896 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-kubelet-config\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069963 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-registration-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069932 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-host\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.069995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-etc-kubernetes\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070000 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-kubelet-config\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070022 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7b4d\" (UniqueName: \"kubernetes.io/projected/0013c995-6334-4215-875b-694d671f8a29-kube-api-access-q7b4d\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-systemd-units\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070069 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-host\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070073 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-run-netns\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070104 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-run-netns\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.071646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070105 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-ovnkube-script-lib\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070139 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-system-cni-dir\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070149 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-systemd-units\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj6wr\" (UniqueName: \"kubernetes.io/projected/81e98332-3036-480c-973b-8be7e53d1c72-kube-api-access-jj6wr\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070194 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-kubernetes\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070200 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-system-cni-dir\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070048 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-etc-kubernetes\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070224 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-node-log\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070249 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de21d14f-46c5-4141-94e1-e70c13420d37-ovn-node-metrics-cert\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070277 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-kubernetes\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070280 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8blx\" (UniqueName: \"kubernetes.io/projected/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-kube-api-access-b8blx\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070304 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070322 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-node-log\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-socket-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070352 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-lib-modules\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070373 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-cni-netd\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-systemd\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.072364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070429 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-os-release\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-device-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070537 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-dbus\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070571 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81e98332-3036-480c-973b-8be7e53d1c72-host-slash\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070592 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-log-socket\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-hostroot\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070643 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-tuned\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-slash\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-cnibin\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070726 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de21d14f-46c5-4141-94e1-e70c13420d37-ovnkube-script-lib\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070829 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-cnibin\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070846 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-device-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070882 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-log-socket\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070944 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f264771-1d1b-4010-af77-e6e4f848f6f1-socket-dir\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.070964 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-dbus\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071003 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/81e98332-3036-480c-973b-8be7e53d1c72-host-slash\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:04.073055 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071032 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071054 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-hostroot\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-lib-modules\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071097 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-cni-netd\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071126 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071176 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-systemd\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071218 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de21d14f-46c5-4141-94e1-e70c13420d37-host-slash\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.071200 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-os-release\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.072624 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/31d6878e-778c-440b-b24a-29625b07f363-agent-certs\") pod \"konnectivity-agent-m4hbp\" (UID: \"31d6878e-778c-440b-b24a-29625b07f363\") " pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.072741 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7901c631-4fe6-459a-9ee3-da2a1d110921-tmp\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.072973 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de21d14f-46c5-4141-94e1-e70c13420d37-ovn-node-metrics-cert\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.073540 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.073011 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7901c631-4fe6-459a-9ee3-da2a1d110921-etc-tuned\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.077477 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.077446 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:04.077477 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.077473 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:04.077477 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.077486 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nl2g9 for pod openshift-network-diagnostics/network-check-target-27zsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:04.077989 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.077543 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9 podName:c3d6e98d-63d4-49d9-89fe-9bf30b99372d nodeName:}" failed. No retries permitted until 2026-07-07 16:46:04.57752704 +0000 UTC m=+3.095730372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nl2g9" (UniqueName: "kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9") pod "network-check-target-27zsg" (UID: "c3d6e98d-63d4-49d9-89fe-9bf30b99372d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:04.078526 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.078461 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j45fw\" (UniqueName: \"kubernetes.io/projected/2f264771-1d1b-4010-af77-e6e4f848f6f1-kube-api-access-j45fw\") pod \"aws-ebs-csi-driver-node-j2d8b\" (UID: \"2f264771-1d1b-4010-af77-e6e4f848f6f1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.078623 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.078601 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9g4m\" (UniqueName: \"kubernetes.io/projected/f50849c2-188e-44b0-aef6-4eb6e4c5f6a3-kube-api-access-r9g4m\") pod \"multus-additional-cni-plugins-vd598\" (UID: \"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3\") " pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.078729 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.078705 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c46dc\" (UniqueName: \"kubernetes.io/projected/de21d14f-46c5-4141-94e1-e70c13420d37-kube-api-access-c46dc\") pod \"ovnkube-node-k2br8\" (UID: \"de21d14f-46c5-4141-94e1-e70c13420d37\") " pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.079473 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.079445 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj6wr\" (UniqueName: \"kubernetes.io/projected/81e98332-3036-480c-973b-8be7e53d1c72-kube-api-access-jj6wr\") pod \"iptables-alerter-z49ss\" (UID: \"81e98332-3036-480c-973b-8be7e53d1c72\") " pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:04.079567 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.079505 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jsr6\" (UniqueName: \"kubernetes.io/projected/7901c631-4fe6-459a-9ee3-da2a1d110921-kube-api-access-9jsr6\") pod \"tuned-4ts7d\" (UID: \"7901c631-4fe6-459a-9ee3-da2a1d110921\") " pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.079758 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.079741 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m57d6\" (UniqueName: \"kubernetes.io/projected/0cb3613a-561f-44b4-81e0-979f9c4d70d7-kube-api-access-m57d6\") pod \"node-ca-v2qtj\" (UID: \"0cb3613a-561f-44b4-81e0-979f9c4d70d7\") " pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:04.080247 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.080230 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7b4d\" (UniqueName: \"kubernetes.io/projected/0013c995-6334-4215-875b-694d671f8a29-kube-api-access-q7b4d\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:04.080450 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.080436 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8blx\" (UniqueName: \"kubernetes.io/projected/0ae40f99-bed2-4da8-8c58-71cd4f8b6340-kube-api-access-b8blx\") pod \"multus-jnnfz\" (UID: \"0ae40f99-bed2-4da8-8c58-71cd4f8b6340\") " pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.104292 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.104270 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:46:04.171196 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.171154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42be081f-532a-4903-853a-542bf86fef99-hosts-file\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.171367 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.171205 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42be081f-532a-4903-853a-542bf86fef99-tmp-dir\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.171367 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.171245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xltm\" (UniqueName: \"kubernetes.io/projected/42be081f-532a-4903-853a-542bf86fef99-kube-api-access-7xltm\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.171367 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.171317 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42be081f-532a-4903-853a-542bf86fef99-hosts-file\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.171603 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.171586 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42be081f-532a-4903-853a-542bf86fef99-tmp-dir\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.180989 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.180969 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xltm\" (UniqueName: \"kubernetes.io/projected/42be081f-532a-4903-853a-542bf86fef99-kube-api-access-7xltm\") pod \"node-resolver-rwnxl\" (UID: \"42be081f-532a-4903-853a-542bf86fef99\") " pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.192835 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.192786 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v2qtj" Jul 07 16:46:04.199922 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.199898 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vd598" Jul 07 16:46:04.202416 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.202386 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb3613a_561f_44b4_81e0_979f9c4d70d7.slice/crio-6fc521deba4da2aa2ee2bdc6744c8474ef96d7f2f0f374144471e20fa6c3914e WatchSource:0}: Error finding container 6fc521deba4da2aa2ee2bdc6744c8474ef96d7f2f0f374144471e20fa6c3914e: Status 404 returned error can't find the container with id 6fc521deba4da2aa2ee2bdc6744c8474ef96d7f2f0f374144471e20fa6c3914e Jul 07 16:46:04.208028 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.208008 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:04.208929 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.208894 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf50849c2_188e_44b0_aef6_4eb6e4c5f6a3.slice/crio-c64b180d601d6c107d94ce5f30d6c85eae703a6018ce4ad34ca43b5bf0228c0c WatchSource:0}: Error finding container c64b180d601d6c107d94ce5f30d6c85eae703a6018ce4ad34ca43b5bf0228c0c: Status 404 returned error can't find the container with id c64b180d601d6c107d94ce5f30d6c85eae703a6018ce4ad34ca43b5bf0228c0c Jul 07 16:46:04.212669 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.212650 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z49ss" Jul 07 16:46:04.218599 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.218579 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" Jul 07 16:46:04.218786 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.218760 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde21d14f_46c5_4141_94e1_e70c13420d37.slice/crio-81741e5720a8ea725a4769971124212087f15a4eafadb500c075a69043bcb163 WatchSource:0}: Error finding container 81741e5720a8ea725a4769971124212087f15a4eafadb500c075a69043bcb163: Status 404 returned error can't find the container with id 81741e5720a8ea725a4769971124212087f15a4eafadb500c075a69043bcb163 Jul 07 16:46:04.222694 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.222669 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e98332_3036_480c_973b_8be7e53d1c72.slice/crio-ca327ddcd2ed5dae563848d316e400cb3b460d7c1a5bae61304ffecf167ada1e WatchSource:0}: Error finding container ca327ddcd2ed5dae563848d316e400cb3b460d7c1a5bae61304ffecf167ada1e: Status 404 returned error can't find the container with id ca327ddcd2ed5dae563848d316e400cb3b460d7c1a5bae61304ffecf167ada1e Jul 07 16:46:04.224082 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.224055 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jnnfz" Jul 07 16:46:04.229832 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.229385 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:04.230867 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.230806 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7901c631_4fe6_459a_9ee3_da2a1d110921.slice/crio-2b64b4c61ada41bbc501111c28ceb9b96a18c804837ed28b8b30e0a4dc1d84af WatchSource:0}: Error finding container 2b64b4c61ada41bbc501111c28ceb9b96a18c804837ed28b8b30e0a4dc1d84af: Status 404 returned error can't find the container with id 2b64b4c61ada41bbc501111c28ceb9b96a18c804837ed28b8b30e0a4dc1d84af Jul 07 16:46:04.234124 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.234099 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" Jul 07 16:46:04.238224 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.238201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rwnxl" Jul 07 16:46:04.239743 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.239722 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ae40f99_bed2_4da8_8c58_71cd4f8b6340.slice/crio-6ecc65bb37b480660c9e8498a15524c89ba5deefff8f2bda0328386227288896 WatchSource:0}: Error finding container 6ecc65bb37b480660c9e8498a15524c89ba5deefff8f2bda0328386227288896: Status 404 returned error can't find the container with id 6ecc65bb37b480660c9e8498a15524c89ba5deefff8f2bda0328386227288896 Jul 07 16:46:04.244410 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.244386 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31d6878e_778c_440b_b24a_29625b07f363.slice/crio-41b921703027c7c3d7b77e6f6358d5f40c045d8873ada710d7dde8a0a2cde127 WatchSource:0}: Error finding container 41b921703027c7c3d7b77e6f6358d5f40c045d8873ada710d7dde8a0a2cde127: Status 404 returned error can't find the container with id 41b921703027c7c3d7b77e6f6358d5f40c045d8873ada710d7dde8a0a2cde127 Jul 07 16:46:04.247207 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.247182 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f264771_1d1b_4010_af77_e6e4f848f6f1.slice/crio-cfc5275662c01f27e2477d8b359365e6a917f6c072a8066d2e218374f807a123 WatchSource:0}: Error finding container cfc5275662c01f27e2477d8b359365e6a917f6c072a8066d2e218374f807a123: Status 404 returned error can't find the container with id cfc5275662c01f27e2477d8b359365e6a917f6c072a8066d2e218374f807a123 Jul 07 16:46:04.250955 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:04.250933 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42be081f_532a_4903_853a_542bf86fef99.slice/crio-43f976e6450ba496d8a43674a7fb60c52ccd8393fb23e4f121ad7ea2afd21532 WatchSource:0}: Error finding container 43f976e6450ba496d8a43674a7fb60c52ccd8393fb23e4f121ad7ea2afd21532: Status 404 returned error can't find the container with id 43f976e6450ba496d8a43674a7fb60c52ccd8393fb23e4f121ad7ea2afd21532 Jul 07 16:46:04.574902 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.574802 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:04.575052 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.574927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:04.575052 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.575000 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:04.575166 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.575067 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:04.575166 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.575079 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret podName:10b5f4cc-d157-4e0e-bd7d-089cecbe76c9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:05.575057995 +0000 UTC m=+4.093261335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret") pod "global-pull-secret-syncer-6bcch" (UID: "10b5f4cc-d157-4e0e-bd7d-089cecbe76c9") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:04.575166 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.575119 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs podName:0013c995-6334-4215-875b-694d671f8a29 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:05.575103871 +0000 UTC m=+4.093307197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs") pod "network-metrics-daemon-r8wcc" (UID: "0013c995-6334-4215-875b-694d671f8a29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:04.676187 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.675559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:04.676187 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.675743 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:04.676187 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.675766 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:04.676187 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.675778 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nl2g9 for pod openshift-network-diagnostics/network-check-target-27zsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:04.676187 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:04.675859 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9 podName:c3d6e98d-63d4-49d9-89fe-9bf30b99372d nodeName:}" failed. No retries permitted until 2026-07-07 16:46:05.675840519 +0000 UTC m=+4.194043846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl2g9" (UniqueName: "kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9") pod "network-check-target-27zsg" (UID: "c3d6e98d-63d4-49d9-89fe-9bf30b99372d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:04.974538 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.974379 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:41:03 +0000 UTC" deadline="2027-12-31 20:16:11.761384461 +0000 UTC" Jul 07 16:46:04.974538 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:04.974440 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13011h30m6.786948739s" Jul 07 16:46:05.040245 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.040087 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m4hbp" event={"ID":"31d6878e-778c-440b-b24a-29625b07f363","Type":"ContainerStarted","Data":"41b921703027c7c3d7b77e6f6358d5f40c045d8873ada710d7dde8a0a2cde127"} Jul 07 16:46:05.049125 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.049097 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jnnfz" event={"ID":"0ae40f99-bed2-4da8-8c58-71cd4f8b6340","Type":"ContainerStarted","Data":"6ecc65bb37b480660c9e8498a15524c89ba5deefff8f2bda0328386227288896"} Jul 07 16:46:05.051321 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.051295 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z49ss" event={"ID":"81e98332-3036-480c-973b-8be7e53d1c72","Type":"ContainerStarted","Data":"ca327ddcd2ed5dae563848d316e400cb3b460d7c1a5bae61304ffecf167ada1e"} Jul 07 16:46:05.053614 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.053589 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"81741e5720a8ea725a4769971124212087f15a4eafadb500c075a69043bcb163"} Jul 07 16:46:05.056999 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.056975 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vd598" event={"ID":"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3","Type":"ContainerStarted","Data":"c64b180d601d6c107d94ce5f30d6c85eae703a6018ce4ad34ca43b5bf0228c0c"} Jul 07 16:46:05.059604 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.059581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rwnxl" event={"ID":"42be081f-532a-4903-853a-542bf86fef99","Type":"ContainerStarted","Data":"43f976e6450ba496d8a43674a7fb60c52ccd8393fb23e4f121ad7ea2afd21532"} Jul 07 16:46:05.062107 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.062083 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" event={"ID":"2f264771-1d1b-4010-af77-e6e4f848f6f1","Type":"ContainerStarted","Data":"cfc5275662c01f27e2477d8b359365e6a917f6c072a8066d2e218374f807a123"} Jul 07 16:46:05.065520 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.065495 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" event={"ID":"7901c631-4fe6-459a-9ee3-da2a1d110921","Type":"ContainerStarted","Data":"2b64b4c61ada41bbc501111c28ceb9b96a18c804837ed28b8b30e0a4dc1d84af"} Jul 07 16:46:05.070523 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.070498 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v2qtj" event={"ID":"0cb3613a-561f-44b4-81e0-979f9c4d70d7","Type":"ContainerStarted","Data":"6fc521deba4da2aa2ee2bdc6744c8474ef96d7f2f0f374144471e20fa6c3914e"} Jul 07 16:46:05.583997 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.583948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:05.584194 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.584061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:05.584261 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:05.584198 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:05.584312 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:05.584262 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs podName:0013c995-6334-4215-875b-694d671f8a29 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:07.584243918 +0000 UTC m=+6.102447249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs") pod "network-metrics-daemon-r8wcc" (UID: "0013c995-6334-4215-875b-694d671f8a29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:05.584691 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:05.584671 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:05.584767 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:05.584731 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret podName:10b5f4cc-d157-4e0e-bd7d-089cecbe76c9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:07.584715629 +0000 UTC m=+6.102918945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret") pod "global-pull-secret-syncer-6bcch" (UID: "10b5f4cc-d157-4e0e-bd7d-089cecbe76c9") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:05.684973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.684919 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:05.685146 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:05.685093 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:05.685146 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:05.685112 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:05.685146 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:05.685125 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nl2g9 for pod openshift-network-diagnostics/network-check-target-27zsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:05.685313 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:05.685182 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9 podName:c3d6e98d-63d4-49d9-89fe-9bf30b99372d nodeName:}" failed. No retries permitted until 2026-07-07 16:46:07.68516215 +0000 UTC m=+6.203365466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl2g9" (UniqueName: "kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9") pod "network-check-target-27zsg" (UID: "c3d6e98d-63d4-49d9-89fe-9bf30b99372d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:05.975400 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.975285 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:41:03 +0000 UTC" deadline="2028-01-01 16:22:33.327772849 +0000 UTC" Jul 07 16:46:05.975400 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:05.975326 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13031h36m27.352451188s" Jul 07 16:46:06.024348 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:06.023235 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:06.024348 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:06.023363 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:06.024348 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:06.023756 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:06.024348 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:06.023860 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:06.024348 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:06.023922 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:06.024348 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:06.024003 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:07.601814 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:07.601732 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:07.602267 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:07.601877 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:07.602267 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:07.601922 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:07.602267 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:07.601988 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs podName:0013c995-6334-4215-875b-694d671f8a29 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:11.601968433 +0000 UTC m=+10.120171759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs") pod "network-metrics-daemon-r8wcc" (UID: "0013c995-6334-4215-875b-694d671f8a29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:07.602267 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:07.602009 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:07.602267 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:07.602043 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret podName:10b5f4cc-d157-4e0e-bd7d-089cecbe76c9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:11.602032594 +0000 UTC m=+10.120235907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret") pod "global-pull-secret-syncer-6bcch" (UID: "10b5f4cc-d157-4e0e-bd7d-089cecbe76c9") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:07.702795 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:07.702756 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:07.702978 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:07.702959 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:07.703039 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:07.702981 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:07.703039 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:07.702995 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nl2g9 for pod openshift-network-diagnostics/network-check-target-27zsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:07.703151 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:07.703060 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9 podName:c3d6e98d-63d4-49d9-89fe-9bf30b99372d nodeName:}" failed. No retries permitted until 2026-07-07 16:46:11.703040669 +0000 UTC m=+10.221243983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl2g9" (UniqueName: "kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9") pod "network-check-target-27zsg" (UID: "c3d6e98d-63d4-49d9-89fe-9bf30b99372d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:08.022109 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:08.021645 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:08.022109 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:08.021683 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:08.022109 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:08.021646 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:08.022109 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:08.021769 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:08.022109 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:08.021907 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:08.022109 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:08.022005 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:10.021539 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:10.021432 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:10.021975 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:10.021565 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:10.021975 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:10.021958 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:10.022119 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:10.022053 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:10.022232 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:10.022203 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:10.022333 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:10.022304 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:11.634074 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:11.633990 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:11.634074 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:11.634049 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:11.634614 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:11.634180 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:11.634614 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:11.634181 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:11.634614 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:11.634237 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret podName:10b5f4cc-d157-4e0e-bd7d-089cecbe76c9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:19.634219056 +0000 UTC m=+18.152422370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret") pod "global-pull-secret-syncer-6bcch" (UID: "10b5f4cc-d157-4e0e-bd7d-089cecbe76c9") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:11.634614 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:11.634257 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs podName:0013c995-6334-4215-875b-694d671f8a29 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:19.634247058 +0000 UTC m=+18.152450376 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs") pod "network-metrics-daemon-r8wcc" (UID: "0013c995-6334-4215-875b-694d671f8a29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:11.735122 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:11.735083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:11.735290 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:11.735267 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:11.735348 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:11.735298 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:11.735348 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:11.735311 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nl2g9 for pod openshift-network-diagnostics/network-check-target-27zsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:11.735474 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:11.735369 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9 podName:c3d6e98d-63d4-49d9-89fe-9bf30b99372d nodeName:}" failed. No retries permitted until 2026-07-07 16:46:19.735351338 +0000 UTC m=+18.253554677 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl2g9" (UniqueName: "kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9") pod "network-check-target-27zsg" (UID: "c3d6e98d-63d4-49d9-89fe-9bf30b99372d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:12.028575 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:12.027513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:12.028575 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:12.027652 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:12.028575 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:12.027876 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:12.028575 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:12.027912 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:12.028575 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:12.028029 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:12.028575 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:12.028168 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:14.021806 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:14.021559 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:14.022255 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:14.021925 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:14.022255 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:14.021575 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:14.022255 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:14.021566 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:14.022255 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:14.022032 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:14.022255 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:14.022092 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:16.025848 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:16.025564 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:16.025848 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:16.025652 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:16.025848 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:16.025787 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:16.026386 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:16.025926 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:16.026386 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:16.026098 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:16.026386 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:16.026348 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:18.021936 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:18.021901 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:18.021936 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:18.021937 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:18.022441 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:18.021907 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:18.022441 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:18.022035 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:18.022441 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:18.022082 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:18.022441 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:18.022147 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:19.695653 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:19.695619 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:19.696137 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:19.695660 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:19.696137 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:19.695780 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:19.696137 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:19.695793 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:19.696137 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:19.695862 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret podName:10b5f4cc-d157-4e0e-bd7d-089cecbe76c9 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:35.695844037 +0000 UTC m=+34.214047352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret") pod "global-pull-secret-syncer-6bcch" (UID: "10b5f4cc-d157-4e0e-bd7d-089cecbe76c9") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:19.696137 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:19.695883 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs podName:0013c995-6334-4215-875b-694d671f8a29 nodeName:}" failed. No retries permitted until 2026-07-07 16:46:35.695871576 +0000 UTC m=+34.214074890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs") pod "network-metrics-daemon-r8wcc" (UID: "0013c995-6334-4215-875b-694d671f8a29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:19.796956 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:19.796920 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:19.797123 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:19.797102 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:19.797189 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:19.797126 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:19.797189 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:19.797140 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nl2g9 for pod openshift-network-diagnostics/network-check-target-27zsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:19.797286 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:19.797203 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9 podName:c3d6e98d-63d4-49d9-89fe-9bf30b99372d nodeName:}" failed. No retries permitted until 2026-07-07 16:46:35.79718509 +0000 UTC m=+34.315388419 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl2g9" (UniqueName: "kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9") pod "network-check-target-27zsg" (UID: "c3d6e98d-63d4-49d9-89fe-9bf30b99372d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:20.021674 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:20.021596 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:20.021866 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:20.021606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:20.021866 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:20.021722 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:20.021866 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:20.021849 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:20.022018 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:20.021896 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:20.022018 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:20.021963 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:22.024470 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:22.024437 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:22.024883 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:22.024437 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:22.024883 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:22.024552 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:22.024883 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:22.024450 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:22.024883 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:22.024632 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:22.024883 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:22.024730 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:23.117187 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:23.116876 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" event={"ID":"4eb399c6f3875cdd0d3f494f486968b8","Type":"ContainerStarted","Data":"67f16090ea5e39b498bbd3e73a248eb295d3b8b0da34ef3f58cac9dc40f73925"} Jul 07 16:46:23.119678 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:23.119589 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jnnfz" event={"ID":"0ae40f99-bed2-4da8-8c58-71cd4f8b6340","Type":"ContainerStarted","Data":"7ef232a54ac2de53626101e6fb70da2e8b02d0762a374c669627af927f0c3cc6"} Jul 07 16:46:23.132755 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:23.132707 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"d017d96da99c1314ec94b4b55d741fcb8eab8b054cf352bfbf57fc2c13d74710"} Jul 07 16:46:23.141607 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:23.141581 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" event={"ID":"7901c631-4fe6-459a-9ee3-da2a1d110921","Type":"ContainerStarted","Data":"a19e1656add09ce95c9cf8c1c237b9f1a07ae41b7a93fe7558c0aea87fde92e5"} Jul 07 16:46:23.142483 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:23.142433 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-198.ec2.internal" podStartSLOduration=20.142414135 podStartE2EDuration="20.142414135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:23.141683479 +0000 UTC m=+21.659886814" watchObservedRunningTime="2026-07-07 16:46:23.142414135 +0000 UTC m=+21.660617470" Jul 07 16:46:23.169723 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:23.169641 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jnnfz" podStartSLOduration=2.452540105 podStartE2EDuration="21.169622204s" totalImagesPullingTime="18.717082099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:23.169582997 +0000 UTC m=+21.687786343" watchObservedRunningTime="2026-07-07 16:46:23.169622204 +0000 UTC m=+21.687825539" Jul 07 16:46:23.199300 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:23.199248 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4ts7d" podStartSLOduration=2.6889383220000003 podStartE2EDuration="21.199233818s" totalImagesPullingTime="18.510295496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:23.198639112 +0000 UTC m=+21.716842447" watchObservedRunningTime="2026-07-07 16:46:23.199233818 +0000 UTC m=+21.717437149" Jul 07 16:46:24.022088 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.021839 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:24.022242 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.021854 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:24.022242 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:24.022192 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:24.022364 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.021908 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:24.022364 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:24.022257 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:24.022468 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:24.022371 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:24.144948 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.144731 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m4hbp" event={"ID":"31d6878e-778c-440b-b24a-29625b07f363","Type":"ContainerStarted","Data":"a8816725ac5fd5a7c57a086a0b209091865551b50b6430c1dd8ae3f6e229aba1"} Jul 07 16:46:24.146644 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.146613 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z49ss" event={"ID":"81e98332-3036-480c-973b-8be7e53d1c72","Type":"ContainerStarted","Data":"a912ed636f552035397c1b7d90dacf179b011bcc96e2964b575b9f9cdf463553"} Jul 07 16:46:24.149422 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.149395 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"6599ace49fdfdb120e91921e0b4c7a12e451e23842427c6660bf98073b0f4c45"} Jul 07 16:46:24.149523 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.149465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"d86ae9435ce3cf00dfb90200a2b84d72e40e88cc0c80d0db51e884335ab613e1"} Jul 07 16:46:24.149523 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.149509 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"6b33c1f56877b63645b647ad82a5d57aca5f5f6732cc31e1d6abfb20ecb06148"} Jul 07 16:46:24.149630 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.149540 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"c065e600789b7dba1f2f5196b029eb1e6744bbd2b2b3e41795765d73bef88fcb"} Jul 07 16:46:24.149630 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.149568 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"9e4496de1a962044afb9a37d1794627b6743c565ea9613212e28710a1ae14751"} Jul 07 16:46:24.150869 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.150841 2572 generic.go:356] "Generic (PLEG): container finished" podID="f50849c2-188e-44b0-aef6-4eb6e4c5f6a3" containerID="9f783d3b44f44fc0f5a1264422a19fe249430525242615f8a76318bb93b08353" exitCode=0 Jul 07 16:46:24.150952 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.150909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vd598" event={"ID":"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3","Type":"ContainerDied","Data":"9f783d3b44f44fc0f5a1264422a19fe249430525242615f8a76318bb93b08353"} Jul 07 16:46:24.152620 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.152296 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rwnxl" event={"ID":"42be081f-532a-4903-853a-542bf86fef99","Type":"ContainerStarted","Data":"243941e5cf1b8102f93d6893d64486a9cbe21a03a3e042a7996674156769b9ea"} Jul 07 16:46:24.154249 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.154215 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" event={"ID":"2f264771-1d1b-4010-af77-e6e4f848f6f1","Type":"ContainerStarted","Data":"8b83499da5a9f25abaa845b23301a011578a4930fa582634e4849ed331c2c7f0"} Jul 07 16:46:24.155728 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.155706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v2qtj" event={"ID":"0cb3613a-561f-44b4-81e0-979f9c4d70d7","Type":"ContainerStarted","Data":"49f2f4eedc84c22dda53dc9b09b7a48381c17624883a3efa2877e6fa6f63ff54"} Jul 07 16:46:24.157273 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.157249 2572 generic.go:356] "Generic (PLEG): container finished" podID="e791ab086a91ee920b2829c487f6c72f" containerID="7ddc85abf04d2722a98675d85ef5e7720400a6bee47ffef917c36037139a5f76" exitCode=0 Jul 07 16:46:24.157409 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.157386 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" event={"ID":"e791ab086a91ee920b2829c487f6c72f","Type":"ContainerDied","Data":"7ddc85abf04d2722a98675d85ef5e7720400a6bee47ffef917c36037139a5f76"} Jul 07 16:46:24.163880 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.163836 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m4hbp" podStartSLOduration=3.680293428 podStartE2EDuration="22.16380288s" totalImagesPullingTime="18.483509452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:24.163340841 +0000 UTC m=+22.681544188" watchObservedRunningTime="2026-07-07 16:46:24.16380288 +0000 UTC m=+22.682006215" Jul 07 16:46:24.183385 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.183343 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rwnxl" podStartSLOduration=3.691951912 podStartE2EDuration="22.183330272s" totalImagesPullingTime="18.49137836s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:24.182912205 +0000 UTC m=+22.701115534" watchObservedRunningTime="2026-07-07 16:46:24.183330272 +0000 UTC m=+22.701533605" Jul 07 16:46:24.219431 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.219399 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v2qtj" podStartSLOduration=3.577818078 podStartE2EDuration="22.219386161s" totalImagesPullingTime="18.641568083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:24.219090506 +0000 UTC m=+22.737293841" watchObservedRunningTime="2026-07-07 16:46:24.219386161 +0000 UTC m=+22.737589495" Jul 07 16:46:24.722704 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.722681 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 16:46:24.988414 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.988323 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:46:24.722699024Z","UUID":"85b52fa8-22e2-46cf-a158-0b0cca698b02","Handler":null,"Name":"","Endpoint":""} Jul 07 16:46:24.990219 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.990197 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 16:46:24.990326 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:24.990233 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 16:46:25.161675 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:25.161636 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" event={"ID":"2f264771-1d1b-4010-af77-e6e4f848f6f1","Type":"ContainerStarted","Data":"66376b3b7073993da5c5dab6e2cf0b4b9ab37ab217d3b80f565f07823225d888"} Jul 07 16:46:25.163659 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:25.163624 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" event={"ID":"e791ab086a91ee920b2829c487f6c72f","Type":"ContainerStarted","Data":"20f2fd02a8d381a6f119001065d1e87aa87abfc587bff3aa1c7d4705690d7a40"} Jul 07 16:46:25.183010 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:25.182956 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-198.ec2.internal" podStartSLOduration=22.182939024 podStartE2EDuration="22.182939024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:25.182408045 +0000 UTC m=+23.700611381" watchObservedRunningTime="2026-07-07 16:46:25.182939024 +0000 UTC m=+23.701142360" Jul 07 16:46:25.200772 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:25.200734 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z49ss" podStartSLOduration=4.681887157 podStartE2EDuration="23.200716045s" totalImagesPullingTime="18.518828888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:25.200047945 +0000 UTC m=+23.718251279" watchObservedRunningTime="2026-07-07 16:46:25.200716045 +0000 UTC m=+23.718919379" Jul 07 16:46:25.885018 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:25.884979 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:25.885658 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:25.885637 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:26.021458 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:26.021433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:26.021458 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:26.021460 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:26.021645 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:26.021433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:26.021645 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:26.021555 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:26.021749 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:26.021654 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:26.021796 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:26.021749 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:26.168569 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:26.168519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"e2adcd6c72cf4cbfbfdc831494de9910e5177571c3f88fa68f454bd44b001c5c"} Jul 07 16:46:26.170593 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:26.170565 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" event={"ID":"2f264771-1d1b-4010-af77-e6e4f848f6f1","Type":"ContainerStarted","Data":"2b2e78d52cb92fb84a2281a1c4f4505c38eaff0f496b8e76376ba883943db8a3"} Jul 07 16:46:26.171020 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:26.171000 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:26.171418 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:26.171403 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m4hbp" Jul 07 16:46:26.222894 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:26.222749 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2d8b" podStartSLOduration=3.321821039 podStartE2EDuration="24.222722317s" totalImagesPullingTime="20.900901278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:26.201223387 +0000 UTC m=+24.719426722" watchObservedRunningTime="2026-07-07 16:46:26.222722317 +0000 UTC m=+24.740925654" Jul 07 16:46:28.021735 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:28.021708 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:28.021735 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:28.021728 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:28.022124 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:28.021729 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:28.022124 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:28.021797 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:28.022124 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:28.021921 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:28.022124 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:28.022018 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:28.179518 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:28.179294 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" event={"ID":"de21d14f-46c5-4141-94e1-e70c13420d37","Type":"ContainerStarted","Data":"314d1cf64ece0807a2a1c0b4a13a76ac2de179bbe381e0d8c7a1c92ee0453376"} Jul 07 16:46:28.217522 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:28.217470 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" podStartSLOduration=7.526063466 podStartE2EDuration="26.217448748s" totalImagesPullingTime="18.691385282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:28.215426359 +0000 UTC m=+26.733629708" watchObservedRunningTime="2026-07-07 16:46:28.217448748 +0000 UTC m=+26.735652090" Jul 07 16:46:29.182228 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:29.182200 2572 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 16:46:29.182834 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:29.182741 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:29.182834 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:29.182812 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:29.198738 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:29.198716 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:29.199029 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:29.199015 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:29.763381 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:29.763349 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:46:30.021367 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.021299 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:30.021367 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.021344 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:30.021587 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.021302 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:30.021587 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:30.021435 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:30.021587 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:30.021542 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:30.021736 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:30.021653 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:30.663580 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.663328 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8wcc"] Jul 07 16:46:30.663953 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.663603 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:30.663953 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:30.663696 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:30.667290 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.667269 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6bcch"] Jul 07 16:46:30.667385 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.667337 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:30.667439 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:30.667415 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:30.685602 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.685581 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-27zsg"] Jul 07 16:46:30.685681 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:30.685643 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:30.685745 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:30.685704 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:31.188096 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:31.188067 2572 generic.go:356] "Generic (PLEG): container finished" podID="f50849c2-188e-44b0-aef6-4eb6e4c5f6a3" containerID="875539c4b1a1ebfefc10fb9218214fd62d5f974926def461da88422cd1c7a293" exitCode=0 Jul 07 16:46:31.188240 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:31.188159 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vd598" event={"ID":"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3","Type":"ContainerDied","Data":"875539c4b1a1ebfefc10fb9218214fd62d5f974926def461da88422cd1c7a293"} Jul 07 16:46:32.021706 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:32.021677 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:32.022053 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:32.021723 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:32.022053 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:32.021815 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:32.022053 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:32.021926 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:32.192297 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:32.192265 2572 generic.go:356] "Generic (PLEG): container finished" podID="f50849c2-188e-44b0-aef6-4eb6e4c5f6a3" containerID="13ecc8a0a9f082455194146c85a93ed489cecc39ed6f51c6c6d64b5055466d59" exitCode=0 Jul 07 16:46:32.192444 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:32.192319 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vd598" event={"ID":"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3","Type":"ContainerDied","Data":"13ecc8a0a9f082455194146c85a93ed489cecc39ed6f51c6c6d64b5055466d59"} Jul 07 16:46:33.021435 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:33.021403 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:33.021586 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:33.021494 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:33.197198 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:33.197164 2572 generic.go:356] "Generic (PLEG): container finished" podID="f50849c2-188e-44b0-aef6-4eb6e4c5f6a3" containerID="59cb2e1614e3049de0d50a3450210c134bc10d1b21af9ffa98cfaa696860800c" exitCode=0 Jul 07 16:46:33.197568 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:33.197196 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vd598" event={"ID":"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3","Type":"ContainerDied","Data":"59cb2e1614e3049de0d50a3450210c134bc10d1b21af9ffa98cfaa696860800c"} Jul 07 16:46:34.021797 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:34.021552 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:34.021964 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:34.021627 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:34.021964 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:34.021922 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r8wcc" podUID="0013c995-6334-4215-875b-694d671f8a29" Jul 07 16:46:34.022094 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:34.022024 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-27zsg" podUID="c3d6e98d-63d4-49d9-89fe-9bf30b99372d" Jul 07 16:46:35.021253 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.021223 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:35.021613 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.021322 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6bcch" podUID="10b5f4cc-d157-4e0e-bd7d-089cecbe76c9" Jul 07 16:46:35.725128 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.725093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:35.725289 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.725142 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:35.725289 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.725264 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:35.725289 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.725270 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:35.725414 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.725322 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret podName:10b5f4cc-d157-4e0e-bd7d-089cecbe76c9 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:07.725307929 +0000 UTC m=+66.243511244 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret") pod "global-pull-secret-syncer-6bcch" (UID: "10b5f4cc-d157-4e0e-bd7d-089cecbe76c9") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:46:35.725414 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.725337 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs podName:0013c995-6334-4215-875b-694d671f8a29 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:07.725330176 +0000 UTC m=+66.243533488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs") pod "network-metrics-daemon-r8wcc" (UID: "0013c995-6334-4215-875b-694d671f8a29") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:46:35.743646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.743626 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-198.ec2.internal" event="NodeReady" Jul 07 16:46:35.743747 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.743736 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 16:46:35.790386 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.790361 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pjq9z"] Jul 07 16:46:35.792297 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.792282 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:35.795854 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.795701 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 16:46:35.795854 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.795796 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 16:46:35.796023 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.795948 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pvjc\"" Jul 07 16:46:35.796254 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.796235 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-z4l7h"] Jul 07 16:46:35.798186 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.798166 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4l7h" Jul 07 16:46:35.800708 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.800683 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 16:46:35.800708 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.800697 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 16:46:35.800877 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.800861 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-f72zk\"" Jul 07 16:46:35.801017 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.800964 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 16:46:35.805854 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.805832 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pjq9z"] Jul 07 16:46:35.808195 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.808175 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4l7h"] Jul 07 16:46:35.825886 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.825864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:35.826025 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.826010 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:46:35.826082 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.826033 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:46:35.826082 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.826045 2572 projected.go:196] Error preparing data for projected volume kube-api-access-nl2g9 for pod openshift-network-diagnostics/network-check-target-27zsg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:35.826169 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:35.826101 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9 podName:c3d6e98d-63d4-49d9-89fe-9bf30b99372d nodeName:}" failed. No retries permitted until 2026-07-07 16:47:07.826084652 +0000 UTC m=+66.344287968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nl2g9" (UniqueName: "kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9") pod "network-check-target-27zsg" (UID: "c3d6e98d-63d4-49d9-89fe-9bf30b99372d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:46:35.926745 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.926712 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpwpv\" (UniqueName: \"kubernetes.io/projected/5d097f72-3543-4a68-bb27-43bc8592bc9a-kube-api-access-zpwpv\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:35.926745 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.926749 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d097f72-3543-4a68-bb27-43bc8592bc9a-config-volume\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:35.927079 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.926772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d097f72-3543-4a68-bb27-43bc8592bc9a-tmp-dir\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:35.927079 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.926872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/080d41be-8f0f-403b-b782-e75d215f8fa4-cert\") pod \"ingress-canary-z4l7h\" (UID: \"080d41be-8f0f-403b-b782-e75d215f8fa4\") " pod="openshift-ingress-canary/ingress-canary-z4l7h" Jul 07 16:46:35.927079 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.926909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cztrw\" (UniqueName: \"kubernetes.io/projected/080d41be-8f0f-403b-b782-e75d215f8fa4-kube-api-access-cztrw\") pod \"ingress-canary-z4l7h\" (UID: \"080d41be-8f0f-403b-b782-e75d215f8fa4\") " pod="openshift-ingress-canary/ingress-canary-z4l7h" Jul 07 16:46:35.927079 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:35.926943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.021881 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.021794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:46:36.022483 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.021794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:46:36.026598 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.026012 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:46:36.026728 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.026653 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:46:36.026728 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.026707 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:46:36.026848 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.026652 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rsbn5\"" Jul 07 16:46:36.027430 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.027378 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvb6g\"" Jul 07 16:46:36.027621 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.027601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d097f72-3543-4a68-bb27-43bc8592bc9a-config-volume\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.027695 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.027651 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d097f72-3543-4a68-bb27-43bc8592bc9a-tmp-dir\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.027754 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.027701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/080d41be-8f0f-403b-b782-e75d215f8fa4-cert\") pod \"ingress-canary-z4l7h\" (UID: \"080d41be-8f0f-403b-b782-e75d215f8fa4\") " pod="openshift-ingress-canary/ingress-canary-z4l7h" Jul 07 16:46:36.028969 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.028257 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d097f72-3543-4a68-bb27-43bc8592bc9a-config-volume\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.028969 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.028312 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cztrw\" (UniqueName: \"kubernetes.io/projected/080d41be-8f0f-403b-b782-e75d215f8fa4-kube-api-access-cztrw\") pod \"ingress-canary-z4l7h\" (UID: \"080d41be-8f0f-403b-b782-e75d215f8fa4\") " pod="openshift-ingress-canary/ingress-canary-z4l7h" Jul 07 16:46:36.028969 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.028373 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.028969 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.028447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpwpv\" (UniqueName: \"kubernetes.io/projected/5d097f72-3543-4a68-bb27-43bc8592bc9a-kube-api-access-zpwpv\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.028969 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:36.028838 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:46:36.028969 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:36.028938 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls podName:5d097f72-3543-4a68-bb27-43bc8592bc9a nodeName:}" failed. No retries permitted until 2026-07-07 16:46:36.528913902 +0000 UTC m=+35.047117217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls") pod "dns-default-pjq9z" (UID: "5d097f72-3543-4a68-bb27-43bc8592bc9a") : secret "dns-default-metrics-tls" not found Jul 07 16:46:36.030801 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.029324 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d097f72-3543-4a68-bb27-43bc8592bc9a-tmp-dir\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.035494 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.035470 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/080d41be-8f0f-403b-b782-e75d215f8fa4-cert\") pod \"ingress-canary-z4l7h\" (UID: \"080d41be-8f0f-403b-b782-e75d215f8fa4\") " pod="openshift-ingress-canary/ingress-canary-z4l7h" Jul 07 16:46:36.042463 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.042437 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpwpv\" (UniqueName: \"kubernetes.io/projected/5d097f72-3543-4a68-bb27-43bc8592bc9a-kube-api-access-zpwpv\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.042636 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.042620 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cztrw\" (UniqueName: \"kubernetes.io/projected/080d41be-8f0f-403b-b782-e75d215f8fa4-kube-api-access-cztrw\") pod \"ingress-canary-z4l7h\" (UID: \"080d41be-8f0f-403b-b782-e75d215f8fa4\") " pod="openshift-ingress-canary/ingress-canary-z4l7h" Jul 07 16:46:36.111545 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.111525 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-z4l7h" Jul 07 16:46:36.265015 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.264985 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-z4l7h"] Jul 07 16:46:36.532599 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:36.532560 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:36.532781 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:36.532710 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:46:36.532857 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:36.532782 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls podName:5d097f72-3543-4a68-bb27-43bc8592bc9a nodeName:}" failed. No retries permitted until 2026-07-07 16:46:37.532760265 +0000 UTC m=+36.050963596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls") pod "dns-default-pjq9z" (UID: "5d097f72-3543-4a68-bb27-43bc8592bc9a") : secret "dns-default-metrics-tls" not found Jul 07 16:46:37.020994 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:37.020967 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:46:37.024174 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:37.024140 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:46:37.541017 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:37.540985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:37.541188 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:37.541142 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:46:37.541243 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:37.541223 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls podName:5d097f72-3543-4a68-bb27-43bc8592bc9a nodeName:}" failed. No retries permitted until 2026-07-07 16:46:39.541206626 +0000 UTC m=+38.059409938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls") pod "dns-default-pjq9z" (UID: "5d097f72-3543-4a68-bb27-43bc8592bc9a") : secret "dns-default-metrics-tls" not found Jul 07 16:46:37.759650 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:46:37.759464 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080d41be_8f0f_403b_b782_e75d215f8fa4.slice/crio-5473fac016c71a38873a983a0ac5f40e6070915585ccfa0f90a79c1d78bb4bda WatchSource:0}: Error finding container 5473fac016c71a38873a983a0ac5f40e6070915585ccfa0f90a79c1d78bb4bda: Status 404 returned error can't find the container with id 5473fac016c71a38873a983a0ac5f40e6070915585ccfa0f90a79c1d78bb4bda Jul 07 16:46:38.209556 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:38.209529 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4l7h" event={"ID":"080d41be-8f0f-403b-b782-e75d215f8fa4","Type":"ContainerStarted","Data":"5473fac016c71a38873a983a0ac5f40e6070915585ccfa0f90a79c1d78bb4bda"} Jul 07 16:46:39.215256 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:39.215222 2572 generic.go:356] "Generic (PLEG): container finished" podID="f50849c2-188e-44b0-aef6-4eb6e4c5f6a3" containerID="44551fb3d6f620e395a33ffa96dc689d3c75b55ce8a4ae0066ddc312c79ae4b1" exitCode=0 Jul 07 16:46:39.215689 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:39.215281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vd598" event={"ID":"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3","Type":"ContainerDied","Data":"44551fb3d6f620e395a33ffa96dc689d3c75b55ce8a4ae0066ddc312c79ae4b1"} Jul 07 16:46:39.558085 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:39.558003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:39.558229 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:39.558160 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:46:39.558283 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:39.558246 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls podName:5d097f72-3543-4a68-bb27-43bc8592bc9a nodeName:}" failed. No retries permitted until 2026-07-07 16:46:43.558225671 +0000 UTC m=+42.076429007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls") pod "dns-default-pjq9z" (UID: "5d097f72-3543-4a68-bb27-43bc8592bc9a") : secret "dns-default-metrics-tls" not found Jul 07 16:46:40.222043 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:40.222014 2572 generic.go:356] "Generic (PLEG): container finished" podID="f50849c2-188e-44b0-aef6-4eb6e4c5f6a3" containerID="74dc93b5ab537d08eec95dfdd770be4d800d1bb4837428d13585e78f7560eab3" exitCode=0 Jul 07 16:46:40.222398 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:40.222064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vd598" event={"ID":"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3","Type":"ContainerDied","Data":"74dc93b5ab537d08eec95dfdd770be4d800d1bb4837428d13585e78f7560eab3"} Jul 07 16:46:41.225772 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:41.225738 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-z4l7h" event={"ID":"080d41be-8f0f-403b-b782-e75d215f8fa4","Type":"ContainerStarted","Data":"6c44e3249f26df9d69775e094e6f7424362769e9e66cad58a5f6ca058a751ff3"} Jul 07 16:46:41.228853 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:41.228814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vd598" event={"ID":"f50849c2-188e-44b0-aef6-4eb6e4c5f6a3","Type":"ContainerStarted","Data":"9ec4b0bb015504196fc2072695d864caa904cc03be31244a6786bb6cf6abe0f9"} Jul 07 16:46:41.250216 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:41.250176 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-z4l7h" podStartSLOduration=3.529441746 podStartE2EDuration="6.250162071s" totalImagesPullingTime="2.720720325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:41.249891256 +0000 UTC m=+39.768094594" watchObservedRunningTime="2026-07-07 16:46:41.250162071 +0000 UTC m=+39.768365405" Jul 07 16:46:41.277245 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:41.277205 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vd598" podStartSLOduration=12.67569488 podStartE2EDuration="39.27719143s" totalImagesPullingTime="26.60149655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:41.274490754 +0000 UTC m=+39.792694089" watchObservedRunningTime="2026-07-07 16:46:41.27719143 +0000 UTC m=+39.795394771" Jul 07 16:46:43.589793 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:43.589752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:43.590177 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:43.589885 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:46:43.590177 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:43.589934 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls podName:5d097f72-3543-4a68-bb27-43bc8592bc9a nodeName:}" failed. No retries permitted until 2026-07-07 16:46:51.589921181 +0000 UTC m=+50.108124493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls") pod "dns-default-pjq9z" (UID: "5d097f72-3543-4a68-bb27-43bc8592bc9a") : secret "dns-default-metrics-tls" not found Jul 07 16:46:51.639602 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:46:51.639563 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:46:51.640055 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:51.639691 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:46:51.640055 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:46:51.639752 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls podName:5d097f72-3543-4a68-bb27-43bc8592bc9a nodeName:}" failed. No retries permitted until 2026-07-07 16:47:07.639738239 +0000 UTC m=+66.157941550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls") pod "dns-default-pjq9z" (UID: "5d097f72-3543-4a68-bb27-43bc8592bc9a") : secret "dns-default-metrics-tls" not found Jul 07 16:47:01.203650 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:01.203618 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k2br8" Jul 07 16:47:07.646002 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.645967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:47:07.646419 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:07.646094 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:47:07.646419 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:07.646142 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls podName:5d097f72-3543-4a68-bb27-43bc8592bc9a nodeName:}" failed. No retries permitted until 2026-07-07 16:47:39.646129473 +0000 UTC m=+98.164332785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls") pod "dns-default-pjq9z" (UID: "5d097f72-3543-4a68-bb27-43bc8592bc9a") : secret "dns-default-metrics-tls" not found Jul 07 16:47:07.746836 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.746803 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:47:07.746975 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.746870 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:47:07.749960 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.749944 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:47:07.750016 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.749942 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:47:07.757290 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:07.757271 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 16:47:07.757375 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:07.757331 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs podName:0013c995-6334-4215-875b-694d671f8a29 nodeName:}" failed. No retries permitted until 2026-07-07 16:48:11.757317002 +0000 UTC m=+130.275520320 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs") pod "network-metrics-daemon-r8wcc" (UID: "0013c995-6334-4215-875b-694d671f8a29") : secret "metrics-daemon-secret" not found Jul 07 16:47:07.760660 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.760637 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/10b5f4cc-d157-4e0e-bd7d-089cecbe76c9-original-pull-secret\") pod \"global-pull-secret-syncer-6bcch\" (UID: \"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9\") " pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:47:07.847100 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.847082 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:47:07.850705 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.850687 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:47:07.860978 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.860958 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:47:07.870567 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.870543 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl2g9\" (UniqueName: \"kubernetes.io/projected/c3d6e98d-63d4-49d9-89fe-9bf30b99372d-kube-api-access-nl2g9\") pod \"network-check-target-27zsg\" (UID: \"c3d6e98d-63d4-49d9-89fe-9bf30b99372d\") " pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:47:07.932206 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:07.932163 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6bcch" Jul 07 16:47:08.086135 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:08.086105 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6bcch"] Jul 07 16:47:08.089222 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:08.089195 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b5f4cc_d157_4e0e_bd7d_089cecbe76c9.slice/crio-4918aa86ca852a1cf635c74cf05085239aef364d0930fe9e81198926fb8b9950 WatchSource:0}: Error finding container 4918aa86ca852a1cf635c74cf05085239aef364d0930fe9e81198926fb8b9950: Status 404 returned error can't find the container with id 4918aa86ca852a1cf635c74cf05085239aef364d0930fe9e81198926fb8b9950 Jul 07 16:47:08.156168 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:08.156142 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bvb6g\"" Jul 07 16:47:08.162746 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:08.162732 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:47:08.288391 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:08.288353 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6bcch" event={"ID":"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9","Type":"ContainerStarted","Data":"4918aa86ca852a1cf635c74cf05085239aef364d0930fe9e81198926fb8b9950"} Jul 07 16:47:08.317071 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:08.317040 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-27zsg"] Jul 07 16:47:08.319742 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:08.319717 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d6e98d_63d4_49d9_89fe_9bf30b99372d.slice/crio-109db2748fd7d11a678680e2f645eaab55a531d2f9aa2b0fdae4b0f581954492 WatchSource:0}: Error finding container 109db2748fd7d11a678680e2f645eaab55a531d2f9aa2b0fdae4b0f581954492: Status 404 returned error can't find the container with id 109db2748fd7d11a678680e2f645eaab55a531d2f9aa2b0fdae4b0f581954492 Jul 07 16:47:09.292973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:09.292931 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-27zsg" event={"ID":"c3d6e98d-63d4-49d9-89fe-9bf30b99372d","Type":"ContainerStarted","Data":"109db2748fd7d11a678680e2f645eaab55a531d2f9aa2b0fdae4b0f581954492"} Jul 07 16:47:12.701076 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.701045 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7"] Jul 07 16:47:12.703218 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.703192 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.706031 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.706003 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 16:47:12.707401 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.707369 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 16:47:12.707486 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.707449 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-24fvs\"" Jul 07 16:47:12.709654 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.709524 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 16:47:12.709654 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.709530 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 16:47:12.712893 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.712872 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7"] Jul 07 16:47:12.779282 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.779251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jql6m\" (UniqueName: \"kubernetes.io/projected/ce33d408-dd45-4e47-ace2-4d8eafcf1206-kube-api-access-jql6m\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.779547 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.779289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.779547 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.779375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ce33d408-dd45-4e47-ace2-4d8eafcf1206-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.812494 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.812462 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg"] Jul 07 16:47:12.813966 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.813946 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qh2nc"] Jul 07 16:47:12.814084 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.814065 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg" Jul 07 16:47:12.815638 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.815620 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-dc9c5f76c-946gt"] Jul 07 16:47:12.815763 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.815740 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:12.816717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.816699 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tkrql\"" Jul 07 16:47:12.816979 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.816961 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 16:47:12.817197 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.817178 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:47:12.817457 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.817439 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:12.818666 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.818528 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 16:47:12.818666 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.818621 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 16:47:12.818809 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.818716 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9wvtp\"" Jul 07 16:47:12.819471 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.819078 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 16:47:12.819471 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.819102 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 16:47:12.819941 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.819922 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 07 16:47:12.820732 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.820521 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 07 16:47:12.820732 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.820723 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 07 16:47:12.821500 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.821308 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 16:47:12.821500 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.821309 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 16:47:12.821652 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.821592 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 07 16:47:12.822204 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.821738 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sqcjk\"" Jul 07 16:47:12.825195 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.825023 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 16:47:12.825340 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.825319 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg"] Jul 07 16:47:12.828535 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.828516 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qh2nc"] Jul 07 16:47:12.830943 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.830880 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dc9c5f76c-946gt"] Jul 07 16:47:12.879944 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.879921 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jql6m\" (UniqueName: \"kubernetes.io/projected/ce33d408-dd45-4e47-ace2-4d8eafcf1206-kube-api-access-jql6m\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.880050 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.879952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.880117 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:12.880058 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:12.880117 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:12.880099 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls podName:ce33d408-dd45-4e47-ace2-4d8eafcf1206 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:13.380085537 +0000 UTC m=+71.898288849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-jqgr7" (UID: "ce33d408-dd45-4e47-ace2-4d8eafcf1206") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:12.880232 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.880141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ce33d408-dd45-4e47-ace2-4d8eafcf1206-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.880839 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.880797 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ce33d408-dd45-4e47-ace2-4d8eafcf1206-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.891346 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.891324 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jql6m\" (UniqueName: \"kubernetes.io/projected/ce33d408-dd45-4e47-ace2-4d8eafcf1206-kube-api-access-jql6m\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:12.981134 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgshs\" (UniqueName: \"kubernetes.io/projected/f7e8811f-bdc5-464e-bdd5-4950e57015d8-kube-api-access-zgshs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:12.981134 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f590db-ee36-45d1-a652-0183b053cb69-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:12.981336 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981157 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:12.981336 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981191 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-default-certificate\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:12.981336 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981218 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-stats-auth\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:12.981336 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981256 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d3f590db-ee36-45d1-a652-0183b053cb69-snapshots\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:12.981336 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981302 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wsn9\" (UniqueName: \"kubernetes.io/projected/d3f590db-ee36-45d1-a652-0183b053cb69-kube-api-access-9wsn9\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:12.981336 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981322 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:12.981643 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981345 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3f590db-ee36-45d1-a652-0183b053cb69-serving-cert\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:12.981643 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981406 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3f590db-ee36-45d1-a652-0183b053cb69-tmp\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:12.981643 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981428 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89wzt\" (UniqueName: \"kubernetes.io/projected/ca2be8fd-5c81-4828-abf0-c9db10087542-kube-api-access-89wzt\") pod \"volume-data-source-validator-5d456fdbcd-2tnxg\" (UID: \"ca2be8fd-5c81-4828-abf0-c9db10087542\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg" Jul 07 16:47:12.981643 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:12.981446 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f590db-ee36-45d1-a652-0183b053cb69-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.081962 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.081928 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-default-certificate\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.081962 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.081964 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-stats-auth\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.082150 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.081990 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d3f590db-ee36-45d1-a652-0183b053cb69-snapshots\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.082150 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082112 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wsn9\" (UniqueName: \"kubernetes.io/projected/d3f590db-ee36-45d1-a652-0183b053cb69-kube-api-access-9wsn9\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.082150 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082146 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.082279 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:13.082265 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:13.582245529 +0000 UTC m=+72.100448860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : configmap references non-existent config key: service-ca.crt Jul 07 16:47:13.082394 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082362 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3f590db-ee36-45d1-a652-0183b053cb69-serving-cert\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.082474 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082445 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3f590db-ee36-45d1-a652-0183b053cb69-tmp\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.082525 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082475 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89wzt\" (UniqueName: \"kubernetes.io/projected/ca2be8fd-5c81-4828-abf0-c9db10087542-kube-api-access-89wzt\") pod \"volume-data-source-validator-5d456fdbcd-2tnxg\" (UID: \"ca2be8fd-5c81-4828-abf0-c9db10087542\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg" Jul 07 16:47:13.082525 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082500 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f590db-ee36-45d1-a652-0183b053cb69-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.082627 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082525 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgshs\" (UniqueName: \"kubernetes.io/projected/f7e8811f-bdc5-464e-bdd5-4950e57015d8-kube-api-access-zgshs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.082627 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f590db-ee36-45d1-a652-0183b053cb69-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.082627 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.082774 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082660 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d3f590db-ee36-45d1-a652-0183b053cb69-snapshots\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.082774 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:13.082720 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:47:13.082774 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:13.082769 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:13.582753379 +0000 UTC m=+72.100956705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : secret "router-metrics-certs-default" not found Jul 07 16:47:13.082971 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.082947 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d3f590db-ee36-45d1-a652-0183b053cb69-tmp\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.083198 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.083179 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f590db-ee36-45d1-a652-0183b053cb69-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.083743 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.083716 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3f590db-ee36-45d1-a652-0183b053cb69-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.084515 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.084498 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-default-certificate\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.084589 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.084519 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-stats-auth\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.084915 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.084899 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d3f590db-ee36-45d1-a652-0183b053cb69-serving-cert\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.094753 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.094731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wsn9\" (UniqueName: \"kubernetes.io/projected/d3f590db-ee36-45d1-a652-0183b053cb69-kube-api-access-9wsn9\") pod \"insights-operator-5c847dcfc4-qh2nc\" (UID: \"d3f590db-ee36-45d1-a652-0183b053cb69\") " pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.095100 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.095078 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgshs\" (UniqueName: \"kubernetes.io/projected/f7e8811f-bdc5-464e-bdd5-4950e57015d8-kube-api-access-zgshs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.095288 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.095269 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89wzt\" (UniqueName: \"kubernetes.io/projected/ca2be8fd-5c81-4828-abf0-c9db10087542-kube-api-access-89wzt\") pod \"volume-data-source-validator-5d456fdbcd-2tnxg\" (UID: \"ca2be8fd-5c81-4828-abf0-c9db10087542\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg" Jul 07 16:47:13.127182 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.127160 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg" Jul 07 16:47:13.135044 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.135029 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" Jul 07 16:47:13.260791 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.260766 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg"] Jul 07 16:47:13.261365 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:13.261337 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2be8fd_5c81_4828_abf0_c9db10087542.slice/crio-3143a96f45c393e66ed427d78456a8b5a791804b4bcb6151860e5f978da0c360 WatchSource:0}: Error finding container 3143a96f45c393e66ed427d78456a8b5a791804b4bcb6151860e5f978da0c360: Status 404 returned error can't find the container with id 3143a96f45c393e66ed427d78456a8b5a791804b4bcb6151860e5f978da0c360 Jul 07 16:47:13.281447 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.281423 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qh2nc"] Jul 07 16:47:13.304903 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.304875 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6bcch" event={"ID":"10b5f4cc-d157-4e0e-bd7d-089cecbe76c9","Type":"ContainerStarted","Data":"7c99aea76102882368807a8e023704a157d0249ee19a94bed2eb3a06162ab579"} Jul 07 16:47:13.306298 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.306277 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-27zsg" event={"ID":"c3d6e98d-63d4-49d9-89fe-9bf30b99372d","Type":"ContainerStarted","Data":"1560348bfa9d541b0b84000cc536523e03e804f55216f4b2b4cd320fb8bf6922"} Jul 07 16:47:13.306381 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.306325 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:47:13.307288 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.307267 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg" event={"ID":"ca2be8fd-5c81-4828-abf0-c9db10087542","Type":"ContainerStarted","Data":"3143a96f45c393e66ed427d78456a8b5a791804b4bcb6151860e5f978da0c360"} Jul 07 16:47:13.314890 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:13.314868 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f590db_ee36_45d1_a652_0183b053cb69.slice/crio-e6879f330bdd3b2a051175ea4938c32d4bd47757d1973532f99a186e6ba6f59d WatchSource:0}: Error finding container e6879f330bdd3b2a051175ea4938c32d4bd47757d1973532f99a186e6ba6f59d: Status 404 returned error can't find the container with id e6879f330bdd3b2a051175ea4938c32d4bd47757d1973532f99a186e6ba6f59d Jul 07 16:47:13.326436 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.326380 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6bcch" podStartSLOduration=66.583160743 podStartE2EDuration="1m11.32636609s" totalImagesPullingTime="4.743205347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:13.326274512 +0000 UTC m=+71.844477858" watchObservedRunningTime="2026-07-07 16:47:13.32636609 +0000 UTC m=+71.844569454" Jul 07 16:47:13.345703 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.345667 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-27zsg" podStartSLOduration=66.83887621 podStartE2EDuration="1m11.345655067s" totalImagesPullingTime="4.506778857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:13.345500255 +0000 UTC m=+71.863703603" watchObservedRunningTime="2026-07-07 16:47:13.345655067 +0000 UTC m=+71.863858395" Jul 07 16:47:13.384352 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.384332 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:13.384564 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:13.384548 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:13.384616 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:13.384600 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls podName:ce33d408-dd45-4e47-ace2-4d8eafcf1206 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:14.384588631 +0000 UTC m=+72.902791945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-jqgr7" (UID: "ce33d408-dd45-4e47-ace2-4d8eafcf1206") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:13.586125 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.586042 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.586277 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:13.586134 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:13.586277 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:13.586197 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:14.586179438 +0000 UTC m=+73.104382769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : configmap references non-existent config key: service-ca.crt Jul 07 16:47:13.586277 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:13.586255 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:47:13.586420 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:13.586313 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:14.586296283 +0000 UTC m=+73.104499610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : secret "router-metrics-certs-default" not found Jul 07 16:47:14.311709 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:14.311639 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" event={"ID":"d3f590db-ee36-45d1-a652-0183b053cb69","Type":"ContainerStarted","Data":"e6879f330bdd3b2a051175ea4938c32d4bd47757d1973532f99a186e6ba6f59d"} Jul 07 16:47:14.391532 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:14.391490 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:14.391720 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:14.391619 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:14.391720 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:14.391687 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls podName:ce33d408-dd45-4e47-ace2-4d8eafcf1206 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.391666598 +0000 UTC m=+74.909869927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-jqgr7" (UID: "ce33d408-dd45-4e47-ace2-4d8eafcf1206") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:14.592433 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:14.592364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:14.592587 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:14.592481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:14.592587 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:14.592567 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.592542759 +0000 UTC m=+75.110746090 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : configmap references non-existent config key: service-ca.crt Jul 07 16:47:14.592712 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:14.592613 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:47:14.592712 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:14.592669 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.592652079 +0000 UTC m=+75.110855396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : secret "router-metrics-certs-default" not found Jul 07 16:47:15.316035 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.315951 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg" event={"ID":"ca2be8fd-5c81-4828-abf0-c9db10087542","Type":"ContainerStarted","Data":"22fd8fd49ce5e6b052829576a7385ae51452b33dca6b7b7106dc1603a42f62b0"} Jul 07 16:47:15.317444 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.317422 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" event={"ID":"d3f590db-ee36-45d1-a652-0183b053cb69","Type":"ContainerStarted","Data":"417f8eebb95c636036078bbd0b0e39d48842bfe8e08096a0f12a48d32d76286f"} Jul 07 16:47:15.336266 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.336218 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-2tnxg" podStartSLOduration=2.117353238 podStartE2EDuration="3.336205206s" totalImagesPullingTime="1.218851968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:15.334463996 +0000 UTC m=+73.852667345" watchObservedRunningTime="2026-07-07 16:47:15.336205206 +0000 UTC m=+73.854408539" Jul 07 16:47:15.354670 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.354629 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" podStartSLOduration=1.637550185 podStartE2EDuration="3.354616103s" totalImagesPullingTime="1.717065918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:15.35393407 +0000 UTC m=+73.872137406" watchObservedRunningTime="2026-07-07 16:47:15.354616103 +0000 UTC m=+73.872819437" Jul 07 16:47:15.772590 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.772556 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wxw67"] Jul 07 16:47:15.775579 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.775556 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:15.778424 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.778401 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 16:47:15.778671 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.778659 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 16:47:15.778810 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.778794 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2mgsv\"" Jul 07 16:47:15.786054 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.786031 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wxw67"] Jul 07 16:47:15.903837 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.903800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-crio-socket\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:15.903945 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.903849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:15.903945 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.903878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhpz6\" (UniqueName: \"kubernetes.io/projected/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-api-access-rhpz6\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:15.904024 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.903960 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:15.904024 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:15.903988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-data-volume\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.004752 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.004725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-crio-socket\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.004752 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.004754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.004944 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.004778 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhpz6\" (UniqueName: \"kubernetes.io/projected/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-api-access-rhpz6\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.004944 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.004816 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.004944 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.004870 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-data-volume\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.004944 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.004891 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-crio-socket\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.004944 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.004899 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:16.005113 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.004949 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:16.005113 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.004981 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.504963868 +0000 UTC m=+75.023167190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:16.005113 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.005007 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:16.50498999 +0000 UTC m=+75.023193304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : configmap "kube-rbac-proxy" not found Jul 07 16:47:16.005222 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.005177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-data-volume\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.015860 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.015840 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhpz6\" (UniqueName: \"kubernetes.io/projected/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-api-access-rhpz6\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.411089 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.408578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:16.411089 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.409849 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:16.411089 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.409921 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls podName:ce33d408-dd45-4e47-ace2-4d8eafcf1206 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:20.409900336 +0000 UTC m=+78.928103654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-jqgr7" (UID: "ce33d408-dd45-4e47-ace2-4d8eafcf1206") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:16.509625 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.509584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.509777 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.509652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:16.509777 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.509716 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:16.509777 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.509738 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:16.509777 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.509768 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:17.509752428 +0000 UTC m=+76.027955739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : configmap "kube-rbac-proxy" not found Jul 07 16:47:16.509937 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.509789 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:17.509775738 +0000 UTC m=+76.027979049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:16.610618 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.610583 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:16.610755 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:16.610678 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:16.610755 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.610730 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:20.610714179 +0000 UTC m=+79.128917516 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : configmap references non-existent config key: service-ca.crt Jul 07 16:47:16.610879 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.610764 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:47:16.610879 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:16.610810 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:20.610798207 +0000 UTC m=+79.129001524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : secret "router-metrics-certs-default" not found Jul 07 16:47:17.518569 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:17.518519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:17.519043 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:17.518630 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:17.519043 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:17.518639 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:17.519043 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:17.518700 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:19.51868465 +0000 UTC m=+78.036887961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : configmap "kube-rbac-proxy" not found Jul 07 16:47:17.519043 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:17.518752 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:17.519043 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:17.518810 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:19.518794484 +0000 UTC m=+78.036997811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:17.956188 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:17.956164 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rwnxl_42be081f-532a-4903-853a-542bf86fef99/dns-node-resolver/0.log" Jul 07 16:47:18.953430 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:18.953402 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v2qtj_0cb3613a-561f-44b4-81e0-979f9c4d70d7/node-ca/0.log" Jul 07 16:47:19.532589 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:19.532546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:19.532777 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:19.532622 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:19.532777 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:19.532694 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:19.532777 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:19.532704 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:19.532777 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:19.532748 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:23.532733683 +0000 UTC m=+82.050936995 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : configmap "kube-rbac-proxy" not found Jul 07 16:47:19.532777 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:19.532762 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:23.532755736 +0000 UTC m=+82.050959047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:19.753329 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:19.753301 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4l7h_080d41be-8f0f-403b-b782-e75d215f8fa4/serve-healthcheck-canary/0.log" Jul 07 16:47:20.438037 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:20.438007 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:20.438430 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:20.438155 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:20.438430 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:20.438214 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls podName:ce33d408-dd45-4e47-ace2-4d8eafcf1206 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:28.438200452 +0000 UTC m=+86.956403764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-jqgr7" (UID: "ce33d408-dd45-4e47-ace2-4d8eafcf1206") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:20.638719 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:20.638689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:20.638883 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:20.638859 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:20.638971 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:20.638878 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:28.638859373 +0000 UTC m=+87.157062702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : configmap references non-existent config key: service-ca.crt Jul 07 16:47:20.638971 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:20.638947 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:47:20.639062 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:20.638990 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:28.63897865 +0000 UTC m=+87.157181962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : secret "router-metrics-certs-default" not found Jul 07 16:47:23.561013 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:23.560974 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:23.561503 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:23.561036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:23.561503 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:23.561104 2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:47:23.561503 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:23.561143 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:23.561503 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:23.561174 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:31.56115747 +0000 UTC m=+90.079360783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : configmap "kube-rbac-proxy" not found Jul 07 16:47:23.561503 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:23.561208 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:31.561190492 +0000 UTC m=+90.079393827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:28.495376 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:28.495259 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:28.495722 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:28.495393 2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:28.495722 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:28.495453 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls podName:ce33d408-dd45-4e47-ace2-4d8eafcf1206 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:44.495437245 +0000 UTC m=+103.013640557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-jqgr7" (UID: "ce33d408-dd45-4e47-ace2-4d8eafcf1206") : secret "cluster-monitoring-operator-tls" not found Jul 07 16:47:28.697019 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:28.696986 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:28.697172 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:28.697085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:28.697172 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:28.697135 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:44.69711807 +0000 UTC m=+103.215321401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : configmap references non-existent config key: service-ca.crt Jul 07 16:47:28.697299 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:28.697206 2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 07 16:47:28.697299 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:28.697264 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs podName:f7e8811f-bdc5-464e-bdd5-4950e57015d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:47:44.697248378 +0000 UTC m=+103.215451691 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs") pod "router-default-dc9c5f76c-946gt" (UID: "f7e8811f-bdc5-464e-bdd5-4950e57015d8") : secret "router-metrics-certs-default" not found Jul 07 16:47:31.618731 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:31.618698 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:31.619167 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:31.618775 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:31.619167 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:31.618860 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:47:31.619167 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:47:31.618923 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls podName:ed8bafdc-1e11-46c7-93e2-ef2cb0e453af nodeName:}" failed. No retries permitted until 2026-07-07 16:47:47.618908029 +0000 UTC m=+106.137111342 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxw67" (UID: "ed8bafdc-1e11-46c7-93e2-ef2cb0e453af") : secret "insights-runtime-extractor-tls" not found Jul 07 16:47:31.619286 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:31.619266 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:39.677440 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:39.677389 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:47:39.679713 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:39.679692 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d097f72-3543-4a68-bb27-43bc8592bc9a-metrics-tls\") pod \"dns-default-pjq9z\" (UID: \"5d097f72-3543-4a68-bb27-43bc8592bc9a\") " pod="openshift-dns/dns-default-pjq9z" Jul 07 16:47:39.708382 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:39.708355 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pvjc\"" Jul 07 16:47:39.716541 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:39.716523 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pjq9z" Jul 07 16:47:39.840061 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:39.840038 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pjq9z"] Jul 07 16:47:39.843063 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:39.843041 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d097f72_3543_4a68_bb27_43bc8592bc9a.slice/crio-ac027a8b24520fa4c62ef34c3b58a9221539d1c6198324485f6af2fe72cff99b WatchSource:0}: Error finding container ac027a8b24520fa4c62ef34c3b58a9221539d1c6198324485f6af2fe72cff99b: Status 404 returned error can't find the container with id ac027a8b24520fa4c62ef34c3b58a9221539d1c6198324485f6af2fe72cff99b Jul 07 16:47:40.381862 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:40.381760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjq9z" event={"ID":"5d097f72-3543-4a68-bb27-43bc8592bc9a","Type":"ContainerStarted","Data":"ac027a8b24520fa4c62ef34c3b58a9221539d1c6198324485f6af2fe72cff99b"} Jul 07 16:47:42.389142 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:42.389109 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjq9z" event={"ID":"5d097f72-3543-4a68-bb27-43bc8592bc9a","Type":"ContainerStarted","Data":"c13a2e60b327d0ec2c92314b2b07f96493b9a9f243744afaf28c34b2f42ff096"} Jul 07 16:47:42.389509 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:42.389165 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pjq9z" event={"ID":"5d097f72-3543-4a68-bb27-43bc8592bc9a","Type":"ContainerStarted","Data":"8f3c1c561c1d8194dd43238e77d5fa12153713783c5e8ab3642cbfa618bf089e"} Jul 07 16:47:42.389509 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:42.389225 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pjq9z" Jul 07 16:47:42.420398 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:42.420357 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pjq9z" podStartSLOduration=65.923149464 podStartE2EDuration="1m7.420345286s" totalImagesPullingTime="1.497195822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:42.419717772 +0000 UTC m=+100.937921105" watchObservedRunningTime="2026-07-07 16:47:42.420345286 +0000 UTC m=+100.938548614" Jul 07 16:47:44.314195 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.314169 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-27zsg" Jul 07 16:47:44.511929 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.511899 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:44.514192 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.514164 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ce33d408-dd45-4e47-ace2-4d8eafcf1206-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-jqgr7\" (UID: \"ce33d408-dd45-4e47-ace2-4d8eafcf1206\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:44.519025 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.519006 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" Jul 07 16:47:44.646374 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.646349 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7"] Jul 07 16:47:44.648397 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:44.648369 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce33d408_dd45_4e47_ace2_4d8eafcf1206.slice/crio-4914a470d2a8561a14103cff5aa860146442d280e70e847d619c8f415c2cde3c WatchSource:0}: Error finding container 4914a470d2a8561a14103cff5aa860146442d280e70e847d619c8f415c2cde3c: Status 404 returned error can't find the container with id 4914a470d2a8561a14103cff5aa860146442d280e70e847d619c8f415c2cde3c Jul 07 16:47:44.713413 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.713388 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:44.713519 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.713432 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:44.714041 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.714022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7e8811f-bdc5-464e-bdd5-4950e57015d8-service-ca-bundle\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:44.715667 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.715645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7e8811f-bdc5-464e-bdd5-4950e57015d8-metrics-certs\") pod \"router-default-dc9c5f76c-946gt\" (UID: \"f7e8811f-bdc5-464e-bdd5-4950e57015d8\") " pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:44.941685 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:44.941657 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:45.067496 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:45.067464 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-dc9c5f76c-946gt"] Jul 07 16:47:45.070079 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:45.070058 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e8811f_bdc5_464e_bdd5_4950e57015d8.slice/crio-2f506c20d98f71408a7e4a530ead9775bf4a808b96c7141f5ed0a3fbfd7d5aae WatchSource:0}: Error finding container 2f506c20d98f71408a7e4a530ead9775bf4a808b96c7141f5ed0a3fbfd7d5aae: Status 404 returned error can't find the container with id 2f506c20d98f71408a7e4a530ead9775bf4a808b96c7141f5ed0a3fbfd7d5aae Jul 07 16:47:45.399857 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:45.399753 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" event={"ID":"ce33d408-dd45-4e47-ace2-4d8eafcf1206","Type":"ContainerStarted","Data":"4914a470d2a8561a14103cff5aa860146442d280e70e847d619c8f415c2cde3c"} Jul 07 16:47:45.401576 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:45.401545 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dc9c5f76c-946gt" event={"ID":"f7e8811f-bdc5-464e-bdd5-4950e57015d8","Type":"ContainerStarted","Data":"be5c446d88bae6ff01f34413eda8093645afefb730379c5f54228a9feed7b1c1"} Jul 07 16:47:45.401795 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:45.401592 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-dc9c5f76c-946gt" event={"ID":"f7e8811f-bdc5-464e-bdd5-4950e57015d8","Type":"ContainerStarted","Data":"2f506c20d98f71408a7e4a530ead9775bf4a808b96c7141f5ed0a3fbfd7d5aae"} Jul 07 16:47:45.433714 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:45.433669 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-dc9c5f76c-946gt" podStartSLOduration=33.433655868 podStartE2EDuration="33.433655868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:45.432481883 +0000 UTC m=+103.950685220" watchObservedRunningTime="2026-07-07 16:47:45.433655868 +0000 UTC m=+103.951859202" Jul 07 16:47:45.942070 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:45.942035 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:45.944904 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:45.944883 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:46.404390 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:46.404319 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:46.405630 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:46.405612 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-dc9c5f76c-946gt" Jul 07 16:47:47.409750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:47.409706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" event={"ID":"ce33d408-dd45-4e47-ace2-4d8eafcf1206","Type":"ContainerStarted","Data":"f5738ddebd4726ec20446560ef5e72d31d61055319817f7c6b8da9c3be9c12f0"} Jul 07 16:47:47.431620 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:47.431574 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-jqgr7" podStartSLOduration=33.421221381 podStartE2EDuration="35.431558407s" totalImagesPullingTime="2.010337026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:47.431093384 +0000 UTC m=+105.949296747" watchObservedRunningTime="2026-07-07 16:47:47.431558407 +0000 UTC m=+105.949761742" Jul 07 16:47:47.636394 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:47.636361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:47.638472 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:47.638448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ed8bafdc-1e11-46c7-93e2-ef2cb0e453af-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxw67\" (UID: \"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af\") " pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:47.884777 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:47.884746 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wxw67" Jul 07 16:47:48.031394 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:48.031369 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wxw67"] Jul 07 16:47:48.034337 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:48.034310 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded8bafdc_1e11_46c7_93e2_ef2cb0e453af.slice/crio-6a5afa46d44adbcb2ee921ccfba99e9ed45050f030e2dd291514b3dacdb114f1 WatchSource:0}: Error finding container 6a5afa46d44adbcb2ee921ccfba99e9ed45050f030e2dd291514b3dacdb114f1: Status 404 returned error can't find the container with id 6a5afa46d44adbcb2ee921ccfba99e9ed45050f030e2dd291514b3dacdb114f1 Jul 07 16:47:48.413761 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:48.413724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxw67" event={"ID":"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af","Type":"ContainerStarted","Data":"6a5afa46d44adbcb2ee921ccfba99e9ed45050f030e2dd291514b3dacdb114f1"} Jul 07 16:47:49.198261 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.197376 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2"] Jul 07 16:47:49.210135 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.210108 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.210584 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.210517 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd"] Jul 07 16:47:49.213076 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.213052 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 16:47:49.214436 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.214406 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 16:47:49.214609 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.214587 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 16:47:49.214609 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.214601 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 16:47:49.224014 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.223996 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" Jul 07 16:47:49.227862 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.227700 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t29nk\"" Jul 07 16:47:49.228194 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.227984 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 07 16:47:49.231914 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.231181 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2"] Jul 07 16:47:49.232895 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.232851 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd"] Jul 07 16:47:49.246233 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.246208 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2988a9ef-c66d-4be9-b960-27ddb13c7b7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66db7bbfb-t96cd\" (UID: \"2988a9ef-c66d-4be9-b960-27ddb13c7b7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" Jul 07 16:47:49.246363 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.246251 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0c9a358-9857-4668-98e3-a08b90ce7099-klusterlet-config\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.246429 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.246356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bh8j\" (UniqueName: \"kubernetes.io/projected/e0c9a358-9857-4668-98e3-a08b90ce7099-kube-api-access-9bh8j\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.246495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.246427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c9a358-9857-4668-98e3-a08b90ce7099-tmp\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.246495 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.246455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjsn9\" (UniqueName: \"kubernetes.io/projected/2988a9ef-c66d-4be9-b960-27ddb13c7b7f-kube-api-access-zjsn9\") pod \"managed-serviceaccount-addon-agent-66db7bbfb-t96cd\" (UID: \"2988a9ef-c66d-4be9-b960-27ddb13c7b7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" Jul 07 16:47:49.347481 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.347450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2988a9ef-c66d-4be9-b960-27ddb13c7b7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66db7bbfb-t96cd\" (UID: \"2988a9ef-c66d-4be9-b960-27ddb13c7b7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" Jul 07 16:47:49.347634 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.347499 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0c9a358-9857-4668-98e3-a08b90ce7099-klusterlet-config\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.347634 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.347555 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bh8j\" (UniqueName: \"kubernetes.io/projected/e0c9a358-9857-4668-98e3-a08b90ce7099-kube-api-access-9bh8j\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.347634 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.347601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c9a358-9857-4668-98e3-a08b90ce7099-tmp\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.347634 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.347629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjsn9\" (UniqueName: \"kubernetes.io/projected/2988a9ef-c66d-4be9-b960-27ddb13c7b7f-kube-api-access-zjsn9\") pod \"managed-serviceaccount-addon-agent-66db7bbfb-t96cd\" (UID: \"2988a9ef-c66d-4be9-b960-27ddb13c7b7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" Jul 07 16:47:49.348197 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.348170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c9a358-9857-4668-98e3-a08b90ce7099-tmp\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.350629 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.350580 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e0c9a358-9857-4668-98e3-a08b90ce7099-klusterlet-config\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.350916 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.350893 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2988a9ef-c66d-4be9-b960-27ddb13c7b7f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-66db7bbfb-t96cd\" (UID: \"2988a9ef-c66d-4be9-b960-27ddb13c7b7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" Jul 07 16:47:49.385542 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.385512 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bh8j\" (UniqueName: \"kubernetes.io/projected/e0c9a358-9857-4668-98e3-a08b90ce7099-kube-api-access-9bh8j\") pod \"klusterlet-addon-workmgr-cfdc7f957-p58x2\" (UID: \"e0c9a358-9857-4668-98e3-a08b90ce7099\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.385542 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.385527 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjsn9\" (UniqueName: \"kubernetes.io/projected/2988a9ef-c66d-4be9-b960-27ddb13c7b7f-kube-api-access-zjsn9\") pod \"managed-serviceaccount-addon-agent-66db7bbfb-t96cd\" (UID: \"2988a9ef-c66d-4be9-b960-27ddb13c7b7f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" Jul 07 16:47:49.439538 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.439503 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5465489565-pqtfj"] Jul 07 16:47:49.479062 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.478990 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5465489565-pqtfj"] Jul 07 16:47:49.479204 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.479102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.485150 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.485113 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 16:47:49.485308 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.485113 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 16:47:49.485417 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.485399 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xv5k5\"" Jul 07 16:47:49.485916 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.485698 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 16:47:49.489460 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.489437 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 16:47:49.521947 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.521928 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:49.542241 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.542209 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" Jul 07 16:47:49.549743 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.549719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d05f9b0f-91a1-4bbd-b194-edcbf237baec-trusted-ca\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.549877 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.549769 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d05f9b0f-91a1-4bbd-b194-edcbf237baec-installation-pull-secrets\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.549877 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.549800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d05f9b0f-91a1-4bbd-b194-edcbf237baec-ca-trust-extracted\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.549999 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.549885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d05f9b0f-91a1-4bbd-b194-edcbf237baec-registry-certificates\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.549999 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.549942 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-registry-tls\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.549999 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.549972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-bound-sa-token\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.550128 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.550030 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxfl9\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-kube-api-access-nxfl9\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.550128 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.550062 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d05f9b0f-91a1-4bbd-b194-edcbf237baec-image-registry-private-configuration\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.650684 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.650610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d05f9b0f-91a1-4bbd-b194-edcbf237baec-installation-pull-secrets\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.650684 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.650646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d05f9b0f-91a1-4bbd-b194-edcbf237baec-ca-trust-extracted\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.650684 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.650671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d05f9b0f-91a1-4bbd-b194-edcbf237baec-registry-certificates\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.650952 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.650712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-registry-tls\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.650952 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.650742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-bound-sa-token\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.651048 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.650980 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxfl9\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-kube-api-access-nxfl9\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.651048 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.651025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d05f9b0f-91a1-4bbd-b194-edcbf237baec-image-registry-private-configuration\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.651197 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.651072 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d05f9b0f-91a1-4bbd-b194-edcbf237baec-trusted-ca\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.651262 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.651242 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d05f9b0f-91a1-4bbd-b194-edcbf237baec-ca-trust-extracted\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.651978 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.651704 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d05f9b0f-91a1-4bbd-b194-edcbf237baec-registry-certificates\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.652281 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.652256 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d05f9b0f-91a1-4bbd-b194-edcbf237baec-trusted-ca\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.654488 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.654466 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d05f9b0f-91a1-4bbd-b194-edcbf237baec-image-registry-private-configuration\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.655833 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.655774 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d05f9b0f-91a1-4bbd-b194-edcbf237baec-installation-pull-secrets\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.656458 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.656436 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-registry-tls\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.665775 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.665737 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxfl9\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-kube-api-access-nxfl9\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.666200 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.666176 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d05f9b0f-91a1-4bbd-b194-edcbf237baec-bound-sa-token\") pod \"image-registry-5465489565-pqtfj\" (UID: \"d05f9b0f-91a1-4bbd-b194-edcbf237baec\") " pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:49.699732 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.699707 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2"] Jul 07 16:47:49.702984 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:49.702957 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c9a358_9857_4668_98e3_a08b90ce7099.slice/crio-fe4728179e9cf9fc416bf8128e94794d756ef02562344def628516a5454a8a14 WatchSource:0}: Error finding container fe4728179e9cf9fc416bf8128e94794d756ef02562344def628516a5454a8a14: Status 404 returned error can't find the container with id fe4728179e9cf9fc416bf8128e94794d756ef02562344def628516a5454a8a14 Jul 07 16:47:49.715939 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.715918 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd"] Jul 07 16:47:49.718490 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:49.718459 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2988a9ef_c66d_4be9_b960_27ddb13c7b7f.slice/crio-cd9928fd24776d0a3776a1e7910891a67824e086440e7c21fd8a92dea1ac7d91 WatchSource:0}: Error finding container cd9928fd24776d0a3776a1e7910891a67824e086440e7c21fd8a92dea1ac7d91: Status 404 returned error can't find the container with id cd9928fd24776d0a3776a1e7910891a67824e086440e7c21fd8a92dea1ac7d91 Jul 07 16:47:49.795768 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:49.795718 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:50.426881 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:50.426846 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" event={"ID":"2988a9ef-c66d-4be9-b960-27ddb13c7b7f","Type":"ContainerStarted","Data":"cd9928fd24776d0a3776a1e7910891a67824e086440e7c21fd8a92dea1ac7d91"} Jul 07 16:47:50.428164 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:50.428126 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" event={"ID":"e0c9a358-9857-4668-98e3-a08b90ce7099","Type":"ContainerStarted","Data":"fe4728179e9cf9fc416bf8128e94794d756ef02562344def628516a5454a8a14"} Jul 07 16:47:52.237019 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:52.236886 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5465489565-pqtfj"] Jul 07 16:47:52.242363 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:47:52.242339 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05f9b0f_91a1_4bbd_b194_edcbf237baec.slice/crio-11ea9bdfb200bddd7f4cca32ad87cde79433caeaa77f875b21827b65e2f56812 WatchSource:0}: Error finding container 11ea9bdfb200bddd7f4cca32ad87cde79433caeaa77f875b21827b65e2f56812: Status 404 returned error can't find the container with id 11ea9bdfb200bddd7f4cca32ad87cde79433caeaa77f875b21827b65e2f56812 Jul 07 16:47:52.394172 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:52.394092 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pjq9z" Jul 07 16:47:52.442140 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:52.441173 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxw67" event={"ID":"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af","Type":"ContainerStarted","Data":"3e369e94d9786449cae9bd574a20aa21ddec9fdfa55292c7cffba69e53e1ea17"} Jul 07 16:47:52.444034 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:52.444002 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5465489565-pqtfj" event={"ID":"d05f9b0f-91a1-4bbd-b194-edcbf237baec","Type":"ContainerStarted","Data":"964d796928c5a7c347b11182d68a85c96f716f2a448af25b09d57daf0f215f11"} Jul 07 16:47:52.444158 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:52.444057 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5465489565-pqtfj" event={"ID":"d05f9b0f-91a1-4bbd-b194-edcbf237baec","Type":"ContainerStarted","Data":"11ea9bdfb200bddd7f4cca32ad87cde79433caeaa77f875b21827b65e2f56812"} Jul 07 16:47:52.444777 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:52.444756 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:47:53.449170 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:53.449133 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxw67" event={"ID":"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af","Type":"ContainerStarted","Data":"206bcc02c1e9d7ac22600df4639ba6f4453c974273d8fbbf3d71c618a8d554ee"} Jul 07 16:47:57.465881 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.465840 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" event={"ID":"2988a9ef-c66d-4be9-b960-27ddb13c7b7f","Type":"ContainerStarted","Data":"097decbf12872989d6b3592a6b1e6424a4700c5670d27349abfa9a0e2c8a23e7"} Jul 07 16:47:57.467328 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.467302 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" event={"ID":"e0c9a358-9857-4668-98e3-a08b90ce7099","Type":"ContainerStarted","Data":"a21e5475f2c46c9b985e096244bd636a1bf048e0d30b4fa222ad0f67a9041869"} Jul 07 16:47:57.467488 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.467473 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:57.469144 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.469128 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" Jul 07 16:47:57.469400 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.469382 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxw67" event={"ID":"ed8bafdc-1e11-46c7-93e2-ef2cb0e453af","Type":"ContainerStarted","Data":"1854a1ca4ae98213ae8628029c252e017b6f363de7fbe69517d42941a686930b"} Jul 07 16:47:57.510547 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.510498 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-66db7bbfb-t96cd" podStartSLOduration=1.714685593 podStartE2EDuration="8.510485079s" totalImagesPullingTime="6.795799486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:57.510157228 +0000 UTC m=+116.028360565" watchObservedRunningTime="2026-07-07 16:47:57.510485079 +0000 UTC m=+116.028688413" Jul 07 16:47:57.510702 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.510584 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5465489565-pqtfj" podStartSLOduration=8.510576952 podStartE2EDuration="8.510576952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:52.467450959 +0000 UTC m=+110.985654294" watchObservedRunningTime="2026-07-07 16:47:57.510576952 +0000 UTC m=+116.028780289" Jul 07 16:47:57.535864 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.535811 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-cfdc7f957-p58x2" podStartSLOduration=1.702479549 podStartE2EDuration="8.535795821s" totalImagesPullingTime="6.833316272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:57.534967328 +0000 UTC m=+116.053170661" watchObservedRunningTime="2026-07-07 16:47:57.535795821 +0000 UTC m=+116.053999133" Jul 07 16:47:57.584203 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:47:57.584162 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wxw67" podStartSLOduration=34.26207946 podStartE2EDuration="42.584149411s" totalImagesPullingTime="8.322069951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:47:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:57.581078158 +0000 UTC m=+116.099281493" watchObservedRunningTime="2026-07-07 16:47:57.584149411 +0000 UTC m=+116.102352745" Jul 07 16:48:01.855756 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.855719 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4w59x"] Jul 07 16:48:01.858891 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.858870 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.862839 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.862804 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fzkwc\"" Jul 07 16:48:01.863077 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.863053 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:48:01.864132 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.864110 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:48:01.864448 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.864393 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:48:01.864448 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.864424 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:48:01.940082 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.940053 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h"] Jul 07 16:48:01.942402 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.942382 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:01.946658 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.946634 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 16:48:01.946781 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.946730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 16:48:01.946781 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.946766 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-s7bh2\"" Jul 07 16:48:01.946781 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.946773 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 16:48:01.954718 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-textfile\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.954792 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954727 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8q2k\" (UniqueName: \"kubernetes.io/projected/2abe619b-d4af-4688-8868-bfccd5040bfd-kube-api-access-n8q2k\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.954792 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954753 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.954897 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954802 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-wtmp\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.954897 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954842 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-root\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.954897 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-sys\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.954897 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2abe619b-d4af-4688-8868-bfccd5040bfd-metrics-client-ca\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.955075 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-tls\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.955075 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.954999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:01.957361 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:01.957340 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h"] Jul 07 16:48:02.056359 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056326 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-tls\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.056529 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.056529 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056391 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.056529 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e3f79c9a-65d7-4424-8484-6e369165306d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.056529 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056482 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mhl2\" (UniqueName: \"kubernetes.io/projected/e3f79c9a-65d7-4424-8484-6e369165306d-kube-api-access-7mhl2\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.056529 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056510 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-textfile\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056536 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8q2k\" (UniqueName: \"kubernetes.io/projected/2abe619b-d4af-4688-8868-bfccd5040bfd-kube-api-access-n8q2k\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f79c9a-65d7-4424-8484-6e369165306d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-wtmp\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056622 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056639 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-root\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-sys\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.056750 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056742 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2abe619b-d4af-4688-8868-bfccd5040bfd-metrics-client-ca\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.057076 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056801 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-root\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.057076 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056807 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-sys\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.057076 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056805 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-wtmp\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.057076 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.056849 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-textfile\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.060096 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.060070 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:48:02.060215 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.060198 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:48:02.060215 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.060207 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:48:02.061292 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.061274 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:48:02.066883 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:48:02.066864 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 16:48:02.066965 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:48:02.066925 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-tls podName:2abe619b-d4af-4688-8868-bfccd5040bfd nodeName:}" failed. No retries permitted until 2026-07-07 16:48:02.566904574 +0000 UTC m=+121.085107901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-tls") pod "node-exporter-4w59x" (UID: "2abe619b-d4af-4688-8868-bfccd5040bfd") : secret "node-exporter-tls" not found Jul 07 16:48:02.067276 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.067259 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.067349 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.067336 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2abe619b-d4af-4688-8868-bfccd5040bfd-metrics-client-ca\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.068915 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.068896 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.076721 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.076701 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8q2k\" (UniqueName: \"kubernetes.io/projected/2abe619b-d4af-4688-8868-bfccd5040bfd-kube-api-access-n8q2k\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.157190 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.157110 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.157190 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.157165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e3f79c9a-65d7-4424-8484-6e369165306d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.157366 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.157283 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mhl2\" (UniqueName: \"kubernetes.io/projected/e3f79c9a-65d7-4424-8484-6e369165306d-kube-api-access-7mhl2\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.157366 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.157345 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f79c9a-65d7-4424-8484-6e369165306d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.157503 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.157384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.157503 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.157408 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.157503 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.157473 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e3f79c9a-65d7-4424-8484-6e369165306d-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.157653 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:48:02.157513 2572 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 16:48:02.157653 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:48:02.157588 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-tls podName:e3f79c9a-65d7-4424-8484-6e369165306d nodeName:}" failed. No retries permitted until 2026-07-07 16:48:02.657568161 +0000 UTC m=+121.175771487 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-pkw4h" (UID: "e3f79c9a-65d7-4424-8484-6e369165306d") : secret "kube-state-metrics-tls" not found Jul 07 16:48:02.158073 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.158051 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.158170 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.158105 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f79c9a-65d7-4424-8484-6e369165306d-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.159632 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.159608 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.202589 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.202560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mhl2\" (UniqueName: \"kubernetes.io/projected/e3f79c9a-65d7-4424-8484-6e369165306d-kube-api-access-7mhl2\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.660675 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.660640 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.660866 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.660687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-tls\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.663053 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.663021 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2abe619b-d4af-4688-8868-bfccd5040bfd-node-exporter-tls\") pod \"node-exporter-4w59x\" (UID: \"2abe619b-d4af-4688-8868-bfccd5040bfd\") " pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.663155 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.663076 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e3f79c9a-65d7-4424-8484-6e369165306d-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-pkw4h\" (UID: \"e3f79c9a-65d7-4424-8484-6e369165306d\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.775149 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.775118 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fzkwc\"" Jul 07 16:48:02.779194 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.779172 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4w59x" Jul 07 16:48:02.789308 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:48:02.789279 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abe619b_d4af_4688_8868_bfccd5040bfd.slice/crio-755d53316744dcd127afebff20750cdeb1e62790c8fb9623c92735119634137d WatchSource:0}: Error finding container 755d53316744dcd127afebff20750cdeb1e62790c8fb9623c92735119634137d: Status 404 returned error can't find the container with id 755d53316744dcd127afebff20750cdeb1e62790c8fb9623c92735119634137d Jul 07 16:48:02.851626 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.851582 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" Jul 07 16:48:02.990773 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:02.990737 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h"] Jul 07 16:48:02.993758 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:48:02.993733 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f79c9a_65d7_4424_8484_6e369165306d.slice/crio-fa59db6eee7c81c0af0c2b7f401de47cb57317d0dab0e8100dbf8302795d57b7 WatchSource:0}: Error finding container fa59db6eee7c81c0af0c2b7f401de47cb57317d0dab0e8100dbf8302795d57b7: Status 404 returned error can't find the container with id fa59db6eee7c81c0af0c2b7f401de47cb57317d0dab0e8100dbf8302795d57b7 Jul 07 16:48:03.492138 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:03.492099 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4w59x" event={"ID":"2abe619b-d4af-4688-8868-bfccd5040bfd","Type":"ContainerStarted","Data":"755d53316744dcd127afebff20750cdeb1e62790c8fb9623c92735119634137d"} Jul 07 16:48:03.493349 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:03.493316 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" event={"ID":"e3f79c9a-65d7-4424-8484-6e369165306d","Type":"ContainerStarted","Data":"fa59db6eee7c81c0af0c2b7f401de47cb57317d0dab0e8100dbf8302795d57b7"} Jul 07 16:48:04.498527 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:04.498454 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" event={"ID":"e3f79c9a-65d7-4424-8484-6e369165306d","Type":"ContainerStarted","Data":"e025408f8aef7a08a1ad7b1bebd8e00cfdb705b8e425992b9af5b096d84c93f8"} Jul 07 16:48:04.498527 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:04.498521 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" event={"ID":"e3f79c9a-65d7-4424-8484-6e369165306d","Type":"ContainerStarted","Data":"bfc8a1f82c72d7fec53c5188fda1ffe447f59017fb181922a4717e8d51a573fd"} Jul 07 16:48:04.498985 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:04.498549 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" event={"ID":"e3f79c9a-65d7-4424-8484-6e369165306d","Type":"ContainerStarted","Data":"6494f31c47e0b26f8f6a7d5b7135a81ffce0e56ed813c523c03eae11c2b40818"} Jul 07 16:48:04.500043 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:04.500023 2572 generic.go:356] "Generic (PLEG): container finished" podID="2abe619b-d4af-4688-8868-bfccd5040bfd" containerID="c54ed232c0c36c81ee6e5d1faf2da585fe898f309c3748ebdaaf27906e1c718b" exitCode=0 Jul 07 16:48:04.500109 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:04.500097 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4w59x" event={"ID":"2abe619b-d4af-4688-8868-bfccd5040bfd","Type":"ContainerDied","Data":"c54ed232c0c36c81ee6e5d1faf2da585fe898f309c3748ebdaaf27906e1c718b"} Jul 07 16:48:04.572071 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:04.570907 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-pkw4h" podStartSLOduration=2.351418591 podStartE2EDuration="3.570887854s" totalImagesPullingTime="1.219469263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:04.569753331 +0000 UTC m=+123.087956668" watchObservedRunningTime="2026-07-07 16:48:04.570887854 +0000 UTC m=+123.089091191" Jul 07 16:48:05.505901 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:05.505856 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4w59x" event={"ID":"2abe619b-d4af-4688-8868-bfccd5040bfd","Type":"ContainerStarted","Data":"d3e4f8e56ddd1c320876b4846c4cd3511328bf07adda5cd14250814469397036"} Jul 07 16:48:05.506237 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:05.505930 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4w59x" event={"ID":"2abe619b-d4af-4688-8868-bfccd5040bfd","Type":"ContainerStarted","Data":"b2fa7ea66063e3bc8ba26d817c2c5d14fdccb139ea5bb71fee34a489b094bda5"} Jul 07 16:48:05.541006 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:05.540956 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4w59x" podStartSLOduration=3.548750641 podStartE2EDuration="4.54093993s" totalImagesPullingTime="915.921602ms" totalInitContainerRuntime="76.267687ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:05.540518611 +0000 UTC m=+124.058721945" watchObservedRunningTime="2026-07-07 16:48:05.54093993 +0000 UTC m=+124.059143296" Jul 07 16:48:07.060388 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.060356 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-76c9fd44b5-rksd7"] Jul 07 16:48:07.062638 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.062621 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.071077 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.071057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 16:48:07.071169 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.071093 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 16:48:07.071169 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.071120 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 16:48:07.071718 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.071696 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 16:48:07.071800 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.071741 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 16:48:07.071800 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.071752 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wct5m\"" Jul 07 16:48:07.078722 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.078701 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 16:48:07.091336 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.091312 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76c9fd44b5-rksd7"] Jul 07 16:48:07.195994 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.195970 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-federate-client-tls\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.196096 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.196023 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-telemeter-client-tls\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.196096 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.196060 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.196096 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.196078 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-serving-certs-ca-bundle\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.196096 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.196095 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-secret-telemeter-client\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.196246 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.196151 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-metrics-client-ca\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.196246 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.196185 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.196246 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.196212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbs8d\" (UniqueName: \"kubernetes.io/projected/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-kube-api-access-xbs8d\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.297400 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.297373 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-telemeter-client-tls\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.297489 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.297413 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.297489 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.297439 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-serving-certs-ca-bundle\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.297640 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.297618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-secret-telemeter-client\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.297685 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.297656 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-metrics-client-ca\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.297723 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.297712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.297773 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.297752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbs8d\" (UniqueName: \"kubernetes.io/projected/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-kube-api-access-xbs8d\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.297852 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.297786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-federate-client-tls\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.298257 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.298237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-serving-certs-ca-bundle\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.298442 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.298420 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-metrics-client-ca\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.298604 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.298583 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.300110 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.300079 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.300208 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.300118 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-secret-telemeter-client\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.300270 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.300207 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-telemeter-client-tls\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.300270 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.300214 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-federate-client-tls\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.308467 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.308447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbs8d\" (UniqueName: \"kubernetes.io/projected/59589fa5-cd9c-4cc0-bcad-7fd8161980f7-kube-api-access-xbs8d\") pod \"telemeter-client-76c9fd44b5-rksd7\" (UID: \"59589fa5-cd9c-4cc0-bcad-7fd8161980f7\") " pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.371466 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.371390 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" Jul 07 16:48:07.523868 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:07.523770 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76c9fd44b5-rksd7"] Jul 07 16:48:07.527874 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:48:07.527848 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59589fa5_cd9c_4cc0_bcad_7fd8161980f7.slice/crio-3ec5bfa74a10b1321e87b520edbfb72e3bda22f2d5360df7fe6d00b25b45eb14 WatchSource:0}: Error finding container 3ec5bfa74a10b1321e87b520edbfb72e3bda22f2d5360df7fe6d00b25b45eb14: Status 404 returned error can't find the container with id 3ec5bfa74a10b1321e87b520edbfb72e3bda22f2d5360df7fe6d00b25b45eb14 Jul 07 16:48:08.521258 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:08.521211 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" event={"ID":"59589fa5-cd9c-4cc0-bcad-7fd8161980f7","Type":"ContainerStarted","Data":"3ec5bfa74a10b1321e87b520edbfb72e3bda22f2d5360df7fe6d00b25b45eb14"} Jul 07 16:48:09.526007 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:09.525968 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" event={"ID":"59589fa5-cd9c-4cc0-bcad-7fd8161980f7","Type":"ContainerStarted","Data":"c3fa3c5bfde64d7e83bb61c6b0617595dc37219a690833caddcb892d2e22335d"} Jul 07 16:48:11.534257 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:11.534221 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" event={"ID":"59589fa5-cd9c-4cc0-bcad-7fd8161980f7","Type":"ContainerStarted","Data":"413e2260a355b8136a43e01d07011b858904269a08478305a286650124c3db0a"} Jul 07 16:48:11.534804 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:11.534274 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" event={"ID":"59589fa5-cd9c-4cc0-bcad-7fd8161980f7","Type":"ContainerStarted","Data":"4348e6c31fe4c275ca3c3918fc51fbad49c0712856caba0999c514d0e337b153"} Jul 07 16:48:11.832121 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:11.832036 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:48:11.834351 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:11.834314 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0013c995-6334-4215-875b-694d671f8a29-metrics-certs\") pod \"network-metrics-daemon-r8wcc\" (UID: \"0013c995-6334-4215-875b-694d671f8a29\") " pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:48:12.039528 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.039505 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rsbn5\"" Jul 07 16:48:12.046966 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.046949 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r8wcc" Jul 07 16:48:12.192872 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.192801 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-76c9fd44b5-rksd7" podStartSLOduration=2.2192508220000002 podStartE2EDuration="5.192781607s" totalImagesPullingTime="2.973530785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:48:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:11.568861604 +0000 UTC m=+130.087064937" watchObservedRunningTime="2026-07-07 16:48:12.192781607 +0000 UTC m=+130.710984941" Jul 07 16:48:12.193694 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.193671 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r8wcc"] Jul 07 16:48:12.195997 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:48:12.195973 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0013c995_6334_4215_875b_694d671f8a29.slice/crio-92badc44244ea9881decb2ba9582c960d540484d7491fe6eea6ada216bae8130 WatchSource:0}: Error finding container 92badc44244ea9881decb2ba9582c960d540484d7491fe6eea6ada216bae8130: Status 404 returned error can't find the container with id 92badc44244ea9881decb2ba9582c960d540484d7491fe6eea6ada216bae8130 Jul 07 16:48:12.539135 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.539100 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8wcc" event={"ID":"0013c995-6334-4215-875b-694d671f8a29","Type":"ContainerStarted","Data":"92badc44244ea9881decb2ba9582c960d540484d7491fe6eea6ada216bae8130"} Jul 07 16:48:12.884027 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.883942 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56bf7c6c4c-g2kgq"] Jul 07 16:48:12.887422 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.887402 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:12.893641 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.893617 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:48:12.893778 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.893639 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:48:12.894293 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.894272 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:48:12.895353 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.895286 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2q9xq\"" Jul 07 16:48:12.895594 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.895534 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:48:12.895681 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.895632 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:48:12.895996 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.895816 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:48:12.895996 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.895930 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:48:12.900519 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.900500 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 16:48:12.908678 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:12.908655 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56bf7c6c4c-g2kgq"] Jul 07 16:48:13.040754 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.040692 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-console-config\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.040754 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.040737 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-service-ca\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.040754 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.040758 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-oauth-serving-cert\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.041057 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.040800 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-serving-cert\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.041057 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.040861 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-trusted-ca-bundle\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.041057 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.040879 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grkvt\" (UniqueName: \"kubernetes.io/projected/c56fed64-f2f1-4095-9454-5e813e881e6a-kube-api-access-grkvt\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.041057 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.040936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-oauth-config\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.142048 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.141971 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-oauth-serving-cert\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.142048 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-serving-cert\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.142253 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142083 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-trusted-ca-bundle\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.142253 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142108 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grkvt\" (UniqueName: \"kubernetes.io/projected/c56fed64-f2f1-4095-9454-5e813e881e6a-kube-api-access-grkvt\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.142253 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-oauth-config\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.142253 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142223 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-console-config\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.142459 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142256 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-service-ca\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.142924 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142869 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-oauth-serving-cert\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.143047 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142927 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-service-ca\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.143047 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.142977 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-trusted-ca-bundle\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.143171 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.143083 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-console-config\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.144733 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.144713 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-serving-cert\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.144947 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.144926 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-oauth-config\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.158169 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.158140 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grkvt\" (UniqueName: \"kubernetes.io/projected/c56fed64-f2f1-4095-9454-5e813e881e6a-kube-api-access-grkvt\") pod \"console-56bf7c6c4c-g2kgq\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.200633 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.200597 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:13.424581 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.424501 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56bf7c6c4c-g2kgq"] Jul 07 16:48:13.429421 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:48:13.429395 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56fed64_f2f1_4095_9454_5e813e881e6a.slice/crio-d5045ff682682474db0bdc1e4669a810eda81da3b9325f06d6e6eddd4d05ffd2 WatchSource:0}: Error finding container d5045ff682682474db0bdc1e4669a810eda81da3b9325f06d6e6eddd4d05ffd2: Status 404 returned error can't find the container with id d5045ff682682474db0bdc1e4669a810eda81da3b9325f06d6e6eddd4d05ffd2 Jul 07 16:48:13.543727 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.543697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8wcc" event={"ID":"0013c995-6334-4215-875b-694d671f8a29","Type":"ContainerStarted","Data":"bd14a512b67560e7510ca9e74ca9f45bb91ee317f5234adeae954c26d346efea"} Jul 07 16:48:13.544080 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.543759 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r8wcc" event={"ID":"0013c995-6334-4215-875b-694d671f8a29","Type":"ContainerStarted","Data":"ee5b2a39636fde8260be559b211caf56568cb73400551dbfc2015b72c77fa864"} Jul 07 16:48:13.544938 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.544918 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bf7c6c4c-g2kgq" event={"ID":"c56fed64-f2f1-4095-9454-5e813e881e6a","Type":"ContainerStarted","Data":"d5045ff682682474db0bdc1e4669a810eda81da3b9325f06d6e6eddd4d05ffd2"} Jul 07 16:48:13.571773 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:13.571725 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r8wcc" podStartSLOduration=130.446365171 podStartE2EDuration="2m11.571710797s" totalImagesPullingTime="1.125345626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:13.571286648 +0000 UTC m=+132.089489981" watchObservedRunningTime="2026-07-07 16:48:13.571710797 +0000 UTC m=+132.089914130" Jul 07 16:48:14.459846 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:14.459802 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5465489565-pqtfj" Jul 07 16:48:16.558366 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:16.558331 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bf7c6c4c-g2kgq" event={"ID":"c56fed64-f2f1-4095-9454-5e813e881e6a","Type":"ContainerStarted","Data":"a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a"} Jul 07 16:48:16.585627 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:16.585579 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56bf7c6c4c-g2kgq" podStartSLOduration=1.979884709 podStartE2EDuration="4.585563891s" totalImagesPullingTime="2.605679182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:48:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:48:16.584194164 +0000 UTC m=+135.102397499" watchObservedRunningTime="2026-07-07 16:48:16.585563891 +0000 UTC m=+135.103767225" Jul 07 16:48:23.201679 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:23.201638 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:23.202081 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:23.201718 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:23.206513 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:23.206490 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:23.587730 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:23.587654 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:48:35.624311 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:35.624244 2572 generic.go:356] "Generic (PLEG): container finished" podID="d3f590db-ee36-45d1-a652-0183b053cb69" containerID="417f8eebb95c636036078bbd0b0e39d48842bfe8e08096a0f12a48d32d76286f" exitCode=0 Jul 07 16:48:35.624681 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:35.624320 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" event={"ID":"d3f590db-ee36-45d1-a652-0183b053cb69","Type":"ContainerDied","Data":"417f8eebb95c636036078bbd0b0e39d48842bfe8e08096a0f12a48d32d76286f"} Jul 07 16:48:35.624681 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:35.624605 2572 scope.go:117] "RemoveContainer" containerID="417f8eebb95c636036078bbd0b0e39d48842bfe8e08096a0f12a48d32d76286f" Jul 07 16:48:36.629298 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:48:36.629265 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qh2nc" event={"ID":"d3f590db-ee36-45d1-a652-0183b053cb69","Type":"ContainerStarted","Data":"9f8f198c9c706ba6857f71c030bb27ec6bb7b49bc0cd5f9dd9ef8393b36ccb70"} Jul 07 16:49:47.040784 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:49:47.040751 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56bf7c6c4c-g2kgq"] Jul 07 16:50:12.061706 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.061651 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56bf7c6c4c-g2kgq" podUID="c56fed64-f2f1-4095-9454-5e813e881e6a" containerName="console" containerID="cri-o://a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a" gracePeriod=15 Jul 07 16:50:12.298508 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.298484 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:50:12.351258 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351177 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-oauth-config\") pod \"c56fed64-f2f1-4095-9454-5e813e881e6a\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " Jul 07 16:50:12.351258 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351221 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-oauth-serving-cert\") pod \"c56fed64-f2f1-4095-9454-5e813e881e6a\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " Jul 07 16:50:12.351258 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351252 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-trusted-ca-bundle\") pod \"c56fed64-f2f1-4095-9454-5e813e881e6a\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " Jul 07 16:50:12.351532 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351286 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-service-ca\") pod \"c56fed64-f2f1-4095-9454-5e813e881e6a\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " Jul 07 16:50:12.351532 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351308 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-serving-cert\") pod \"c56fed64-f2f1-4095-9454-5e813e881e6a\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " Jul 07 16:50:12.351532 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351331 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-console-config\") pod \"c56fed64-f2f1-4095-9454-5e813e881e6a\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " Jul 07 16:50:12.351532 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351380 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grkvt\" (UniqueName: \"kubernetes.io/projected/c56fed64-f2f1-4095-9454-5e813e881e6a-kube-api-access-grkvt\") pod \"c56fed64-f2f1-4095-9454-5e813e881e6a\" (UID: \"c56fed64-f2f1-4095-9454-5e813e881e6a\") " Jul 07 16:50:12.351738 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351707 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-service-ca" (OuterVolumeSpecName: "service-ca") pod "c56fed64-f2f1-4095-9454-5e813e881e6a" (UID: "c56fed64-f2f1-4095-9454-5e813e881e6a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:50:12.351799 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351737 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c56fed64-f2f1-4095-9454-5e813e881e6a" (UID: "c56fed64-f2f1-4095-9454-5e813e881e6a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:50:12.351799 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351747 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c56fed64-f2f1-4095-9454-5e813e881e6a" (UID: "c56fed64-f2f1-4095-9454-5e813e881e6a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:50:12.351983 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.351858 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-console-config" (OuterVolumeSpecName: "console-config") pod "c56fed64-f2f1-4095-9454-5e813e881e6a" (UID: "c56fed64-f2f1-4095-9454-5e813e881e6a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:50:12.353630 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.353608 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56fed64-f2f1-4095-9454-5e813e881e6a-kube-api-access-grkvt" (OuterVolumeSpecName: "kube-api-access-grkvt") pod "c56fed64-f2f1-4095-9454-5e813e881e6a" (UID: "c56fed64-f2f1-4095-9454-5e813e881e6a"). InnerVolumeSpecName "kube-api-access-grkvt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:50:12.353630 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.353615 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c56fed64-f2f1-4095-9454-5e813e881e6a" (UID: "c56fed64-f2f1-4095-9454-5e813e881e6a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:50:12.353734 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.353646 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c56fed64-f2f1-4095-9454-5e813e881e6a" (UID: "c56fed64-f2f1-4095-9454-5e813e881e6a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:50:12.451991 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.451965 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-service-ca\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:50:12.451991 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.451987 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-serving-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:50:12.451991 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.451996 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-console-config\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:50:12.452191 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.452007 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grkvt\" (UniqueName: \"kubernetes.io/projected/c56fed64-f2f1-4095-9454-5e813e881e6a-kube-api-access-grkvt\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:50:12.452191 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.452016 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56fed64-f2f1-4095-9454-5e813e881e6a-console-oauth-config\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:50:12.452191 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.452024 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-oauth-serving-cert\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:50:12.452191 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.452032 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c56fed64-f2f1-4095-9454-5e813e881e6a-trusted-ca-bundle\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:50:12.967492 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.967454 2572 generic.go:356] "Generic (PLEG): container finished" podID="c56fed64-f2f1-4095-9454-5e813e881e6a" containerID="a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a" exitCode=0 Jul 07 16:50:12.967672 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.967503 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bf7c6c4c-g2kgq" Jul 07 16:50:12.967672 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.967552 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bf7c6c4c-g2kgq" event={"ID":"c56fed64-f2f1-4095-9454-5e813e881e6a","Type":"ContainerDied","Data":"a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a"} Jul 07 16:50:12.967672 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.967608 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bf7c6c4c-g2kgq" event={"ID":"c56fed64-f2f1-4095-9454-5e813e881e6a","Type":"ContainerDied","Data":"d5045ff682682474db0bdc1e4669a810eda81da3b9325f06d6e6eddd4d05ffd2"} Jul 07 16:50:12.967672 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.967647 2572 scope.go:117] "RemoveContainer" containerID="a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a" Jul 07 16:50:12.976462 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.976443 2572 scope.go:117] "RemoveContainer" containerID="a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a" Jul 07 16:50:12.976720 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:50:12.976699 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a\": container with ID starting with a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a not found: ID does not exist" containerID="a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a" Jul 07 16:50:12.976807 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.976724 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a"} err="failed to get container status \"a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a\": rpc error: code = NotFound desc = could not find container \"a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a\": container with ID starting with a5f48331dd5f2f395fb52a5d3b078473778233f18b22e9449c4e996660e1d76a not found: ID does not exist" Jul 07 16:50:12.992592 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.992572 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56bf7c6c4c-g2kgq"] Jul 07 16:50:12.996622 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:12.996602 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56bf7c6c4c-g2kgq"] Jul 07 16:50:14.026165 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:50:14.026134 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56fed64-f2f1-4095-9454-5e813e881e6a" path="/var/lib/kubelet/pods/c56fed64-f2f1-4095-9454-5e813e881e6a/volumes" Jul 07 16:51:01.917931 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:01.917906 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 16:51:25.247118 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.247083 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-khdrt"] Jul 07 16:51:25.249485 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.247359 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56fed64-f2f1-4095-9454-5e813e881e6a" containerName="console" Jul 07 16:51:25.249485 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.247370 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56fed64-f2f1-4095-9454-5e813e881e6a" containerName="console" Jul 07 16:51:25.249485 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.247442 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c56fed64-f2f1-4095-9454-5e813e881e6a" containerName="console" Jul 07 16:51:25.250335 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.250320 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.253951 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.253928 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 07 16:51:25.253951 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.253941 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 07 16:51:25.254128 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.254049 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8hwtw\"" Jul 07 16:51:25.255179 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.255159 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 07 16:51:25.255179 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.255167 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 07 16:51:25.255333 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.255179 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 07 16:51:25.265893 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.265873 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-khdrt"] Jul 07 16:51:25.268785 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.268766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l69m6\" (UniqueName: \"kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-kube-api-access-l69m6\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.268899 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.268840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/adb6d338-be3a-4202-b8da-53db552122fc-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.268899 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.268877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-certificates\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.369921 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.369889 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l69m6\" (UniqueName: \"kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-kube-api-access-l69m6\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.370067 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.369945 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/adb6d338-be3a-4202-b8da-53db552122fc-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.370067 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.369970 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-certificates\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.370139 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:51:25.370085 2572 secret.go:281] references non-existent secret key: tls.crt Jul 07 16:51:25.370139 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:51:25.370102 2572 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 07 16:51:25.370139 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:51:25.370124 2572 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-khdrt: references non-existent secret key: tls.crt Jul 07 16:51:25.370234 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:51:25.370225 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-certificates podName:adb6d338-be3a-4202-b8da-53db552122fc nodeName:}" failed. No retries permitted until 2026-07-07 16:51:25.87019336 +0000 UTC m=+324.388396685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-certificates") pod "keda-metrics-apiserver-559f75f947-khdrt" (UID: "adb6d338-be3a-4202-b8da-53db552122fc") : references non-existent secret key: tls.crt Jul 07 16:51:25.370478 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.370461 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/adb6d338-be3a-4202-b8da-53db552122fc-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.382067 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.382040 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l69m6\" (UniqueName: \"kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-kube-api-access-l69m6\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.670922 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.670842 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-z5bmz"] Jul 07 16:51:25.674059 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.674044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:25.678537 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.678519 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 07 16:51:25.691220 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.691195 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-z5bmz"] Jul 07 16:51:25.773947 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.773915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fe06d38a-6e10-4c05-a02c-877db387ba5a-certificates\") pod \"keda-admission-5fbd5c4644-z5bmz\" (UID: \"fe06d38a-6e10-4c05-a02c-877db387ba5a\") " pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:25.774078 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.773950 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8t22\" (UniqueName: \"kubernetes.io/projected/fe06d38a-6e10-4c05-a02c-877db387ba5a-kube-api-access-h8t22\") pod \"keda-admission-5fbd5c4644-z5bmz\" (UID: \"fe06d38a-6e10-4c05-a02c-877db387ba5a\") " pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:25.874511 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.874487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-certificates\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.874646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.874530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fe06d38a-6e10-4c05-a02c-877db387ba5a-certificates\") pod \"keda-admission-5fbd5c4644-z5bmz\" (UID: \"fe06d38a-6e10-4c05-a02c-877db387ba5a\") " pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:25.874646 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.874556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8t22\" (UniqueName: \"kubernetes.io/projected/fe06d38a-6e10-4c05-a02c-877db387ba5a-kube-api-access-h8t22\") pod \"keda-admission-5fbd5c4644-z5bmz\" (UID: \"fe06d38a-6e10-4c05-a02c-877db387ba5a\") " pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:25.877117 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.877085 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/fe06d38a-6e10-4c05-a02c-877db387ba5a-certificates\") pod \"keda-admission-5fbd5c4644-z5bmz\" (UID: \"fe06d38a-6e10-4c05-a02c-877db387ba5a\") " pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:25.877222 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.877151 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/adb6d338-be3a-4202-b8da-53db552122fc-certificates\") pod \"keda-metrics-apiserver-559f75f947-khdrt\" (UID: \"adb6d338-be3a-4202-b8da-53db552122fc\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:25.889354 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.889332 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8t22\" (UniqueName: \"kubernetes.io/projected/fe06d38a-6e10-4c05-a02c-877db387ba5a-kube-api-access-h8t22\") pod \"keda-admission-5fbd5c4644-z5bmz\" (UID: \"fe06d38a-6e10-4c05-a02c-877db387ba5a\") " pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:25.983963 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:25.983932 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:26.125373 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:26.125333 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-z5bmz"] Jul 07 16:51:26.127572 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:51:26.127543 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe06d38a_6e10_4c05_a02c_877db387ba5a.slice/crio-7e104d18db22a386248924dddba9b26067a4a5ab011261b1e0328bbe97bd9387 WatchSource:0}: Error finding container 7e104d18db22a386248924dddba9b26067a4a5ab011261b1e0328bbe97bd9387: Status 404 returned error can't find the container with id 7e104d18db22a386248924dddba9b26067a4a5ab011261b1e0328bbe97bd9387 Jul 07 16:51:26.128929 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:26.128912 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:51:26.160334 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:26.160310 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:26.221695 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:26.221659 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" event={"ID":"fe06d38a-6e10-4c05-a02c-877db387ba5a","Type":"ContainerStarted","Data":"7e104d18db22a386248924dddba9b26067a4a5ab011261b1e0328bbe97bd9387"} Jul 07 16:51:26.318506 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:26.318480 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-khdrt"] Jul 07 16:51:26.320624 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:51:26.320595 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb6d338_be3a_4202_b8da_53db552122fc.slice/crio-4612d4e0d5627420de4265b7360ffca4c11cb3533f4cbc52593d382c8d580f4b WatchSource:0}: Error finding container 4612d4e0d5627420de4265b7360ffca4c11cb3533f4cbc52593d382c8d580f4b: Status 404 returned error can't find the container with id 4612d4e0d5627420de4265b7360ffca4c11cb3533f4cbc52593d382c8d580f4b Jul 07 16:51:27.226863 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:27.226833 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" event={"ID":"adb6d338-be3a-4202-b8da-53db552122fc","Type":"ContainerStarted","Data":"4612d4e0d5627420de4265b7360ffca4c11cb3533f4cbc52593d382c8d580f4b"} Jul 07 16:51:29.235879 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:29.235840 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" event={"ID":"fe06d38a-6e10-4c05-a02c-877db387ba5a","Type":"ContainerStarted","Data":"4e5ef76335088cc8e9033585f10cfbc9a8ceaeaa872b27abc4c47887bd29b2bc"} Jul 07 16:51:29.236230 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:29.235941 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:29.275335 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:29.275249 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" podStartSLOduration=1.393399898 podStartE2EDuration="4.275235046s" totalImagesPullingTime="2.881835148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:51:29.274657485 +0000 UTC m=+327.792860819" watchObservedRunningTime="2026-07-07 16:51:29.275235046 +0000 UTC m=+327.793438380" Jul 07 16:51:43.288401 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:43.288367 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" event={"ID":"adb6d338-be3a-4202-b8da-53db552122fc","Type":"ContainerStarted","Data":"9417f21cb132ad1388f0ce1c80d9abb1115f9550b0ecf3ddc99595cd5c94f145"} Jul 07 16:51:43.288836 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:43.288500 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:51:43.314305 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:43.314257 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" podStartSLOduration=2.075701302 podStartE2EDuration="18.314242598s" totalImagesPullingTime="16.238541296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:51:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:51:43.311842601 +0000 UTC m=+341.830045935" watchObservedRunningTime="2026-07-07 16:51:43.314242598 +0000 UTC m=+341.832445950" Jul 07 16:51:50.241898 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:50.241872 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-z5bmz" Jul 07 16:51:54.297130 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:51:54.297103 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-khdrt" Jul 07 16:52:36.556084 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.556049 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-62c2n"] Jul 07 16:52:36.558250 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.558218 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:36.561246 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.561224 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 16:52:36.561332 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.561224 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 07 16:52:36.563050 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.562877 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 16:52:36.563213 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.563196 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-lfczg\"" Jul 07 16:52:36.578550 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.578526 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-62c2n"] Jul 07 16:52:36.707486 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.707455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpmxp\" (UniqueName: \"kubernetes.io/projected/3f95f502-0dbb-4f07-9eda-88c3a8e1bab6-kube-api-access-fpmxp\") pod \"seaweedfs-64568bcd49-62c2n\" (UID: \"3f95f502-0dbb-4f07-9eda-88c3a8e1bab6\") " pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:36.707614 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.707496 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3f95f502-0dbb-4f07-9eda-88c3a8e1bab6-data\") pod \"seaweedfs-64568bcd49-62c2n\" (UID: \"3f95f502-0dbb-4f07-9eda-88c3a8e1bab6\") " pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:36.808545 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.808476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmxp\" (UniqueName: \"kubernetes.io/projected/3f95f502-0dbb-4f07-9eda-88c3a8e1bab6-kube-api-access-fpmxp\") pod \"seaweedfs-64568bcd49-62c2n\" (UID: \"3f95f502-0dbb-4f07-9eda-88c3a8e1bab6\") " pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:36.808545 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.808527 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3f95f502-0dbb-4f07-9eda-88c3a8e1bab6-data\") pod \"seaweedfs-64568bcd49-62c2n\" (UID: \"3f95f502-0dbb-4f07-9eda-88c3a8e1bab6\") " pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:36.808926 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.808908 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/3f95f502-0dbb-4f07-9eda-88c3a8e1bab6-data\") pod \"seaweedfs-64568bcd49-62c2n\" (UID: \"3f95f502-0dbb-4f07-9eda-88c3a8e1bab6\") " pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:36.831503 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.831478 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpmxp\" (UniqueName: \"kubernetes.io/projected/3f95f502-0dbb-4f07-9eda-88c3a8e1bab6-kube-api-access-fpmxp\") pod \"seaweedfs-64568bcd49-62c2n\" (UID: \"3f95f502-0dbb-4f07-9eda-88c3a8e1bab6\") " pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:36.873456 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:36.873434 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:37.020461 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:37.020432 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-62c2n"] Jul 07 16:52:37.023950 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:52:37.023924 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f95f502_0dbb_4f07_9eda_88c3a8e1bab6.slice/crio-4476a6d7e55e7deb32439963520e4b0ef11c64c86e5669987e71564b8b943066 WatchSource:0}: Error finding container 4476a6d7e55e7deb32439963520e4b0ef11c64c86e5669987e71564b8b943066: Status 404 returned error can't find the container with id 4476a6d7e55e7deb32439963520e4b0ef11c64c86e5669987e71564b8b943066 Jul 07 16:52:37.476252 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:37.476219 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-62c2n" event={"ID":"3f95f502-0dbb-4f07-9eda-88c3a8e1bab6","Type":"ContainerStarted","Data":"4476a6d7e55e7deb32439963520e4b0ef11c64c86e5669987e71564b8b943066"} Jul 07 16:52:41.493174 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:41.493143 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-62c2n" event={"ID":"3f95f502-0dbb-4f07-9eda-88c3a8e1bab6","Type":"ContainerStarted","Data":"aeaf8d3696207af4fe4cee1438c9d965736012ef72293c62ddf9f7f8f4077e54"} Jul 07 16:52:41.493510 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:41.493251 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:52:41.515664 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:41.515616 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-62c2n" podStartSLOduration=1.727075835 podStartE2EDuration="5.515600548s" totalImagesPullingTime="3.788524713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:41.513495848 +0000 UTC m=+400.031699187" watchObservedRunningTime="2026-07-07 16:52:41.515600548 +0000 UTC m=+400.033803883" Jul 07 16:52:47.499260 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:52:47.499230 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-62c2n" Jul 07 16:53:37.383701 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.383629 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64c4c7b8f4-rdkl7"] Jul 07 16:53:37.386647 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.386623 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.395714 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.395695 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:53:37.395856 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.395748 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:53:37.395964 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.395947 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:53:37.397403 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.397387 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:53:37.397403 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.397394 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:53:37.398167 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.398150 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:53:37.398260 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.398152 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2q9xq\"" Jul 07 16:53:37.398698 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.398683 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:53:37.403454 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.403422 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c4c7b8f4-rdkl7"] Jul 07 16:53:37.410025 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.410003 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 16:53:37.470928 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.470906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-service-ca\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.471029 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.470946 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-serving-cert\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.471029 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.470972 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wdmc\" (UniqueName: \"kubernetes.io/projected/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-kube-api-access-9wdmc\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.471101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.471033 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-trusted-ca-bundle\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.471101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.471063 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-oauth-config\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.471101 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.471081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-config\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.471192 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.471108 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-oauth-serving-cert\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.572441 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.572415 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-config\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.572543 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.572447 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-oauth-serving-cert\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.572543 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.572472 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-service-ca\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.572543 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.572501 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-serving-cert\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.572543 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.572538 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wdmc\" (UniqueName: \"kubernetes.io/projected/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-kube-api-access-9wdmc\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.572717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.572572 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-trusted-ca-bundle\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.572717 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.572602 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-oauth-config\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.573191 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.573166 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-config\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.573303 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.573257 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-oauth-serving-cert\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.573384 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.573362 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-service-ca\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.573459 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.573441 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-trusted-ca-bundle\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.574997 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.574979 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-serving-cert\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.575128 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.575109 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-console-oauth-config\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.588073 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.588051 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wdmc\" (UniqueName: \"kubernetes.io/projected/bd8a0551-f8c5-4995-9a4a-6e3cb911ad04-kube-api-access-9wdmc\") pod \"console-64c4c7b8f4-rdkl7\" (UID: \"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04\") " pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.695995 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.695974 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:37.831191 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:37.831164 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64c4c7b8f4-rdkl7"] Jul 07 16:53:37.834153 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:53:37.834127 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8a0551_f8c5_4995_9a4a_6e3cb911ad04.slice/crio-902aacbd1e761824b5a98a335e405d4bdd04a4b5de0cebf437a18fdb5c9937bd WatchSource:0}: Error finding container 902aacbd1e761824b5a98a335e405d4bdd04a4b5de0cebf437a18fdb5c9937bd: Status 404 returned error can't find the container with id 902aacbd1e761824b5a98a335e405d4bdd04a4b5de0cebf437a18fdb5c9937bd Jul 07 16:53:38.699118 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:38.699087 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4c7b8f4-rdkl7" event={"ID":"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04","Type":"ContainerStarted","Data":"b0a0f350057e12103d34bebb27ac169fb205cd075cf8df534a4f5b1bbd56f1fb"} Jul 07 16:53:38.699477 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:38.699138 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64c4c7b8f4-rdkl7" event={"ID":"bd8a0551-f8c5-4995-9a4a-6e3cb911ad04","Type":"ContainerStarted","Data":"902aacbd1e761824b5a98a335e405d4bdd04a4b5de0cebf437a18fdb5c9937bd"} Jul 07 16:53:38.726067 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:38.726018 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64c4c7b8f4-rdkl7" podStartSLOduration=1.7260025460000001 podStartE2EDuration="1.726002546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:53:38.725689819 +0000 UTC m=+457.243893154" watchObservedRunningTime="2026-07-07 16:53:38.726002546 +0000 UTC m=+457.244205881" Jul 07 16:53:47.696898 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:47.696863 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:47.697460 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:47.696924 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:47.701236 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:47.701216 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:47.738014 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:47.737990 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64c4c7b8f4-rdkl7" Jul 07 16:53:48.051395 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.051328 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-wb7jv"] Jul 07 16:53:48.054840 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.054804 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:48.058931 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.058913 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 07 16:53:48.059042 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.059025 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-bsslh\"" Jul 07 16:53:48.078469 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.078443 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-wb7jv"] Jul 07 16:53:48.105572 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.105549 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-s627k"] Jul 07 16:53:48.108374 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.108360 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:48.113777 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.113758 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-f6kbf\"" Jul 07 16:53:48.113904 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.113761 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 07 16:53:48.128128 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.128108 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-s627k"] Jul 07 16:53:48.151296 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.151271 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26h84\" (UniqueName: \"kubernetes.io/projected/7197041f-1146-4665-9e12-ebfe38807207-kube-api-access-26h84\") pod \"model-serving-api-fd65d7d6-wb7jv\" (UID: \"7197041f-1146-4665-9e12-ebfe38807207\") " pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:48.151400 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.151349 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7197041f-1146-4665-9e12-ebfe38807207-tls-certs\") pod \"model-serving-api-fd65d7d6-wb7jv\" (UID: \"7197041f-1146-4665-9e12-ebfe38807207\") " pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:48.252307 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.252268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28bee7d1-8fa0-4289-9fac-51be894f1a61-cert\") pod \"odh-model-controller-84b54b7f97-s627k\" (UID: \"28bee7d1-8fa0-4289-9fac-51be894f1a61\") " pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:48.252415 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.252318 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7197041f-1146-4665-9e12-ebfe38807207-tls-certs\") pod \"model-serving-api-fd65d7d6-wb7jv\" (UID: \"7197041f-1146-4665-9e12-ebfe38807207\") " pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:48.252415 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.252339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm979\" (UniqueName: \"kubernetes.io/projected/28bee7d1-8fa0-4289-9fac-51be894f1a61-kube-api-access-hm979\") pod \"odh-model-controller-84b54b7f97-s627k\" (UID: \"28bee7d1-8fa0-4289-9fac-51be894f1a61\") " pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:48.252415 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.252370 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26h84\" (UniqueName: \"kubernetes.io/projected/7197041f-1146-4665-9e12-ebfe38807207-kube-api-access-26h84\") pod \"model-serving-api-fd65d7d6-wb7jv\" (UID: \"7197041f-1146-4665-9e12-ebfe38807207\") " pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:48.254657 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.254638 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7197041f-1146-4665-9e12-ebfe38807207-tls-certs\") pod \"model-serving-api-fd65d7d6-wb7jv\" (UID: \"7197041f-1146-4665-9e12-ebfe38807207\") " pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:48.269196 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.269169 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26h84\" (UniqueName: \"kubernetes.io/projected/7197041f-1146-4665-9e12-ebfe38807207-kube-api-access-26h84\") pod \"model-serving-api-fd65d7d6-wb7jv\" (UID: \"7197041f-1146-4665-9e12-ebfe38807207\") " pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:48.353394 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.353342 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28bee7d1-8fa0-4289-9fac-51be894f1a61-cert\") pod \"odh-model-controller-84b54b7f97-s627k\" (UID: \"28bee7d1-8fa0-4289-9fac-51be894f1a61\") " pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:48.353394 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.353377 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm979\" (UniqueName: \"kubernetes.io/projected/28bee7d1-8fa0-4289-9fac-51be894f1a61-kube-api-access-hm979\") pod \"odh-model-controller-84b54b7f97-s627k\" (UID: \"28bee7d1-8fa0-4289-9fac-51be894f1a61\") " pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:48.355392 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.355372 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28bee7d1-8fa0-4289-9fac-51be894f1a61-cert\") pod \"odh-model-controller-84b54b7f97-s627k\" (UID: \"28bee7d1-8fa0-4289-9fac-51be894f1a61\") " pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:48.365408 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.365389 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:48.373952 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.373933 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm979\" (UniqueName: \"kubernetes.io/projected/28bee7d1-8fa0-4289-9fac-51be894f1a61-kube-api-access-hm979\") pod \"odh-model-controller-84b54b7f97-s627k\" (UID: \"28bee7d1-8fa0-4289-9fac-51be894f1a61\") " pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:48.418539 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.418499 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:48.506952 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.506926 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-wb7jv"] Jul 07 16:53:48.509814 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:53:48.509790 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7197041f_1146_4665_9e12_ebfe38807207.slice/crio-d7dff69785c84c39b55b5c78498188461602bbb89d1899310b27d17e94750deb WatchSource:0}: Error finding container d7dff69785c84c39b55b5c78498188461602bbb89d1899310b27d17e94750deb: Status 404 returned error can't find the container with id d7dff69785c84c39b55b5c78498188461602bbb89d1899310b27d17e94750deb Jul 07 16:53:48.556444 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.556363 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-s627k"] Jul 07 16:53:48.558793 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:53:48.558772 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bee7d1_8fa0_4289_9fac_51be894f1a61.slice/crio-ac4f70404f253923996449885e76e5e1d190e991c3f321deace6ffc49371e6de WatchSource:0}: Error finding container ac4f70404f253923996449885e76e5e1d190e991c3f321deace6ffc49371e6de: Status 404 returned error can't find the container with id ac4f70404f253923996449885e76e5e1d190e991c3f321deace6ffc49371e6de Jul 07 16:53:48.738432 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.738397 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-s627k" event={"ID":"28bee7d1-8fa0-4289-9fac-51be894f1a61","Type":"ContainerStarted","Data":"ac4f70404f253923996449885e76e5e1d190e991c3f321deace6ffc49371e6de"} Jul 07 16:53:48.739480 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:48.739447 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-wb7jv" event={"ID":"7197041f-1146-4665-9e12-ebfe38807207","Type":"ContainerStarted","Data":"d7dff69785c84c39b55b5c78498188461602bbb89d1899310b27d17e94750deb"} Jul 07 16:53:52.758884 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:52.758833 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-s627k" event={"ID":"28bee7d1-8fa0-4289-9fac-51be894f1a61","Type":"ContainerStarted","Data":"049e4a2f24694480088f1791e889d032fa34802f8b425322010273bfe4491fb9"} Jul 07 16:53:52.759316 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:52.758934 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:53:52.760291 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:52.760266 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-wb7jv" event={"ID":"7197041f-1146-4665-9e12-ebfe38807207","Type":"ContainerStarted","Data":"41c7980682bf5c95e826538e739471390d6a60452ce5eb66359fe9e891fb2119"} Jul 07 16:53:52.760402 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:52.760391 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:53:52.785289 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:52.785238 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-s627k" podStartSLOduration=1.186403231 podStartE2EDuration="4.785224854s" totalImagesPullingTime="3.598821623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:53:52.784576801 +0000 UTC m=+471.302780136" watchObservedRunningTime="2026-07-07 16:53:52.785224854 +0000 UTC m=+471.303428166" Jul 07 16:53:52.809902 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:53:52.809846 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-wb7jv" podStartSLOduration=1.205817118 podStartE2EDuration="4.80981403s" totalImagesPullingTime="3.603996912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:53:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:53:52.808991039 +0000 UTC m=+471.327194373" watchObservedRunningTime="2026-07-07 16:53:52.80981403 +0000 UTC m=+471.328017367" Jul 07 16:54:03.765893 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:54:03.765863 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-s627k" Jul 07 16:54:03.767661 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:54:03.767637 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-wb7jv" Jul 07 16:55:24.166283 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.166248 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz"] Jul 07 16:55:24.169528 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.169509 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:24.173003 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.172985 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 07 16:55:24.182195 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.182172 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz"] Jul 07 16:55:24.272245 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.272217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cvm2\" (UniqueName: \"kubernetes.io/projected/69e8846e-341b-44c2-88c3-11bd163bc019-kube-api-access-9cvm2\") pod \"seaweedfs-tls-custom-6644bf5d6c-8c4cz\" (UID: \"69e8846e-341b-44c2-88c3-11bd163bc019\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:24.272343 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.272272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/69e8846e-341b-44c2-88c3-11bd163bc019-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-8c4cz\" (UID: \"69e8846e-341b-44c2-88c3-11bd163bc019\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:24.373107 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.373087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cvm2\" (UniqueName: \"kubernetes.io/projected/69e8846e-341b-44c2-88c3-11bd163bc019-kube-api-access-9cvm2\") pod \"seaweedfs-tls-custom-6644bf5d6c-8c4cz\" (UID: \"69e8846e-341b-44c2-88c3-11bd163bc019\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:24.373194 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.373141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/69e8846e-341b-44c2-88c3-11bd163bc019-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-8c4cz\" (UID: \"69e8846e-341b-44c2-88c3-11bd163bc019\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:24.373444 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.373429 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/69e8846e-341b-44c2-88c3-11bd163bc019-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-8c4cz\" (UID: \"69e8846e-341b-44c2-88c3-11bd163bc019\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:24.384794 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.384775 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cvm2\" (UniqueName: \"kubernetes.io/projected/69e8846e-341b-44c2-88c3-11bd163bc019-kube-api-access-9cvm2\") pod \"seaweedfs-tls-custom-6644bf5d6c-8c4cz\" (UID: \"69e8846e-341b-44c2-88c3-11bd163bc019\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:24.478629 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.478606 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:24.606905 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:24.606766 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz"] Jul 07 16:55:24.609494 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:55:24.609468 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e8846e_341b_44c2_88c3_11bd163bc019.slice/crio-dd888cc1324c0197fd0145b408f648b47fb61e09a3f29d0ad90867df65b3a79a WatchSource:0}: Error finding container dd888cc1324c0197fd0145b408f648b47fb61e09a3f29d0ad90867df65b3a79a: Status 404 returned error can't find the container with id dd888cc1324c0197fd0145b408f648b47fb61e09a3f29d0ad90867df65b3a79a Jul 07 16:55:25.098599 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:25.098568 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" event={"ID":"69e8846e-341b-44c2-88c3-11bd163bc019","Type":"ContainerStarted","Data":"da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f"} Jul 07 16:55:25.098753 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:25.098615 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" event={"ID":"69e8846e-341b-44c2-88c3-11bd163bc019","Type":"ContainerStarted","Data":"dd888cc1324c0197fd0145b408f648b47fb61e09a3f29d0ad90867df65b3a79a"} Jul 07 16:55:25.121837 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:25.121775 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" podStartSLOduration=0.769870581 podStartE2EDuration="1.121758937s" totalImagesPullingTime="351.888356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:55:25.119598636 +0000 UTC m=+563.637801970" watchObservedRunningTime="2026-07-07 16:55:25.121758937 +0000 UTC m=+563.639962271" Jul 07 16:55:26.796725 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:26.796685 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz"] Jul 07 16:55:27.104797 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:27.104712 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" podUID="69e8846e-341b-44c2-88c3-11bd163bc019" containerName="seaweedfs-tls-custom" containerID="cri-o://da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f" gracePeriod=30 Jul 07 16:55:28.340973 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:28.340950 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:28.407479 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:28.407411 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9cvm2\" (UniqueName: \"kubernetes.io/projected/69e8846e-341b-44c2-88c3-11bd163bc019-kube-api-access-9cvm2\") pod \"69e8846e-341b-44c2-88c3-11bd163bc019\" (UID: \"69e8846e-341b-44c2-88c3-11bd163bc019\") " Jul 07 16:55:28.407479 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:28.407449 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/69e8846e-341b-44c2-88c3-11bd163bc019-data\") pod \"69e8846e-341b-44c2-88c3-11bd163bc019\" (UID: \"69e8846e-341b-44c2-88c3-11bd163bc019\") " Jul 07 16:55:28.408685 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:28.408659 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e8846e-341b-44c2-88c3-11bd163bc019-data" (OuterVolumeSpecName: "data") pod "69e8846e-341b-44c2-88c3-11bd163bc019" (UID: "69e8846e-341b-44c2-88c3-11bd163bc019"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:55:28.409500 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:28.409477 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e8846e-341b-44c2-88c3-11bd163bc019-kube-api-access-9cvm2" (OuterVolumeSpecName: "kube-api-access-9cvm2") pod "69e8846e-341b-44c2-88c3-11bd163bc019" (UID: "69e8846e-341b-44c2-88c3-11bd163bc019"). InnerVolumeSpecName "kube-api-access-9cvm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:55:28.508522 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:28.508484 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cvm2\" (UniqueName: \"kubernetes.io/projected/69e8846e-341b-44c2-88c3-11bd163bc019-kube-api-access-9cvm2\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:55:28.508522 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:28.508521 2572 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/69e8846e-341b-44c2-88c3-11bd163bc019-data\") on node \"ip-10-0-137-198.ec2.internal\" DevicePath \"\"" Jul 07 16:55:29.112877 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.112840 2572 generic.go:356] "Generic (PLEG): container finished" podID="69e8846e-341b-44c2-88c3-11bd163bc019" containerID="da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f" exitCode=0 Jul 07 16:55:29.113073 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.112890 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" Jul 07 16:55:29.113073 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.112890 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" event={"ID":"69e8846e-341b-44c2-88c3-11bd163bc019","Type":"ContainerDied","Data":"da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f"} Jul 07 16:55:29.113073 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.113017 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz" event={"ID":"69e8846e-341b-44c2-88c3-11bd163bc019","Type":"ContainerDied","Data":"dd888cc1324c0197fd0145b408f648b47fb61e09a3f29d0ad90867df65b3a79a"} Jul 07 16:55:29.113073 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.113043 2572 scope.go:117] "RemoveContainer" containerID="da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f" Jul 07 16:55:29.122244 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.122223 2572 scope.go:117] "RemoveContainer" containerID="da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f" Jul 07 16:55:29.122500 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:55:29.122482 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f\": container with ID starting with da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f not found: ID does not exist" containerID="da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f" Jul 07 16:55:29.122572 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.122507 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f"} err="failed to get container status \"da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f\": rpc error: code = NotFound desc = could not find container \"da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f\": container with ID starting with da4d2cfb0b95c1620cf60591a7f9ba98bd313f29c6b2bd59e9140dbf49413e1f not found: ID does not exist" Jul 07 16:55:29.137217 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.137191 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz"] Jul 07 16:55:29.143191 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.143172 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-8c4cz"] Jul 07 16:55:29.181790 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.181767 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-wtngw"] Jul 07 16:55:29.182130 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.182114 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e8846e-341b-44c2-88c3-11bd163bc019" containerName="seaweedfs-tls-custom" Jul 07 16:55:29.182178 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.182132 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e8846e-341b-44c2-88c3-11bd163bc019" containerName="seaweedfs-tls-custom" Jul 07 16:55:29.182216 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.182206 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="69e8846e-341b-44c2-88c3-11bd163bc019" containerName="seaweedfs-tls-custom" Jul 07 16:55:29.186516 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.186499 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.189414 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.189396 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 07 16:55:29.189558 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.189543 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 07 16:55:29.198357 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.198334 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-wtngw"] Jul 07 16:55:29.213611 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.213583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd49a6e6-4283-4a58-8b02-07826df53c76-data\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.213739 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.213643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/cd49a6e6-4283-4a58-8b02-07826df53c76-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.213739 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.213718 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq7ww\" (UniqueName: \"kubernetes.io/projected/cd49a6e6-4283-4a58-8b02-07826df53c76-kube-api-access-sq7ww\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.314546 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.314518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq7ww\" (UniqueName: \"kubernetes.io/projected/cd49a6e6-4283-4a58-8b02-07826df53c76-kube-api-access-sq7ww\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.314655 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.314577 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd49a6e6-4283-4a58-8b02-07826df53c76-data\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.314655 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.314601 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/cd49a6e6-4283-4a58-8b02-07826df53c76-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.314988 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.314968 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd49a6e6-4283-4a58-8b02-07826df53c76-data\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.316825 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.316801 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/cd49a6e6-4283-4a58-8b02-07826df53c76-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.325140 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.325114 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq7ww\" (UniqueName: \"kubernetes.io/projected/cd49a6e6-4283-4a58-8b02-07826df53c76-kube-api-access-sq7ww\") pod \"seaweedfs-tls-custom-8b44d767d-wtngw\" (UID: \"cd49a6e6-4283-4a58-8b02-07826df53c76\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.497113 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.497085 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" Jul 07 16:55:29.632891 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:29.632864 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-wtngw"] Jul 07 16:55:29.635596 ip-10-0-137-198 kubenswrapper[2572]: W0707 16:55:29.635568 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd49a6e6_4283_4a58_8b02_07826df53c76.slice/crio-f36c9bc64a92a2da99a5b4a6b53e0ba502fc2ef036668b7b09c79b0d79737b6e WatchSource:0}: Error finding container f36c9bc64a92a2da99a5b4a6b53e0ba502fc2ef036668b7b09c79b0d79737b6e: Status 404 returned error can't find the container with id f36c9bc64a92a2da99a5b4a6b53e0ba502fc2ef036668b7b09c79b0d79737b6e Jul 07 16:55:30.026227 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:30.026196 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69e8846e-341b-44c2-88c3-11bd163bc019" path="/var/lib/kubelet/pods/69e8846e-341b-44c2-88c3-11bd163bc019/volumes" Jul 07 16:55:30.118605 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:30.118578 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" event={"ID":"cd49a6e6-4283-4a58-8b02-07826df53c76","Type":"ContainerStarted","Data":"1d2709f461586ac6fbc2eefd2ffa07ee2e02bb9ec8ec7ac90602820c7330302b"} Jul 07 16:55:30.118724 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:30.118625 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" event={"ID":"cd49a6e6-4283-4a58-8b02-07826df53c76","Type":"ContainerStarted","Data":"f36c9bc64a92a2da99a5b4a6b53e0ba502fc2ef036668b7b09c79b0d79737b6e"} Jul 07 16:55:30.139712 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:30.139673 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-wtngw" podStartSLOduration=0.872076718 podStartE2EDuration="1.139658753s" totalImagesPullingTime="267.582035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:55:30.138900679 +0000 UTC m=+568.657104016" watchObservedRunningTime="2026-07-07 16:55:30.139658753 +0000 UTC m=+568.657862086" Jul 07 16:55:47.136543 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.136508 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm"] Jul 07 16:55:47.140319 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.140300 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.144001 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.143981 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 07 16:55:47.144144 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.144129 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 07 16:55:47.153889 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.153866 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm"] Jul 07 16:55:47.254802 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.254773 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-data\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.254967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.254809 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk444\" (UniqueName: \"kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-kube-api-access-fk444\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.254967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.254916 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.355415 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.355364 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-data\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.355612 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.355425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk444\" (UniqueName: \"kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-kube-api-access-fk444\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.355612 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.355490 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.355612 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:55:47.355606 2572 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 07 16:55:47.355761 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:55:47.355622 2572 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm: secret "seaweedfs-tls-serving" not found Jul 07 16:55:47.355761 ip-10-0-137-198 kubenswrapper[2572]: E0707 16:55:47.355695 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-seaweedfs-tls-serving podName:f492bf7d-cdb6-4c0e-845c-81396c5fd64c nodeName:}" failed. No retries permitted until 2026-07-07 16:55:47.85567394 +0000 UTC m=+586.373877266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-w8dgm" (UID: "f492bf7d-cdb6-4c0e-845c-81396c5fd64c") : secret "seaweedfs-tls-serving" not found Jul 07 16:55:47.355761 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.355751 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-data\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.367685 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.367662 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk444\" (UniqueName: \"kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-kube-api-access-fk444\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.859967 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.859931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:47.862293 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:47.862262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/f492bf7d-cdb6-4c0e-845c-81396c5fd64c-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-w8dgm\" (UID: \"f492bf7d-cdb6-4c0e-845c-81396c5fd64c\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:48.050176 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:48.050139 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" Jul 07 16:55:48.180222 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:48.180198 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm"] Jul 07 16:55:48.191462 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:48.191422 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" event={"ID":"f492bf7d-cdb6-4c0e-845c-81396c5fd64c","Type":"ContainerStarted","Data":"396ac8c67690f34f78a0925cc841dd5ac6adb086733ed55d4fa2a587cf184f29"} Jul 07 16:55:49.197256 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:49.197223 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" event={"ID":"f492bf7d-cdb6-4c0e-845c-81396c5fd64c","Type":"ContainerStarted","Data":"bace4406c4041a0dcd7f98db96fe86d02c741d991146565fe8faadecbd66a4e1"} Jul 07 16:55:49.219225 ip-10-0-137-198 kubenswrapper[2572]: I0707 16:55:49.219177 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-w8dgm" podStartSLOduration=1.57743297 podStartE2EDuration="2.219162361s" totalImagesPullingTime="641.729391ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:55:49.217659134 +0000 UTC m=+587.735862468" watchObservedRunningTime="2026-07-07 16:55:49.219162361 +0000 UTC m=+587.737365694" Jul 07 17:12:33.273843 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.273791 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s9nz9/must-gather-8ghwq"] Jul 07 17:12:33.276116 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.276095 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s9nz9/must-gather-8ghwq" Jul 07 17:12:33.284651 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.284632 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s9nz9\"/\"openshift-service-ca.crt\"" Jul 07 17:12:33.284784 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.284765 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s9nz9\"/\"default-dockercfg-thlq4\"" Jul 07 17:12:33.284858 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.284808 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s9nz9\"/\"kube-root-ca.crt\"" Jul 07 17:12:33.291330 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.291311 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3ad2d84f-b124-476a-ba1b-502b236b8a7f-must-gather-output\") pod \"must-gather-8ghwq\" (UID: \"3ad2d84f-b124-476a-ba1b-502b236b8a7f\") " pod="openshift-must-gather-s9nz9/must-gather-8ghwq" Jul 07 17:12:33.291400 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.291349 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67kjj\" (UniqueName: \"kubernetes.io/projected/3ad2d84f-b124-476a-ba1b-502b236b8a7f-kube-api-access-67kjj\") pod \"must-gather-8ghwq\" (UID: \"3ad2d84f-b124-476a-ba1b-502b236b8a7f\") " pod="openshift-must-gather-s9nz9/must-gather-8ghwq" Jul 07 17:12:33.296570 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.296547 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s9nz9/must-gather-8ghwq"] Jul 07 17:12:33.391687 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.391664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67kjj\" (UniqueName: \"kubernetes.io/projected/3ad2d84f-b124-476a-ba1b-502b236b8a7f-kube-api-access-67kjj\") pod \"must-gather-8ghwq\" (UID: \"3ad2d84f-b124-476a-ba1b-502b236b8a7f\") " pod="openshift-must-gather-s9nz9/must-gather-8ghwq" Jul 07 17:12:33.391807 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.391732 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3ad2d84f-b124-476a-ba1b-502b236b8a7f-must-gather-output\") pod \"must-gather-8ghwq\" (UID: \"3ad2d84f-b124-476a-ba1b-502b236b8a7f\") " pod="openshift-must-gather-s9nz9/must-gather-8ghwq" Jul 07 17:12:33.392100 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.392083 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3ad2d84f-b124-476a-ba1b-502b236b8a7f-must-gather-output\") pod \"must-gather-8ghwq\" (UID: \"3ad2d84f-b124-476a-ba1b-502b236b8a7f\") " pod="openshift-must-gather-s9nz9/must-gather-8ghwq" Jul 07 17:12:33.403227 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.403201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67kjj\" (UniqueName: \"kubernetes.io/projected/3ad2d84f-b124-476a-ba1b-502b236b8a7f-kube-api-access-67kjj\") pod \"must-gather-8ghwq\" (UID: \"3ad2d84f-b124-476a-ba1b-502b236b8a7f\") " pod="openshift-must-gather-s9nz9/must-gather-8ghwq" Jul 07 17:12:33.584474 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.584418 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s9nz9/must-gather-8ghwq" Jul 07 17:12:33.723173 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.723147 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s9nz9/must-gather-8ghwq"] Jul 07 17:12:33.727279 ip-10-0-137-198 kubenswrapper[2572]: W0707 17:12:33.727254 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ad2d84f_b124_476a_ba1b_502b236b8a7f.slice/crio-1ceb95b664d8946301c9836fbc3e9d0a6436d18c5a8754760cb3f5713c9f53a4 WatchSource:0}: Error finding container 1ceb95b664d8946301c9836fbc3e9d0a6436d18c5a8754760cb3f5713c9f53a4: Status 404 returned error can't find the container with id 1ceb95b664d8946301c9836fbc3e9d0a6436d18c5a8754760cb3f5713c9f53a4 Jul 07 17:12:33.729554 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.729538 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 17:12:33.996006 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:33.995970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s9nz9/must-gather-8ghwq" event={"ID":"3ad2d84f-b124-476a-ba1b-502b236b8a7f","Type":"ContainerStarted","Data":"1ceb95b664d8946301c9836fbc3e9d0a6436d18c5a8754760cb3f5713c9f53a4"} Jul 07 17:12:35.006349 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:35.006306 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s9nz9/must-gather-8ghwq" event={"ID":"3ad2d84f-b124-476a-ba1b-502b236b8a7f","Type":"ContainerStarted","Data":"68220e4e4053dbc20049f6953be83a74c875773c37c7daef996f8af84c98f762"} Jul 07 17:12:35.006801 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:35.006368 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s9nz9/must-gather-8ghwq" event={"ID":"3ad2d84f-b124-476a-ba1b-502b236b8a7f","Type":"ContainerStarted","Data":"034c89fda26d0fd5c29861c8a24b0472104be7f84dbadb6db150c85611d1acb4"} Jul 07 17:12:35.026926 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:35.026881 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s9nz9/must-gather-8ghwq" podStartSLOduration=1.138965785 podStartE2EDuration="2.026867385s" totalImagesPullingTime="887.9016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:12:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:12:35.025337676 +0000 UTC m=+1593.543541012" watchObservedRunningTime="2026-07-07 17:12:35.026867385 +0000 UTC m=+1593.545070719" Jul 07 17:12:36.175944 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:36.175909 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6bcch_10b5f4cc-d157-4e0e-bd7d-089cecbe76c9/global-pull-secret-syncer/0.log" Jul 07 17:12:36.386539 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:36.386510 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m4hbp_31d6878e-778c-440b-b24a-29625b07f363/konnectivity-agent/0.log" Jul 07 17:12:36.483072 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:36.483040 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-198.ec2.internal_4eb399c6f3875cdd0d3f494f486968b8/haproxy/0.log" Jul 07 17:12:40.535552 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:40.535458 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-jqgr7_ce33d408-dd45-4e47-ace2-4d8eafcf1206/cluster-monitoring-operator/0.log" Jul 07 17:12:40.574889 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:40.574854 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-pkw4h_e3f79c9a-65d7-4424-8484-6e369165306d/kube-state-metrics/0.log" Jul 07 17:12:40.601706 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:40.601673 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-pkw4h_e3f79c9a-65d7-4424-8484-6e369165306d/kube-rbac-proxy-main/0.log" Jul 07 17:12:40.629188 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:40.629161 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-pkw4h_e3f79c9a-65d7-4424-8484-6e369165306d/kube-rbac-proxy-self/0.log" Jul 07 17:12:40.734576 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:40.734543 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4w59x_2abe619b-d4af-4688-8868-bfccd5040bfd/node-exporter/0.log" Jul 07 17:12:40.759031 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:40.759000 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4w59x_2abe619b-d4af-4688-8868-bfccd5040bfd/kube-rbac-proxy/0.log" Jul 07 17:12:40.783981 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:40.783815 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4w59x_2abe619b-d4af-4688-8868-bfccd5040bfd/init-textfile/0.log" Jul 07 17:12:41.557566 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:41.557534 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76c9fd44b5-rksd7_59589fa5-cd9c-4cc0-bcad-7fd8161980f7/telemeter-client/0.log" Jul 07 17:12:41.588743 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:41.588710 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76c9fd44b5-rksd7_59589fa5-cd9c-4cc0-bcad-7fd8161980f7/reload/0.log" Jul 07 17:12:41.620846 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:41.620802 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76c9fd44b5-rksd7_59589fa5-cd9c-4cc0-bcad-7fd8161980f7/kube-rbac-proxy/0.log" Jul 07 17:12:43.970953 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:43.970914 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl"] Jul 07 17:12:43.976066 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:43.976044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:43.990145 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:43.990118 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl"] Jul 07 17:12:44.010842 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.010799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-sys\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.011009 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.010874 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-proc\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.011009 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.010927 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzzqk\" (UniqueName: \"kubernetes.io/projected/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-kube-api-access-tzzqk\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.011009 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.010983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-lib-modules\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.011173 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.011045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-podres\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.111712 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.111669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-sys\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.111924 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.111744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-proc\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.111924 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.111805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzzqk\" (UniqueName: \"kubernetes.io/projected/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-kube-api-access-tzzqk\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.111924 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.111860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-lib-modules\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.111924 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.111908 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-podres\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.112151 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.112076 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-podres\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.112151 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.112134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-sys\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.112258 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.112178 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-proc\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.112582 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.112560 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-lib-modules\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.125509 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.125474 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzzqk\" (UniqueName: \"kubernetes.io/projected/e03a9dff-b31f-4cf7-bfef-bfbe64a54cde-kube-api-access-tzzqk\") pod \"perf-node-gather-daemonset-tngzl\" (UID: \"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde\") " pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.287334 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.287247 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:44.301292 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.301270 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64c4c7b8f4-rdkl7_bd8a0551-f8c5-4995-9a4a-6e3cb911ad04/console/0.log" Jul 07 17:12:44.463429 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.462149 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl"] Jul 07 17:12:44.938966 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:44.938929 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-2tnxg_ca2be8fd-5c81-4828-abf0-c9db10087542/volume-data-source-validator/0.log" Jul 07 17:12:45.067392 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:45.067357 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" event={"ID":"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde","Type":"ContainerStarted","Data":"112694b03733e4500ea8421166e5d5cb52b5aeb2844305fb3f1823c74d446318"} Jul 07 17:12:45.067874 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:45.067421 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:45.067874 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:45.067443 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" event={"ID":"e03a9dff-b31f-4cf7-bfef-bfbe64a54cde","Type":"ContainerStarted","Data":"31063b7583085f996cbd8df7b3c4b207c4e8f9f61e059e5edc439ca5a17ab1a5"} Jul 07 17:12:45.088803 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:45.088757 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" podStartSLOduration=2.088740521 podStartE2EDuration="2.088740521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:12:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:12:45.086504526 +0000 UTC m=+1603.604707861" watchObservedRunningTime="2026-07-07 17:12:45.088740521 +0000 UTC m=+1603.606943855" Jul 07 17:12:45.930950 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:45.930922 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pjq9z_5d097f72-3543-4a68-bb27-43bc8592bc9a/dns/0.log" Jul 07 17:12:45.956618 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:45.956590 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pjq9z_5d097f72-3543-4a68-bb27-43bc8592bc9a/kube-rbac-proxy/0.log" Jul 07 17:12:46.146647 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:46.146621 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rwnxl_42be081f-532a-4903-853a-542bf86fef99/dns-node-resolver/0.log" Jul 07 17:12:46.718557 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:46.718531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5465489565-pqtfj_d05f9b0f-91a1-4bbd-b194-edcbf237baec/registry/0.log" Jul 07 17:12:46.842688 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:46.842659 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v2qtj_0cb3613a-561f-44b4-81e0-979f9c4d70d7/node-ca/0.log" Jul 07 17:12:47.843166 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:47.843134 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-dc9c5f76c-946gt_f7e8811f-bdc5-464e-bdd5-4950e57015d8/router/0.log" Jul 07 17:12:48.296814 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:48.296790 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-z4l7h_080d41be-8f0f-403b-b782-e75d215f8fa4/serve-healthcheck-canary/0.log" Jul 07 17:12:48.751261 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:48.751228 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-qh2nc_d3f590db-ee36-45d1-a652-0183b053cb69/insights-operator/1.log" Jul 07 17:12:48.761224 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:48.761202 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-qh2nc_d3f590db-ee36-45d1-a652-0183b053cb69/insights-operator/0.log" Jul 07 17:12:49.000545 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:49.000514 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxw67_ed8bafdc-1e11-46c7-93e2-ef2cb0e453af/kube-rbac-proxy/0.log" Jul 07 17:12:49.028525 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:49.028467 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxw67_ed8bafdc-1e11-46c7-93e2-ef2cb0e453af/exporter/0.log" Jul 07 17:12:49.057547 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:49.057526 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxw67_ed8bafdc-1e11-46c7-93e2-ef2cb0e453af/extractor/0.log" Jul 07 17:12:51.081357 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:51.081329 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s9nz9/perf-node-gather-daemonset-tngzl" Jul 07 17:12:51.506491 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:51.506462 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-wb7jv_7197041f-1146-4665-9e12-ebfe38807207/server/0.log" Jul 07 17:12:51.614482 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:51.614458 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-s627k_28bee7d1-8fa0-4289-9fac-51be894f1a61/manager/0.log" Jul 07 17:12:52.006969 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:52.006937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-62c2n_3f95f502-0dbb-4f07-9eda-88c3a8e1bab6/seaweedfs/0.log" Jul 07 17:12:52.053107 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:52.053077 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-wtngw_cd49a6e6-4283-4a58-8b02-07826df53c76/seaweedfs-tls-custom/0.log" Jul 07 17:12:52.116420 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:52.116369 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-w8dgm_f492bf7d-cdb6-4c0e-845c-81396c5fd64c/seaweedfs-tls-serving/0.log" Jul 07 17:12:59.530920 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:59.530890 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vd598_f50849c2-188e-44b0-aef6-4eb6e4c5f6a3/kube-multus-additional-cni-plugins/0.log" Jul 07 17:12:59.564089 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:59.564065 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vd598_f50849c2-188e-44b0-aef6-4eb6e4c5f6a3/egress-router-binary-copy/0.log" Jul 07 17:12:59.595151 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:59.595126 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vd598_f50849c2-188e-44b0-aef6-4eb6e4c5f6a3/cni-plugins/0.log" Jul 07 17:12:59.621572 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:59.621549 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vd598_f50849c2-188e-44b0-aef6-4eb6e4c5f6a3/bond-cni-plugin/0.log" Jul 07 17:12:59.647404 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:59.647381 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vd598_f50849c2-188e-44b0-aef6-4eb6e4c5f6a3/routeoverride-cni/0.log" Jul 07 17:12:59.685331 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:59.685312 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vd598_f50849c2-188e-44b0-aef6-4eb6e4c5f6a3/whereabouts-cni-bincopy/0.log" Jul 07 17:12:59.714761 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:59.714736 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vd598_f50849c2-188e-44b0-aef6-4eb6e4c5f6a3/whereabouts-cni/0.log" Jul 07 17:12:59.794581 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:12:59.794511 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jnnfz_0ae40f99-bed2-4da8-8c58-71cd4f8b6340/kube-multus/0.log" Jul 07 17:13:00.112728 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:13:00.112696 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r8wcc_0013c995-6334-4215-875b-694d671f8a29/network-metrics-daemon/0.log" Jul 07 17:13:00.150430 ip-10-0-137-198 kubenswrapper[2572]: I0707 17:13:00.150402 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r8wcc_0013c995-6334-4215-875b-694d671f8a29/kube-rbac-proxy/0.log"