Jul 16 21:48:08.732724 ip-10-0-139-28 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 21:48:08.732737 ip-10-0-139-28 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 21:48:08.732744 ip-10-0-139-28 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 21:48:08.732964 ip-10-0-139-28 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 21:48:20.240108 ip-10-0-139-28 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 21:48:20.240129 ip-10-0-139-28 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9df80ce85d284ec6b188e3a4da1bc375 -- Jul 16 21:49:54.590580 ip-10-0-139-28 systemd[1]: Starting Kubernetes Kubelet... Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.925355 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929343 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929355 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929358 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929361 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929365 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929369 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929372 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:55.053192 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929376 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:54.998477 ip-10-0-139-28 systemd[1]: Started Kubernetes Kubelet. Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929380 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929383 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929386 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929389 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929391 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929394 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929398 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929401 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929406 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929409 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929412 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929415 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929421 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929424 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929427 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929430 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929433 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929436 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:55.056631 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929438 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929441 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929444 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929446 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929449 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929451 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929454 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929456 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929459 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929461 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929464 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929466 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929469 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929471 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929474 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929477 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929480 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929483 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929486 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:55.085056 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929488 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929491 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929493 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929497 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929499 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929502 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929504 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929507 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929510 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929512 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929516 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929518 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929521 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929523 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929525 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929528 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929530 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929533 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929535 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929537 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:55.218786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929540 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929542 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929544 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929547 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929549 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929551 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929555 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929557 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929560 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929563 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929567 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929569 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929572 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929574 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929578 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929582 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929585 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929588 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929590 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:55.220121 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929593 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929595 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929597 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929600 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929602 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929605 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929607 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929609 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929613 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929615 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929618 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929620 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929623 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929625 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.929628 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930350 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930358 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930361 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930364 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:55.220976 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930369 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930372 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930376 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930378 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930381 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930385 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930388 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930391 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930393 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930396 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930399 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930401 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930404 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930407 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930409 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930412 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930415 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930417 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930421 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:55.221565 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930424 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930427 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930430 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930433 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930436 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930439 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930442 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930445 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930447 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930450 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930453 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930455 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930457 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930460 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930463 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930465 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930468 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930471 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930473 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930477 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:55.222293 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930479 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930482 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930484 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930487 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930490 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930492 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930494 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930497 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930499 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930501 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930504 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930506 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930508 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930511 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930513 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930515 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930518 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930520 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930523 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930525 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:55.222884 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930528 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930530 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930533 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930535 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930537 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930540 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930542 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930544 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930547 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930552 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930558 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930561 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930568 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930573 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930577 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930579 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930582 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930585 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930587 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:55.223511 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930590 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930592 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930595 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930598 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930600 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930603 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930605 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930607 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930610 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930612 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930615 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930618 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930620 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930622 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930625 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930627 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.930629 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931039 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931044 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:55.224179 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931047 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931049 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931052 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931057 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931061 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931064 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931067 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931070 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931073 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931076 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931079 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931081 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931084 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931086 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931089 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931092 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931094 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931097 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931100 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:55.224797 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931102 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931105 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931107 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931110 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931112 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931115 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931117 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931120 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931122 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931125 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931127 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931129 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931132 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931134 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931136 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931139 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931142 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931146 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931149 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931151 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:55.225500 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931154 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931156 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931159 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931161 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931163 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931166 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931168 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931171 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931173 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931176 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931178 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931180 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931183 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931185 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931187 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931190 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931192 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931194 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931200 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931203 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:55.226113 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931206 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931208 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931211 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931214 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931216 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931220 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931223 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931226 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931230 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931234 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931237 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931239 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931242 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931248 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931251 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931253 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931256 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931258 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931261 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:55.226650 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931263 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931265 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931268 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931287 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931290 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931294 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931297 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931300 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931302 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931305 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931307 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931309 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931312 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931314 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931317 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931319 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931322 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931324 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.931327 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931394 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931406 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 21:49:55.227169 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931415 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931421 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931426 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931429 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931433 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931438 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931441 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931444 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931448 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931451 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931454 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931457 2563 flags.go:64] FLAG: --cgroup-root="" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931460 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931463 2563 flags.go:64] FLAG: --client-ca-file="" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931466 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931468 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931473 2563 flags.go:64] FLAG: --cluster-domain="" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931475 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931479 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931481 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931485 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931488 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931491 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 21:49:55.227736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931494 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931497 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931500 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931503 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931506 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931509 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931512 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931516 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931519 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931523 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931527 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931530 2563 flags.go:64] FLAG: --enable-server="true" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931533 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931539 2563 flags.go:64] FLAG: --event-burst="100" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931542 2563 flags.go:64] FLAG: --event-qps="50" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931545 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931548 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931551 2563 flags.go:64] FLAG: --eviction-hard="" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931555 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931558 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931561 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931564 2563 flags.go:64] FLAG: --eviction-soft="" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931567 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931570 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931573 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 21:49:55.228518 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931577 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931579 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931582 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931585 2563 flags.go:64] FLAG: --feature-gates="" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931589 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931592 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931595 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931598 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931601 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931604 2563 flags.go:64] FLAG: --help="false" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931607 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931610 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931613 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931616 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931619 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931622 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931626 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931630 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931633 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931636 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931639 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931642 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931645 2563 flags.go:64] FLAG: --kube-reserved="" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931648 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 21:49:55.229321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931651 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931655 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931657 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931660 2563 flags.go:64] FLAG: --lock-file="" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931663 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931666 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931669 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931675 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931678 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931680 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931683 2563 flags.go:64] FLAG: --logging-format="text" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931686 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931689 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931692 2563 flags.go:64] FLAG: --manifest-url="" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931695 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931699 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931702 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931706 2563 flags.go:64] FLAG: --max-pods="110" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931709 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931712 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931715 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931717 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931720 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931723 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931727 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 21:49:55.230092 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931736 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931739 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931742 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931745 2563 flags.go:64] FLAG: --pod-cidr="" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931748 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931754 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931757 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931760 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931764 2563 flags.go:64] FLAG: --port="10250" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931767 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931771 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-013d5523f3891987b" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931775 2563 flags.go:64] FLAG: --qos-reserved="" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931778 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931781 2563 flags.go:64] FLAG: --register-node="true" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931784 2563 flags.go:64] FLAG: --register-with-taints="" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931787 2563 flags.go:64] FLAG: --registry-burst="10" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931790 2563 flags.go:64] FLAG: --registry-qps="5" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931792 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931795 2563 flags.go:64] FLAG: --reserved-memory="" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931799 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931802 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931805 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931808 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931810 2563 flags.go:64] FLAG: --runonce="false" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931814 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 21:49:55.231111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931816 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931820 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931823 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931825 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931828 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931832 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931836 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931839 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931843 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931846 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931849 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931852 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931855 2563 flags.go:64] FLAG: --system-cgroups="" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931857 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931862 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931865 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931868 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931872 2563 flags.go:64] FLAG: --tls-min-version="" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931875 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931878 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931881 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931883 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931886 2563 flags.go:64] FLAG: --v="2" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931890 2563 flags.go:64] FLAG: --version="false" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931894 2563 flags.go:64] FLAG: --vmodule="" Jul 16 21:49:55.231870 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931897 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.931901 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932072 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932080 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932086 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932090 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932094 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932098 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932102 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932106 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932109 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932114 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932117 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932122 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932126 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932131 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932135 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932139 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932143 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932147 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:55.380826 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932151 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932154 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932158 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932162 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932168 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932172 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932176 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932179 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932183 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932186 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932190 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932195 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932198 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932202 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932206 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932210 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932213 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932217 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932221 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:55.381533 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932225 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932228 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932232 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932236 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932239 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932242 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932247 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932253 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932261 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932265 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932283 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932287 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932291 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932295 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932300 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932304 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932308 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932311 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932316 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932319 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:55.382082 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932323 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932329 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932333 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932337 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932341 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932346 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932349 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932353 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932356 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932360 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932363 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932367 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932370 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932374 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932377 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932381 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932385 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932388 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932394 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932397 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:55.382675 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932403 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932407 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932410 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932413 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932417 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932421 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932424 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932428 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932432 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932435 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932439 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932444 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932448 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932451 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932455 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932458 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932462 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932466 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932470 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932473 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:55.383203 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932477 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.932480 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.933012 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.940258 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.940294 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.941025 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.941033 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941102 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941107 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941111 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941115 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941118 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941122 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941127 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941130 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:55.383769 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941133 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941135 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941138 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941140 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941143 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941146 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941148 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941151 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941154 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941157 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941160 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941162 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941165 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941168 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941171 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941173 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941176 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941179 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941181 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941184 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:55.384230 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941186 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941196 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941199 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941201 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941204 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941206 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941209 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941211 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941213 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941216 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941218 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941220 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941223 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941225 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941228 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941230 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941232 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941235 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941237 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:55.384801 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941240 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941243 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941245 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941248 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941250 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941252 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941255 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941257 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941260 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941263 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941266 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941268 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941290 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941292 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941295 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941304 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941307 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941310 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941312 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941315 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:55.385318 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941317 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941322 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941325 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941328 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941332 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941335 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941338 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941340 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941343 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941345 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941348 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941350 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941353 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941355 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941357 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941360 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941363 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941369 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941372 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:55.385875 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941374 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941377 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941379 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941382 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941384 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941387 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941390 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941392 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941395 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941404 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941407 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941409 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941412 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.941417 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941570 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 21:49:55.386446 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941577 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941580 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941583 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941586 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941588 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941591 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941594 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941596 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941600 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941610 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941613 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941616 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941618 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941621 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941624 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941628 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941633 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941636 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941638 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 21:49:55.386896 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941641 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941643 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941646 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941648 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941651 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941653 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941656 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941659 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941671 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941674 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941678 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941681 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941684 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941686 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941689 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941692 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941694 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941697 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941699 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 21:49:55.387399 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941701 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941704 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941707 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941709 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941711 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941714 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941716 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941719 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941721 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941725 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941729 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941732 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941734 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941737 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941739 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941742 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941744 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941747 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941749 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941752 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 21:49:55.387925 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941754 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941757 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941767 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941770 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941773 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941776 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941779 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941781 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941784 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941786 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941789 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941791 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941793 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941796 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941798 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941800 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941803 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941805 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941808 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 21:49:55.388512 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941810 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941812 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941816 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941820 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941823 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941825 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941828 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941830 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941833 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941835 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941838 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941840 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941843 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941845 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941848 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941850 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941859 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941861 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941864 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941867 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 21:49:55.389039 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:54.941869 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.941874 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.942020 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.945426 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.946635 2563 server.go:1019] "Starting client certificate rotation" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.946732 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.946781 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.950403 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.954622 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.963410 2563 log.go:25] "Validated CRI v1 runtime API" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.967132 2563 log.go:25] "Validated CRI v1 image API" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.967917 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 21:49:55.389621 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.969970 2563 fs.go:135] Filesystem UUIDs: map[0e391641-22a8-4898-8d36-e09cfd2ee1c1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b3ff64c6-ed66-4b63-b88a-ccfae9048231:/dev/nvme0n1p3] Jul 16 21:49:55.389985 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.969986 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 21:49:55.390051 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.974906 2563 manager.go:216] Machine: {Timestamp:2026-07-16 21:49:54.973730401 +0000 UTC m=+0.276434038 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201954 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec257c297c0a893c7fbf20a4ddb42ef6 SystemUUID:ec257c29-7c0a-893c-7fbf-20a4ddb42ef6 BootID:9df80ce8-5d28-4ec6-b188-e3a4da1bc375 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f7:b8:a7:2c:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f7:b8:a7:2c:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:84:e0:7b:ce:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 21:49:55.390051 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.975022 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 21:49:55.390051 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.975109 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 21:49:55.390051 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.977828 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 21:49:55.390051 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.977853 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 21:49:55.390051 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.979013 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 21:49:55.390051 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.979036 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.979049 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.979057 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.979645 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.981504 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.985607 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.985743 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.985770 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.985784 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.985797 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.985807 2563 kubelet.go:398] "Adding apiserver pod source" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.985816 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.986202 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.986220 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.988045 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.990071 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.990098 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991690 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991712 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991722 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991730 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991742 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991748 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991755 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991761 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991767 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991773 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991788 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.991795 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.993080 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.993088 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.997246 2563 server.go:1268] "Started kubelet" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:54.998670 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:54.998687 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.998708 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.998723 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.998754 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:54.998749 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.001086 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 21:49:55.390340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.001326 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.005020 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.007797 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.007803 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.007893 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.007216 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-28.ec2.internal.18c2e38c8159f1d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-28.ec2.internal,UID:ip-10-0-139-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-28.ec2.internal,},FirstTimestamp:2026-07-16 21:49:54.997219794 +0000 UTC m=+0.299923424,LastTimestamp:2026-07-16 21:49:54.997219794 +0000 UTC m=+0.299923424,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-28.ec2.internal,}" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008438 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008430 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008453 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008604 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008612 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008743 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008758 2563 factory.go:55] Registering systemd factory Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008765 2563 factory.go:223] Registration of the systemd container factory successfully Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008967 2563 factory.go:153] Registering CRI-O factory Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.008976 2563 factory.go:223] Registration of the crio container factory successfully Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.009006 2563 factory.go:103] Registering Raw factory Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.009020 2563 manager.go:1196] Started watching for new ooms in manager Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.009495 2563 manager.go:349] Starting recovery of all containers Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.019331 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.019387 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.023022 2563 manager.go:354] Recovery completed Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.027542 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.029322 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.029360 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.029378 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.029950 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.029963 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.029968 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.029983 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.030875 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.030899 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.030909 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:55.391599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.032252 2563 policy_none.go:49] "None policy: Start" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.032266 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.032291 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.034284 2563 policy_none.go:47] "Start" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.037170 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gkcmc" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.039090 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-28.ec2.internal.18c2e38c834426e7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-28.ec2.internal,UID:ip-10-0-139-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-28.ec2.internal,},FirstTimestamp:2026-07-16 21:49:55.029346023 +0000 UTC m=+0.332049645,LastTimestamp:2026-07-16 21:49:55.029346023 +0000 UTC m=+0.332049645,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-28.ec2.internal,}" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.043071 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-28.ec2.internal.18c2e38c834477b3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-28.ec2.internal,UID:ip-10-0-139-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-28.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-28.ec2.internal,},FirstTimestamp:2026-07-16 21:49:55.029366707 +0000 UTC m=+0.332070330,LastTimestamp:2026-07-16 21:49:55.029366707 +0000 UTC m=+0.332070330,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-28.ec2.internal,}" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.046606 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gkcmc" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.048746 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-28.ec2.internal.18c2e38c8344b5ec default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-28.ec2.internal,UID:ip-10-0-139-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-28.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-28.ec2.internal,},FirstTimestamp:2026-07-16 21:49:55.029382636 +0000 UTC m=+0.332086257,LastTimestamp:2026-07-16 21:49:55.029382636 +0000 UTC m=+0.332086257,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-28.ec2.internal,}" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.052549 2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-28.ec2.internal.18c2e38c834426e7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-28.ec2.internal.18c2e38c834426e7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-28.ec2.internal,UID:ip-10-0-139-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-28.ec2.internal,},FirstTimestamp:2026-07-16 21:49:55.029346023 +0000 UTC m=+0.332049645,LastTimestamp:2026-07-16 21:49:55.030885677 +0000 UTC m=+0.333589305,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-28.ec2.internal,}" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.091859 2563 manager.go:337] "Starting Device Plugin manager" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.091906 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.091921 2563 server.go:87] "Starting device plugin registration server" Jul 16 21:49:55.525820 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.092238 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.092256 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.092392 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.092485 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.092495 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.093013 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.093075 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.121568 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.122836 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.122868 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.122891 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.122930 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.124929 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.192780 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.194127 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.194158 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.194172 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.194202 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.201680 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.201700 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-28.ec2.internal\": node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.223467 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal"] Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.223670 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.225297 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.225334 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.225349 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.227636 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.227738 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.227766 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.228499 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.228530 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.228539 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.228957 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.229051 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.229080 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.229093 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:55.529351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.231220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.231243 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.231928 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.231954 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.231965 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.282291 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-28.ec2.internal\" not found" node="ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.289636 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-28.ec2.internal\" not found" node="ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.310355 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd317b625691a579a6c9126452699ab4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal\" (UID: \"fd317b625691a579a6c9126452699ab4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.310382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd317b625691a579a6c9126452699ab4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal\" (UID: \"fd317b625691a579a6c9126452699ab4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.310399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/089fec5c138becb10b4b84131314bfc6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-28.ec2.internal\" (UID: \"089fec5c138becb10b4b84131314bfc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.329675 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.410874 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd317b625691a579a6c9126452699ab4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal\" (UID: \"fd317b625691a579a6c9126452699ab4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.410907 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd317b625691a579a6c9126452699ab4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal\" (UID: \"fd317b625691a579a6c9126452699ab4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.411129 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fd317b625691a579a6c9126452699ab4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal\" (UID: \"fd317b625691a579a6c9126452699ab4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.410930 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/089fec5c138becb10b4b84131314bfc6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-28.ec2.internal\" (UID: \"089fec5c138becb10b4b84131314bfc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.412720 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd317b625691a579a6c9126452699ab4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal\" (UID: \"fd317b625691a579a6c9126452699ab4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.411047 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/089fec5c138becb10b4b84131314bfc6-config\") pod \"kube-apiserver-proxy-ip-10-0-139-28.ec2.internal\" (UID: \"089fec5c138becb10b4b84131314bfc6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.530355 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.429995 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.530975 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.530857 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.672674 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.586034 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.672674 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.593090 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" Jul 16 21:49:55.672674 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.631385 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.821457 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.731887 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.965534 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.832387 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.965534 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.870680 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:55.965534 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.884538 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:55.965534 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:55.933480 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:55.965534 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.946636 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 21:49:55.965534 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.946779 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 21:49:55.965534 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.946806 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 21:49:55.965534 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:55.946806 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 21:49:56.110035 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:56.034224 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:56.110035 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.057396 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 21:44:55 +0000 UTC" deadline="2028-04-17 09:27:11.831213806 +0000 UTC" Jul 16 21:49:56.110035 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.057421 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15371h37m15.773796471s" Jul 16 21:49:56.110035 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.059511 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 21:49:56.110035 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.060578 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientMemory" Jul 16 21:49:56.110035 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.060606 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 21:49:56.110035 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.060618 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeHasSufficientPID" Jul 16 21:49:56.239021 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:56.134304 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-28.ec2.internal\" not found" Jul 16 21:49:56.239021 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.181240 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:56.239021 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.209577 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" Jul 16 21:49:56.239021 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.223014 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 21:49:56.239021 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.223756 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" Jul 16 21:49:56.239021 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.231101 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 21:49:56.379292 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:56.336656 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd317b625691a579a6c9126452699ab4.slice/crio-69461a1cd2b32c26f5acd044a550a57b2dd9b81be9fe0925c01a29a4d04cf225 WatchSource:0}: Error finding container 69461a1cd2b32c26f5acd044a550a57b2dd9b81be9fe0925c01a29a4d04cf225: Status 404 returned error can't find the container with id 69461a1cd2b32c26f5acd044a550a57b2dd9b81be9fe0925c01a29a4d04cf225 Jul 16 21:49:56.379292 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.339321 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 21:49:56.823188 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.818609 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.987629 2563 apiserver.go:52] "Watching apiserver" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.997885 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:56.999038 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-h49hk","openshift-dns/node-resolver-4bxxg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal","openshift-multus/multus-additional-cni-plugins-mwqts","openshift-multus/multus-t66rp","openshift-network-diagnostics/network-check-target-bz4qm","kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl","openshift-cluster-node-tuning-operator/tuned-bgzgm","openshift-image-registry/node-ca-smdqg","openshift-multus/network-metrics-daemon-9dnfx","openshift-network-operator/iptables-alerter-hbqrl","openshift-ovn-kubernetes/ovnkube-node-dtgfw","kube-system/global-pull-secret-syncer-4dhl9"] Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.001908 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.005060 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x5rkl\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.005314 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.005430 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.005456 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.005695 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.008099 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.008170 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.008183 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-96xbq\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.008362 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.008734 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.009018 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.009680 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.009684 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.009759 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.011559 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.011675 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.011932 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.011940 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cfdnc\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.012321 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.014924 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.015144 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.015912 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.015991 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.016064 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 21:49:57.026683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.016200 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.016302 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c57pg\"" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.017205 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.017271 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.017912 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.018119 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vjkpk\"" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.019629 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.020061 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.025798 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.025863 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.028800 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.028867 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 21:49:57.029229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.029228 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 21:49:57.031672 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.030163 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-86dm6\"" Jul 16 21:49:57.031672 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.031244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:49:57.035367 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.033874 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.035367 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.034715 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 21:49:57.035367 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.034790 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 21:49:57.036963 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.035391 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z9bbv\"" Jul 16 21:49:57.036963 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.036651 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.036963 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.036706 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.042453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h2fkn\"" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.042497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.042497 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.042607 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.044835 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.047405 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k2lgc" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.047580 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.047908 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4bxd2\"" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovnkube-config\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053361 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nnms\" (UniqueName: \"kubernetes.io/projected/da4c9599-cf3e-484f-b4d0-e05fd81063d8-kube-api-access-2nnms\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053403 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-host\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053428 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-cni-bin\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da4c9599-cf3e-484f-b4d0-e05fd81063d8-iptables-alerter-script\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053496 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-var-lib-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-etc-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053546 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-slash\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.107626 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-node-log\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-cni-netd\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-env-overrides\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4c9599-cf3e-484f-b4d0-e05fd81063d8-host-slash\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-serviceca\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053775 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2lmv\" (UniqueName: \"kubernetes.io/projected/d7b7efc6-1366-49fa-a329-2c60cead65dd-kube-api-access-z2lmv\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovn-node-metrics-cert\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053820 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-kubelet\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053854 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-systemd\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-ovn\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053929 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovnkube-script-lib\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053952 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-systemd-units\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053971 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcf4x\" (UniqueName: \"kubernetes.io/projected/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-kube-api-access-rcf4x\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.108761 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.053991 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-run-netns\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.111052 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.054013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-log-socket\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.111052 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.054075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.111052 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.055695 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k2lgc" Jul 16 21:49:57.111052 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.110643 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.148008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" event={"ID":"089fec5c138becb10b4b84131314bfc6","Type":"ContainerStarted","Data":"b569653ef66cb8636764e8aa19f587fd0aac55c15095ab08503226acb6e44a24"} Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154303 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-node-log\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-cni-netd\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4c9599-cf3e-484f-b4d0-e05fd81063d8-host-slash\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154436 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-kubernetes\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-var-lib-kubelet\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154548 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-serviceca\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2lmv\" (UniqueName: \"kubernetes.io/projected/d7b7efc6-1366-49fa-a329-2c60cead65dd-kube-api-access-z2lmv\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgg8c\" (UniqueName: \"kubernetes.io/projected/d240f6f9-678c-4ad8-84af-4e24bb10440f-kube-api-access-qgg8c\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154638 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-registration-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-device-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.208196 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c70bb310-56c5-47c2-905b-639816538960-konnectivity-ca\") pod \"konnectivity-agent-h49hk\" (UID: \"c70bb310-56c5-47c2-905b-639816538960\") " pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154715 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysconfig\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdcxr\" (UniqueName: \"kubernetes.io/projected/09a03623-03c8-413a-819e-b5638989d278-kube-api-access-tdcxr\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154769 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-systemd\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovnkube-script-lib\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-cnibin\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154937 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-systemd-units\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-socket-dir-parent\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.154996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-cni-bin\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155020 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-run\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcf4x\" (UniqueName: \"kubernetes.io/projected/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-kube-api-access-rcf4x\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155104 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.211887 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovnkube-config\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155161 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nnms\" (UniqueName: \"kubernetes.io/projected/da4c9599-cf3e-484f-b4d0-e05fd81063d8-kube-api-access-2nnms\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-system-cni-dir\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155213 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-os-release\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155641 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-systemd\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155328 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysctl-d\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c70bb310-56c5-47c2-905b-639816538960-agent-certs\") pod \"konnectivity-agent-h49hk\" (UID: \"c70bb310-56c5-47c2-905b-639816538960\") " pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155958 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.155972 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-cnibin\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156006 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-var-lib-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156042 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-cni-multus\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-daemon-config\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156612 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovnkube-config\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156719 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovnkube-script-lib\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.212789 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156788 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-sys\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156826 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-etc-selinux\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156802 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-systemd-units\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.156946 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-slash\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157008 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-env-overrides\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157069 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-var-lib-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157139 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-cni-netd\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-netns\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157157 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-node-log\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157179 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/da4c9599-cf3e-484f-b4d0-e05fd81063d8-host-slash\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157198 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-slash\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmmzr\" (UniqueName: \"kubernetes.io/projected/5ce636d5-2c44-47cf-a0b9-671192e67af1-kube-api-access-hmmzr\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.213730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157275 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-serviceca\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157298 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-sys-fs\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157439 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-system-cni-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-cni-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157542 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-k8s-cni-cncf-io\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f944a82-6944-48d8-92ef-fd83397b4dca-kubelet-config\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157626 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7b7efc6-1366-49fa-a329-2c60cead65dd-env-overrides\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157739 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krd5x\" (UniqueName: \"kubernetes.io/projected/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-kube-api-access-krd5x\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157791 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovn-node-metrics-cert\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157840 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-conf-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157882 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-modprobe-d\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157927 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ce636d5-2c44-47cf-a0b9-671192e67af1-tmp\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.157972 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-kubelet\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.217652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-ovn\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158036 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d240f6f9-678c-4ad8-84af-4e24bb10440f-cni-binary-copy\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158158 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-etc-kubernetes\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-tmp-dir\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-kubelet\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-hostroot\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158274 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-systemd\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158326 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-lib-modules\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158352 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f944a82-6944-48d8-92ef-fd83397b4dca-dbus\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158432 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-hosts-file\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-run-netns\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158507 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-log-socket\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.218802 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158565 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-tuned\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-socket-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158632 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-host\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158662 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-cni-bin\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da4c9599-cf3e-484f-b4d0-e05fd81063d8-iptables-alerter-script\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-os-release\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc95b\" (UniqueName: \"kubernetes.io/projected/2055e987-d811-4511-a7e8-75efd27281b2-kube-api-access-wc95b\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-multus-certs\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-host\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-etc-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.158865 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysctl-conf\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159081 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxsm9\" (UniqueName: \"kubernetes.io/projected/ec28c3ec-b224-48b9-961e-47da9a2f5b30-kube-api-access-nxsm9\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159167 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.219937 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159207 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159531 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159720 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-kubelet\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-run-ovn\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159863 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-run-netns\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159904 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-log-socket\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.159964 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-etc-openvswitch\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.160033 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7b7efc6-1366-49fa-a329-2c60cead65dd-host-cni-bin\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.160086 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-host\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.160363 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/da4c9599-cf3e-484f-b4d0-e05fd81063d8-iptables-alerter-script\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.164188 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7b7efc6-1366-49fa-a329-2c60cead65dd-ovn-node-metrics-cert\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.166672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nnms\" (UniqueName: \"kubernetes.io/projected/da4c9599-cf3e-484f-b4d0-e05fd81063d8-kube-api-access-2nnms\") pod \"iptables-alerter-hbqrl\" (UID: \"da4c9599-cf3e-484f-b4d0-e05fd81063d8\") " pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.174790 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcf4x\" (UniqueName: \"kubernetes.io/projected/3a9e8556-7305-4e0a-8e45-4f77a30f88c6-kube-api-access-rcf4x\") pod \"node-ca-smdqg\" (UID: \"3a9e8556-7305-4e0a-8e45-4f77a30f88c6\") " pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.174807 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2lmv\" (UniqueName: \"kubernetes.io/projected/d7b7efc6-1366-49fa-a329-2c60cead65dd-kube-api-access-z2lmv\") pod \"ovnkube-node-dtgfw\" (UID: \"d7b7efc6-1366-49fa-a329-2c60cead65dd\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.222009 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.179603 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" event={"ID":"fd317b625691a579a6c9126452699ab4","Type":"ContainerStarted","Data":"69461a1cd2b32c26f5acd044a550a57b2dd9b81be9fe0925c01a29a4d04cf225"} Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259636 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-cnibin\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259666 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-socket-dir-parent\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259700 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-cni-bin\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-run\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259735 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-system-cni-dir\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259763 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-cnibin\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259785 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-os-release\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259796 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-cni-bin\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259828 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysctl-d\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259855 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-os-release\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259858 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c70bb310-56c5-47c2-905b-639816538960-agent-certs\") pod \"konnectivity-agent-h49hk\" (UID: \"c70bb310-56c5-47c2-905b-639816538960\") " pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:49:57.301002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259856 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-system-cni-dir\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259876 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-socket-dir-parent\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-run\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259877 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259884 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-cnibin\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259926 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-cnibin\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-cni-multus\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259954 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysctl-d\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-daemon-config\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-sys\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.259990 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-cni-multus\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260021 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-etc-selinux\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260044 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260054 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-sys\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260069 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.307059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260094 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-netns\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-etc-selinux\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260135 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-netns\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.260143 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260160 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmmzr\" (UniqueName: \"kubernetes.io/projected/5ce636d5-2c44-47cf-a0b9-671192e67af1-kube-api-access-hmmzr\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260183 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-sys-fs\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.260215 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret podName:5f944a82-6944-48d8-92ef-fd83397b4dca nodeName:}" failed. No retries permitted until 2026-07-16 21:49:57.76019265 +0000 UTC m=+3.062896284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret") pod "global-pull-secret-syncer-4dhl9" (UID: "5f944a82-6944-48d8-92ef-fd83397b4dca") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260224 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-sys-fs\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-system-cni-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-cni-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260324 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-k8s-cni-cncf-io\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260348 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-system-cni-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260352 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f944a82-6944-48d8-92ef-fd83397b4dca-kubelet-config\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:57.307972 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260397 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-k8s-cni-cncf-io\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krd5x\" (UniqueName: \"kubernetes.io/projected/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-kube-api-access-krd5x\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260399 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5f944a82-6944-48d8-92ef-fd83397b4dca-kubelet-config\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260447 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-cni-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.260468 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.260513 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs podName:09a03623-03c8-413a-819e-b5638989d278 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:57.760498104 +0000 UTC m=+3.063201741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs") pod "network-metrics-daemon-9dnfx" (UID: "09a03623-03c8-413a-819e-b5638989d278") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-conf-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-modprobe-d\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260589 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ce636d5-2c44-47cf-a0b9-671192e67af1-tmp\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260594 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-daemon-config\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260617 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-multus-conf-dir\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d240f6f9-678c-4ad8-84af-4e24bb10440f-cni-binary-copy\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260647 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260654 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-modprobe-d\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.308688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260682 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-etc-kubernetes\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260656 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-etc-kubernetes\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-tmp-dir\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260738 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-kubelet\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260759 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-hostroot\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-var-lib-kubelet\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-systemd\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260837 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-lib-modules\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260855 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-hostroot\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260889 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-systemd\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260882 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f944a82-6944-48d8-92ef-fd83397b4dca-dbus\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260942 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5f944a82-6944-48d8-92ef-fd83397b4dca-dbus\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260958 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-hosts-file\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260969 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-lib-modules\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260988 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.312673 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261012 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-tuned\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261017 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-hosts-file\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261020 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d240f6f9-678c-4ad8-84af-4e24bb10440f-cni-binary-copy\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-socket-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261066 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-os-release\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.260975 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-tmp-dir\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261090 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc95b\" (UniqueName: \"kubernetes.io/projected/2055e987-d811-4511-a7e8-75efd27281b2-kube-api-access-wc95b\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261152 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-multus-certs\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261170 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2055e987-d811-4511-a7e8-75efd27281b2-os-release\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261173 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-host\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261102 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-socket-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261205 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-host\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261212 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysctl-conf\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261245 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d240f6f9-678c-4ad8-84af-4e24bb10440f-host-run-multus-certs\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxsm9\" (UniqueName: \"kubernetes.io/projected/ec28c3ec-b224-48b9-961e-47da9a2f5b30-kube-api-access-nxsm9\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261317 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261347 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-kubernetes\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261372 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-var-lib-kubelet\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261399 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysctl-conf\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261452 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgg8c\" (UniqueName: \"kubernetes.io/projected/d240f6f9-678c-4ad8-84af-4e24bb10440f-kube-api-access-qgg8c\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261475 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-kubernetes\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261482 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-registration-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261521 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-device-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261538 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261533 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261550 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-var-lib-kubelet\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261584 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-registration-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.314736 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261609 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ec28c3ec-b224-48b9-961e-47da9a2f5b30-device-dir\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261616 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c70bb310-56c5-47c2-905b-639816538960-konnectivity-ca\") pod \"konnectivity-agent-h49hk\" (UID: \"c70bb310-56c5-47c2-905b-639816538960\") " pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261643 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysconfig\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261672 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2055e987-d811-4511-a7e8-75efd27281b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261692 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-sysconfig\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.261722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdcxr\" (UniqueName: \"kubernetes.io/projected/09a03623-03c8-413a-819e-b5638989d278-kube-api-access-tdcxr\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.262872 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c70bb310-56c5-47c2-905b-639816538960-konnectivity-ca\") pod \"konnectivity-agent-h49hk\" (UID: \"c70bb310-56c5-47c2-905b-639816538960\") " pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.263046 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ce636d5-2c44-47cf-a0b9-671192e67af1-tmp\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.263422 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5ce636d5-2c44-47cf-a0b9-671192e67af1-etc-tuned\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.263703 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c70bb310-56c5-47c2-905b-639816538960-agent-certs\") pod \"konnectivity-agent-h49hk\" (UID: \"c70bb310-56c5-47c2-905b-639816538960\") " pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.269156 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.269190 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.269207 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lhmpl for pod openshift-network-diagnostics/network-check-target-bz4qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.269299 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl podName:e25ef18d-2760-4765-bf2d-a44eff90c864 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:57.769264381 +0000 UTC m=+3.071967998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lhmpl" (UniqueName: "kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl") pod "network-check-target-bz4qm" (UID: "e25ef18d-2760-4765-bf2d-a44eff90c864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:57.315893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.274564 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krd5x\" (UniqueName: \"kubernetes.io/projected/64f5abd7-58f7-4b0a-94db-9a3a992d0f66-kube-api-access-krd5x\") pod \"node-resolver-4bxxg\" (UID: \"64f5abd7-58f7-4b0a-94db-9a3a992d0f66\") " pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.317278 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.277190 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc95b\" (UniqueName: \"kubernetes.io/projected/2055e987-d811-4511-a7e8-75efd27281b2-kube-api-access-wc95b\") pod \"multus-additional-cni-plugins-mwqts\" (UID: \"2055e987-d811-4511-a7e8-75efd27281b2\") " pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.317278 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.279049 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgg8c\" (UniqueName: \"kubernetes.io/projected/d240f6f9-678c-4ad8-84af-4e24bb10440f-kube-api-access-qgg8c\") pod \"multus-t66rp\" (UID: \"d240f6f9-678c-4ad8-84af-4e24bb10440f\") " pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.317278 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.279923 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmmzr\" (UniqueName: \"kubernetes.io/projected/5ce636d5-2c44-47cf-a0b9-671192e67af1-kube-api-access-hmmzr\") pod \"tuned-bgzgm\" (UID: \"5ce636d5-2c44-47cf-a0b9-671192e67af1\") " pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.317278 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.315535 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-smdqg" Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.328019 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:57.328100 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9e8556_7305_4e0a_8e45_4f77a30f88c6.slice/crio-4adae870cb26c7e4a7f68753dbae59b7bb7dbf4c73d5c58c57e3f9ded5eb8a64 WatchSource:0}: Error finding container 4adae870cb26c7e4a7f68753dbae59b7bb7dbf4c73d5c58c57e3f9ded5eb8a64: Status 404 returned error can't find the container with id 4adae870cb26c7e4a7f68753dbae59b7bb7dbf4c73d5c58c57e3f9ded5eb8a64 Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:57.342489 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b7efc6_1366_49fa_a329_2c60cead65dd.slice/crio-07f2f7fe5965379c762bfb62599e1d7b93030053c863b7c613ca0cbb04640edb WatchSource:0}: Error finding container 07f2f7fe5965379c762bfb62599e1d7b93030053c863b7c613ca0cbb04640edb: Status 404 returned error can't find the container with id 07f2f7fe5965379c762bfb62599e1d7b93030053c863b7c613ca0cbb04640edb Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.344108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hbqrl" Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.351328 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mwqts" Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:57.356925 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4c9599_cf3e_484f_b4d0_e05fd81063d8.slice/crio-c576a63f27e78060dff866455b17bc68205b362b929eb00e4354d1874f7d5827 WatchSource:0}: Error finding container c576a63f27e78060dff866455b17bc68205b362b929eb00e4354d1874f7d5827: Status 404 returned error can't find the container with id c576a63f27e78060dff866455b17bc68205b362b929eb00e4354d1874f7d5827 Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.358747 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t66rp" Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.368094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:57.372358 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2055e987_d811_4511_a7e8_75efd27281b2.slice/crio-5b71d91d66d83abadcfe2d82dda06b07d2ca44c6da643eb66267d33f028728a9 WatchSource:0}: Error finding container 5b71d91d66d83abadcfe2d82dda06b07d2ca44c6da643eb66267d33f028728a9: Status 404 returned error can't find the container with id 5b71d91d66d83abadcfe2d82dda06b07d2ca44c6da643eb66267d33f028728a9 Jul 16 21:49:57.376531 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:57.373810 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd240f6f9_678c_4ad8_84af_4e24bb10440f.slice/crio-8e68aba9d92004d4e4f3b9e59c1cd1cea30c8a269da744728e36ff25f5e446e6 WatchSource:0}: Error finding container 8e68aba9d92004d4e4f3b9e59c1cd1cea30c8a269da744728e36ff25f5e446e6: Status 404 returned error can't find the container with id 8e68aba9d92004d4e4f3b9e59c1cd1cea30c8a269da744728e36ff25f5e446e6 Jul 16 21:49:57.377307 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.376825 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4bxxg" Jul 16 21:49:57.380127 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.380064 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxsm9\" (UniqueName: \"kubernetes.io/projected/ec28c3ec-b224-48b9-961e-47da9a2f5b30-kube-api-access-nxsm9\") pod \"aws-ebs-csi-driver-node-6stfl\" (UID: \"ec28c3ec-b224-48b9-961e-47da9a2f5b30\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.382495 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.382467 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdcxr\" (UniqueName: \"kubernetes.io/projected/09a03623-03c8-413a-819e-b5638989d278-kube-api-access-tdcxr\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:57.384652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.384626 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:49:57.390335 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.390312 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" Jul 16 21:49:57.766117 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.766037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:57.766117 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.766092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:57.766296 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.766213 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:57.766296 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.766276 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs podName:09a03623-03c8-413a-819e-b5638989d278 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:58.766262114 +0000 UTC m=+4.068965739 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs") pod "network-metrics-daemon-9dnfx" (UID: "09a03623-03c8-413a-819e-b5638989d278") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:57.766387 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.766213 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:57.766520 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.766493 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret podName:5f944a82-6944-48d8-92ef-fd83397b4dca nodeName:}" failed. No retries permitted until 2026-07-16 21:49:58.766474086 +0000 UTC m=+4.069177710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret") pod "global-pull-secret-syncer-4dhl9" (UID: "5f944a82-6944-48d8-92ef-fd83397b4dca") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:57.866680 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:57.866642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:49:57.866923 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.866894 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:57.866972 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.866932 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:57.866972 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.866950 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lhmpl for pod openshift-network-diagnostics/network-check-target-bz4qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:57.867050 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:57.867029 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl podName:e25ef18d-2760-4765-bf2d-a44eff90c864 nodeName:}" failed. No retries permitted until 2026-07-16 21:49:58.867004129 +0000 UTC m=+4.169707756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhmpl" (UniqueName: "kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl") pod "network-check-target-bz4qm" (UID: "e25ef18d-2760-4765-bf2d-a44eff90c864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:58.059321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.059188 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:44:57 +0000 UTC" deadline="2028-03-08 18:23:21.920705193 +0000 UTC" Jul 16 21:49:58.059321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.059243 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14420h33m23.861465395s" Jul 16 21:49:58.109183 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:58.109137 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce636d5_2c44_47cf_a0b9_671192e67af1.slice/crio-4ee35c5bff315ba2d4d9c8bf17d421b49b5342ba1dd294d838e6a0cfdce6b616 WatchSource:0}: Error finding container 4ee35c5bff315ba2d4d9c8bf17d421b49b5342ba1dd294d838e6a0cfdce6b616: Status 404 returned error can't find the container with id 4ee35c5bff315ba2d4d9c8bf17d421b49b5342ba1dd294d838e6a0cfdce6b616 Jul 16 21:49:58.124023 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.123991 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:58.124477 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.124155 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:49:58.177144 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.177113 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:58.183043 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.182994 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" event={"ID":"5ce636d5-2c44-47cf-a0b9-671192e67af1","Type":"ContainerStarted","Data":"4ee35c5bff315ba2d4d9c8bf17d421b49b5342ba1dd294d838e6a0cfdce6b616"} Jul 16 21:49:58.184320 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.184248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t66rp" event={"ID":"d240f6f9-678c-4ad8-84af-4e24bb10440f","Type":"ContainerStarted","Data":"8e68aba9d92004d4e4f3b9e59c1cd1cea30c8a269da744728e36ff25f5e446e6"} Jul 16 21:49:58.186174 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.186131 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerStarted","Data":"5b71d91d66d83abadcfe2d82dda06b07d2ca44c6da643eb66267d33f028728a9"} Jul 16 21:49:58.187535 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.187500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hbqrl" event={"ID":"da4c9599-cf3e-484f-b4d0-e05fd81063d8","Type":"ContainerStarted","Data":"c576a63f27e78060dff866455b17bc68205b362b929eb00e4354d1874f7d5827"} Jul 16 21:49:58.188940 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.188911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"07f2f7fe5965379c762bfb62599e1d7b93030053c863b7c613ca0cbb04640edb"} Jul 16 21:49:58.190389 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.190347 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-smdqg" event={"ID":"3a9e8556-7305-4e0a-8e45-4f77a30f88c6","Type":"ContainerStarted","Data":"4adae870cb26c7e4a7f68753dbae59b7bb7dbf4c73d5c58c57e3f9ded5eb8a64"} Jul 16 21:49:58.618013 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:58.617969 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec28c3ec_b224_48b9_961e_47da9a2f5b30.slice/crio-c7a6a9145533500f4f376aa0cca314379d8af59966d79cdd97832ba8deabcc20 WatchSource:0}: Error finding container c7a6a9145533500f4f376aa0cca314379d8af59966d79cdd97832ba8deabcc20: Status 404 returned error can't find the container with id c7a6a9145533500f4f376aa0cca314379d8af59966d79cdd97832ba8deabcc20 Jul 16 21:49:58.622557 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:58.622527 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64f5abd7_58f7_4b0a_94db_9a3a992d0f66.slice/crio-a4536da29cd94d307cde400f012f078a5df8066293827be889009c840780bfab WatchSource:0}: Error finding container a4536da29cd94d307cde400f012f078a5df8066293827be889009c840780bfab: Status 404 returned error can't find the container with id a4536da29cd94d307cde400f012f078a5df8066293827be889009c840780bfab Jul 16 21:49:58.629269 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:49:58.629241 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70bb310_56c5_47c2_905b_639816538960.slice/crio-d934dfcd83d6836c041ec1a01566b3b3c6af290288c72478febbf176d3d0a366 WatchSource:0}: Error finding container d934dfcd83d6836c041ec1a01566b3b3c6af290288c72478febbf176d3d0a366: Status 404 returned error can't find the container with id d934dfcd83d6836c041ec1a01566b3b3c6af290288c72478febbf176d3d0a366 Jul 16 21:49:58.776354 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.776072 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:58.776354 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.776350 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:58.776555 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.776387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:49:58.776555 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.776435 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret podName:5f944a82-6944-48d8-92ef-fd83397b4dca nodeName:}" failed. No retries permitted until 2026-07-16 21:50:00.77641312 +0000 UTC m=+6.079116738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret") pod "global-pull-secret-syncer-4dhl9" (UID: "5f944a82-6944-48d8-92ef-fd83397b4dca") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:49:58.776555 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.776499 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:58.776555 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.776554 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs podName:09a03623-03c8-413a-819e-b5638989d278 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:00.776537055 +0000 UTC m=+6.079240681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs") pod "network-metrics-daemon-9dnfx" (UID: "09a03623-03c8-413a-819e-b5638989d278") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:49:58.827522 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.827208 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 21:49:58.879486 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:58.878677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:49:58.879486 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.878921 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:49:58.879486 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.878947 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:49:58.879486 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.878961 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lhmpl for pod openshift-network-diagnostics/network-check-target-bz4qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:58.879486 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:58.879029 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl podName:e25ef18d-2760-4765-bf2d-a44eff90c864 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:00.879007641 +0000 UTC m=+6.181711276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhmpl" (UniqueName: "kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl") pod "network-check-target-bz4qm" (UID: "e25ef18d-2760-4765-bf2d-a44eff90c864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:49:59.060495 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.060444 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:44:57 +0000 UTC" deadline="2028-01-03 19:32:29.833245626 +0000 UTC" Jul 16 21:49:59.060495 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.060492 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12861h42m30.772758897s" Jul 16 21:49:59.126199 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.126166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:49:59.126842 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:59.126299 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:49:59.126842 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.126726 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:49:59.126842 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:49:59.126825 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:49:59.207695 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.206379 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" event={"ID":"089fec5c138becb10b4b84131314bfc6","Type":"ContainerStarted","Data":"f391b8faef688ce2747c8cdcd4a15fb6e77e39a134cea8cd69b1fdf7f4762b9f"} Jul 16 21:49:59.215705 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.215661 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" event={"ID":"fd317b625691a579a6c9126452699ab4","Type":"ContainerStarted","Data":"fce655cdad479b12efa6ed8f6eecf1f7f3d61ee0470614a642e9f0d5046e3fe3"} Jul 16 21:49:59.217822 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.217790 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h49hk" event={"ID":"c70bb310-56c5-47c2-905b-639816538960","Type":"ContainerStarted","Data":"d934dfcd83d6836c041ec1a01566b3b3c6af290288c72478febbf176d3d0a366"} Jul 16 21:49:59.222212 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.222182 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4bxxg" event={"ID":"64f5abd7-58f7-4b0a-94db-9a3a992d0f66","Type":"ContainerStarted","Data":"a4536da29cd94d307cde400f012f078a5df8066293827be889009c840780bfab"} Jul 16 21:49:59.238977 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.238945 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" event={"ID":"ec28c3ec-b224-48b9-961e-47da9a2f5b30","Type":"ContainerStarted","Data":"c7a6a9145533500f4f376aa0cca314379d8af59966d79cdd97832ba8deabcc20"} Jul 16 21:49:59.245390 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:49:59.245311 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-28.ec2.internal" podStartSLOduration=3.24529127 podStartE2EDuration="3.24529127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:59.22780515 +0000 UTC m=+4.530508802" watchObservedRunningTime="2026-07-16 21:49:59.24529127 +0000 UTC m=+4.547994906" Jul 16 21:50:00.123592 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:00.123553 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:00.123793 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.123729 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:00.266745 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:00.265945 2563 generic.go:356] "Generic (PLEG): container finished" podID="fd317b625691a579a6c9126452699ab4" containerID="fce655cdad479b12efa6ed8f6eecf1f7f3d61ee0470614a642e9f0d5046e3fe3" exitCode=0 Jul 16 21:50:00.266745 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:00.266073 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" event={"ID":"fd317b625691a579a6c9126452699ab4","Type":"ContainerDied","Data":"fce655cdad479b12efa6ed8f6eecf1f7f3d61ee0470614a642e9f0d5046e3fe3"} Jul 16 21:50:00.799921 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:00.799799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:00.799921 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:00.799904 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:00.800411 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.800161 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:00.800411 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.800234 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs podName:09a03623-03c8-413a-819e-b5638989d278 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:04.800212988 +0000 UTC m=+10.102916611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs") pod "network-metrics-daemon-9dnfx" (UID: "09a03623-03c8-413a-819e-b5638989d278") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:00.800646 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.800488 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:00.800646 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.800555 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret podName:5f944a82-6944-48d8-92ef-fd83397b4dca nodeName:}" failed. No retries permitted until 2026-07-16 21:50:04.800534647 +0000 UTC m=+10.103238276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret") pod "global-pull-secret-syncer-4dhl9" (UID: "5f944a82-6944-48d8-92ef-fd83397b4dca") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:00.900829 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:00.900775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:00.901022 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.901007 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:00.901098 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.901030 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:00.901098 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.901044 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lhmpl for pod openshift-network-diagnostics/network-check-target-bz4qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:00.901215 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:00.901106 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl podName:e25ef18d-2760-4765-bf2d-a44eff90c864 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:04.901087483 +0000 UTC m=+10.203791099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhmpl" (UniqueName: "kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl") pod "network-check-target-bz4qm" (UID: "e25ef18d-2760-4765-bf2d-a44eff90c864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:01.126184 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:01.126095 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:01.126372 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:01.126238 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:01.126711 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:01.126680 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:01.126850 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:01.126794 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:01.277905 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:01.277864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" event={"ID":"fd317b625691a579a6c9126452699ab4","Type":"ContainerStarted","Data":"7230b577d644595aa9add542b52323fb7739ed9dda38ed4044d3ad4582d1af10"} Jul 16 21:50:02.124000 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:02.123966 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:02.124190 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:02.124117 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:03.123981 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:03.123503 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:03.123981 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:03.123533 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:03.123981 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:03.123635 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:03.123981 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:03.123731 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:04.123645 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:04.123613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:04.123830 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.123752 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:04.835939 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:04.835897 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:04.835939 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:04.835957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:04.836480 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.836081 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:04.836480 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.836159 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret podName:5f944a82-6944-48d8-92ef-fd83397b4dca nodeName:}" failed. No retries permitted until 2026-07-16 21:50:12.83613843 +0000 UTC m=+18.138842043 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret") pod "global-pull-secret-syncer-4dhl9" (UID: "5f944a82-6944-48d8-92ef-fd83397b4dca") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:04.836579 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.836084 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:04.836579 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.836542 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs podName:09a03623-03c8-413a-819e-b5638989d278 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:12.83652598 +0000 UTC m=+18.139229593 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs") pod "network-metrics-daemon-9dnfx" (UID: "09a03623-03c8-413a-819e-b5638989d278") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:04.936956 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:04.936872 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:04.937116 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.937048 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:04.937116 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.937077 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:04.937116 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.937091 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lhmpl for pod openshift-network-diagnostics/network-check-target-bz4qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:04.937284 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:04.937159 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl podName:e25ef18d-2760-4765-bf2d-a44eff90c864 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:12.937140712 +0000 UTC m=+18.239844323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhmpl" (UniqueName: "kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl") pod "network-check-target-bz4qm" (UID: "e25ef18d-2760-4765-bf2d-a44eff90c864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:05.124800 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:05.124071 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:05.124800 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:05.124191 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:05.124800 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:05.124609 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:05.124800 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:05.124706 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:06.123596 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:06.123489 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:06.124093 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:06.123655 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:07.123485 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:07.123389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:07.123635 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:07.123389 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:07.123635 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:07.123526 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:07.123635 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:07.123610 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:08.123705 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:08.123676 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:08.124106 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:08.123817 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:09.123778 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:09.123742 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:09.123778 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:09.123774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:09.124253 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:09.123877 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:09.124253 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:09.124007 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:10.123599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:10.123558 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:10.123791 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:10.123698 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:11.124158 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:11.124118 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:11.124646 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:11.124117 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:11.124646 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:11.124263 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:11.124646 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:11.124368 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:12.123899 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:12.123856 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:12.124097 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.124010 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:12.894985 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:12.894952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:12.895480 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:12.894999 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:12.895480 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.895094 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:12.895480 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.895147 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:12.895480 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.895151 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret podName:5f944a82-6944-48d8-92ef-fd83397b4dca nodeName:}" failed. No retries permitted until 2026-07-16 21:50:28.895137098 +0000 UTC m=+34.197840707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret") pod "global-pull-secret-syncer-4dhl9" (UID: "5f944a82-6944-48d8-92ef-fd83397b4dca") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:12.895480 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.895215 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs podName:09a03623-03c8-413a-819e-b5638989d278 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:28.895197439 +0000 UTC m=+34.197901053 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs") pod "network-metrics-daemon-9dnfx" (UID: "09a03623-03c8-413a-819e-b5638989d278") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:12.995897 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:12.995863 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:12.996073 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.996034 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:12.996073 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.996055 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:12.996073 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.996065 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lhmpl for pod openshift-network-diagnostics/network-check-target-bz4qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:12.996197 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:12.996116 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl podName:e25ef18d-2760-4765-bf2d-a44eff90c864 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:28.996103304 +0000 UTC m=+34.298806925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhmpl" (UniqueName: "kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl") pod "network-check-target-bz4qm" (UID: "e25ef18d-2760-4765-bf2d-a44eff90c864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:13.123106 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:13.123042 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:13.123303 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:13.123179 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:13.123303 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:13.123231 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:13.123428 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:13.123341 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:14.123386 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:14.123350 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:14.123840 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:14.123478 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:15.123914 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:15.123879 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:15.124385 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:15.123989 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:15.124385 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:15.124044 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:15.124385 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:15.124158 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:16.123139 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:16.123098 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:16.123353 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:16.123246 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:17.123218 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.123005 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:17.123576 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:17.123334 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:17.123576 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.123137 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:17.123576 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:17.123428 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:17.311985 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.311955 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerStarted","Data":"03c3b36b937700eb95ab7fbd4c5a908cd70bbe489e75edf0dc57f85f2b45e9da"} Jul 16 21:50:17.313372 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.313334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h49hk" event={"ID":"c70bb310-56c5-47c2-905b-639816538960","Type":"ContainerStarted","Data":"d52d5a53a9396959c179a40c547de92e232985cb7b9d8e6008e3cfa16186f3cd"} Jul 16 21:50:17.314737 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.314703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4bxxg" event={"ID":"64f5abd7-58f7-4b0a-94db-9a3a992d0f66","Type":"ContainerStarted","Data":"f72fa537c218ccfc419994dd9a6f98fb46118cddc77a51803b3990633fa579ce"} Jul 16 21:50:17.316086 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.316065 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" event={"ID":"ec28c3ec-b224-48b9-961e-47da9a2f5b30","Type":"ContainerStarted","Data":"6da13d34778106a91c51fa4276ee1efc195593a90737d695dc629d799fe3583a"} Jul 16 21:50:17.317236 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.317218 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" event={"ID":"5ce636d5-2c44-47cf-a0b9-671192e67af1","Type":"ContainerStarted","Data":"8fd3790478e4ee320d8bfb960ea3a0d38dc37f8ed2453b921fda1aa46d0f49c9"} Jul 16 21:50:17.318598 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.318570 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t66rp" event={"ID":"d240f6f9-678c-4ad8-84af-4e24bb10440f","Type":"ContainerStarted","Data":"5f1c9a838cf2f0a799cabde13ad50829020e8cf67ac3af4ccc06ba48a872acdb"} Jul 16 21:50:17.320189 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.320170 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"fb1897c79c25380a33e3342e5a3746de6ad31620aeabf4a8d70d4cbf5a6bce6c"} Jul 16 21:50:17.320294 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.320224 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"ff1d82e8c8498a60a3b9068879e6e02c229b0594e41a5b0ebe521f2c9cee96a0"} Jul 16 21:50:17.321663 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.321645 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-smdqg" event={"ID":"3a9e8556-7305-4e0a-8e45-4f77a30f88c6","Type":"ContainerStarted","Data":"2f553bfdf3e81d00b13e76e8542a84a2467dfb04b59d73f8d7f6647cc5ada714"} Jul 16 21:50:17.337794 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.337749 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-28.ec2.internal" podStartSLOduration=21.337717137 podStartE2EDuration="21.337717137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:01.321705448 +0000 UTC m=+6.624409103" watchObservedRunningTime="2026-07-16 21:50:17.337717137 +0000 UTC m=+22.640420759" Jul 16 21:50:17.356479 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.356436 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4bxxg" podStartSLOduration=3.9734045140000003 podStartE2EDuration="22.356418509s" totalImagesPullingTime="18.383013995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:17.356403576 +0000 UTC m=+22.659107206" watchObservedRunningTime="2026-07-16 21:50:17.356418509 +0000 UTC m=+22.659122122" Jul 16 21:50:17.374143 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.374103 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h49hk" podStartSLOduration=3.003794441 podStartE2EDuration="21.374089098s" totalImagesPullingTime="18.370294657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:17.373833368 +0000 UTC m=+22.676537010" watchObservedRunningTime="2026-07-16 21:50:17.374089098 +0000 UTC m=+22.676792729" Jul 16 21:50:17.391920 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.391863 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-smdqg" podStartSLOduration=2.765252427 podStartE2EDuration="22.391847128s" totalImagesPullingTime="19.626594701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:17.391514033 +0000 UTC m=+22.694217663" watchObservedRunningTime="2026-07-16 21:50:17.391847128 +0000 UTC m=+22.694550758" Jul 16 21:50:17.417470 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.417417 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t66rp" podStartSLOduration=2.7303860220000002 podStartE2EDuration="22.417403527s" totalImagesPullingTime="19.687017505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:17.416569628 +0000 UTC m=+22.719273257" watchObservedRunningTime="2026-07-16 21:50:17.417403527 +0000 UTC m=+22.720107157" Jul 16 21:50:17.438975 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:17.438862 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-bgzgm" podStartSLOduration=3.541958983 podStartE2EDuration="22.438840408s" totalImagesPullingTime="18.896881425s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:17.438051838 +0000 UTC m=+22.740755489" watchObservedRunningTime="2026-07-16 21:50:17.438840408 +0000 UTC m=+22.741544051" Jul 16 21:50:18.123616 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.123426 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:18.124376 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:18.123698 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:18.324989 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.324915 2563 generic.go:356] "Generic (PLEG): container finished" podID="2055e987-d811-4511-a7e8-75efd27281b2" containerID="03c3b36b937700eb95ab7fbd4c5a908cd70bbe489e75edf0dc57f85f2b45e9da" exitCode=0 Jul 16 21:50:18.325155 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.325005 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerDied","Data":"03c3b36b937700eb95ab7fbd4c5a908cd70bbe489e75edf0dc57f85f2b45e9da"} Jul 16 21:50:18.327608 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.327592 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 21:50:18.327908 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.327889 2563 generic.go:356] "Generic (PLEG): container finished" podID="d7b7efc6-1366-49fa-a329-2c60cead65dd" containerID="fb1897c79c25380a33e3342e5a3746de6ad31620aeabf4a8d70d4cbf5a6bce6c" exitCode=1 Jul 16 21:50:18.328005 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.327980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerDied","Data":"fb1897c79c25380a33e3342e5a3746de6ad31620aeabf4a8d70d4cbf5a6bce6c"} Jul 16 21:50:18.328079 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.328066 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"918e890c1b796417669a46760973e3756e09d1766707114195d1aa4bad5c1045"} Jul 16 21:50:18.328133 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.328119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"d9ce479b82c120375a7c74a8c08f576486ad1e8f317bb06de05e03f4eedba2fe"} Jul 16 21:50:18.328185 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.328169 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"5ba0f8412138322feb38390e2ee7830541534f814e727ee6f35fb56b347bbd10"} Jul 16 21:50:18.328235 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.328220 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"efb2108ea4bbb90ea09f6b4189870b9f01dfcaf02fb76d321e73c64e4f3b9dfb"} Jul 16 21:50:18.571490 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.571462 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 21:50:18.581513 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:18.581463 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:50:19.105380 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.105223 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T21:50:18.571484769Z","UUID":"3f829522-eda6-4f6a-b325-b5cacad7fd45","Handler":null,"Name":"","Endpoint":""} Jul 16 21:50:19.107004 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.106982 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 21:50:19.107143 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.107023 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 21:50:19.124026 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.123997 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:19.124486 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:19.124116 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:19.124486 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.124180 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:19.124486 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:19.124316 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:19.332850 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.332800 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hbqrl" event={"ID":"da4c9599-cf3e-484f-b4d0-e05fd81063d8","Type":"ContainerStarted","Data":"b717f2fc927443792752cfc8f0c1fe96702c1217f30de82865b94c3f7898da05"} Jul 16 21:50:19.335351 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.335303 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" event={"ID":"ec28c3ec-b224-48b9-961e-47da9a2f5b30","Type":"ContainerStarted","Data":"0d7eb341a6cf34876320baf9202ca79f3d365392b7c2014d65b82d76d240d8c8"} Jul 16 21:50:19.344035 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.344007 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:50:19.344581 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.344556 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:50:19.352242 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:19.352197 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hbqrl" podStartSLOduration=4.714486617 podStartE2EDuration="24.352178391s" totalImagesPullingTime="19.637691774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:19.352158247 +0000 UTC m=+24.654861879" watchObservedRunningTime="2026-07-16 21:50:19.352178391 +0000 UTC m=+24.654882024" Jul 16 21:50:20.123424 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:20.123187 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:20.123644 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:20.123547 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:20.340510 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:20.340379 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" event={"ID":"ec28c3ec-b224-48b9-961e-47da9a2f5b30","Type":"ContainerStarted","Data":"fd931f0c87e630b0ac1d8f97e0923164cc3317d26050bd423cb04bdf33850e4b"} Jul 16 21:50:20.344223 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:20.344199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 21:50:20.344787 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:20.344736 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"1de34524081e2b01091f3c8354be691250640094a4057540200b35801c3dc134"} Jul 16 21:50:20.345338 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:20.345315 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h49hk" Jul 16 21:50:20.364049 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:20.364001 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6stfl" podStartSLOduration=3.554465806 podStartE2EDuration="24.363987451s" totalImagesPullingTime="20.809521645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:20.36366624 +0000 UTC m=+25.666369872" watchObservedRunningTime="2026-07-16 21:50:20.363987451 +0000 UTC m=+25.666691081" Jul 16 21:50:21.123503 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:21.123468 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:21.123676 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:21.123605 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:21.123676 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:21.123657 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:21.123804 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:21.123783 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:22.123292 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:22.123246 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:22.123905 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:22.123397 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:23.124149 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.123957 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:23.124689 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.123957 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:23.124689 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:23.124248 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:23.124689 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:23.124306 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:23.354253 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.354177 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 21:50:23.354595 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.354573 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"e6d575f2b832f09febf7ad85041aafe1989701ac5d3bbf87b42ac6be8d5eb1bd"} Jul 16 21:50:23.354823 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.354802 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:50:23.354989 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.354960 2563 scope.go:117] "RemoveContainer" containerID="fb1897c79c25380a33e3342e5a3746de6ad31620aeabf4a8d70d4cbf5a6bce6c" Jul 16 21:50:23.356721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.356696 2563 generic.go:356] "Generic (PLEG): container finished" podID="2055e987-d811-4511-a7e8-75efd27281b2" containerID="c86951421d2af79f65ec12608a94a7240b319c14b36de15163db0c3d2d53a7bc" exitCode=0 Jul 16 21:50:23.356797 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.356745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerDied","Data":"c86951421d2af79f65ec12608a94a7240b319c14b36de15163db0c3d2d53a7bc"} Jul 16 21:50:23.372343 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:23.372323 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:50:24.123216 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:24.123184 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:24.123459 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:24.123313 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:24.363356 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:24.363331 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 21:50:24.363959 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:24.363743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" event={"ID":"d7b7efc6-1366-49fa-a329-2c60cead65dd","Type":"ContainerStarted","Data":"be397c215716a5bbb1ea2b43cb19862ec2fe50ad44983e085cc485427355ff4e"} Jul 16 21:50:24.364100 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:24.364080 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:50:24.364193 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:24.364162 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:50:24.381839 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:24.381813 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:50:24.398556 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:24.398342 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" podStartSLOduration=9.673746091 podStartE2EDuration="29.398321283s" totalImagesPullingTime="19.724575192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:24.398176504 +0000 UTC m=+29.700880138" watchObservedRunningTime="2026-07-16 21:50:24.398321283 +0000 UTC m=+29.701024915" Jul 16 21:50:24.999919 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:24.999727 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9dnfx"] Jul 16 21:50:25.000108 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:25.000049 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:25.000189 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:25.000165 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:25.003184 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:25.003161 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4dhl9"] Jul 16 21:50:25.003331 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:25.003266 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:25.003401 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:25.003380 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:25.006304 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:25.006264 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bz4qm"] Jul 16 21:50:25.006378 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:25.006368 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:25.006463 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:25.006443 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:25.368468 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:25.368436 2563 generic.go:356] "Generic (PLEG): container finished" podID="2055e987-d811-4511-a7e8-75efd27281b2" containerID="292f0ce2af7679cc69f792cd659305a8fdbd9e9d10d40c60ed3a01ac525dfbdb" exitCode=0 Jul 16 21:50:25.368854 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:25.368513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerDied","Data":"292f0ce2af7679cc69f792cd659305a8fdbd9e9d10d40c60ed3a01ac525dfbdb"} Jul 16 21:50:26.123983 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:26.123953 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:26.124136 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:26.124060 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:27.124012 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:27.123978 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:27.124893 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:27.124025 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:27.124893 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:27.124118 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:27.124893 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:27.124240 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:27.375527 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:27.375438 2563 generic.go:356] "Generic (PLEG): container finished" podID="2055e987-d811-4511-a7e8-75efd27281b2" containerID="5fa66431ce3d3e585ce50d1c9b96ec5bb22e5df988d768f21c66645ef0132c50" exitCode=0 Jul 16 21:50:27.375527 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:27.375502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerDied","Data":"5fa66431ce3d3e585ce50d1c9b96ec5bb22e5df988d768f21c66645ef0132c50"} Jul 16 21:50:28.124165 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:28.124131 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:28.124586 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:28.124296 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9dnfx" podUID="09a03623-03c8-413a-819e-b5638989d278" Jul 16 21:50:28.914510 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:28.914460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:28.914693 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:28.914529 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:28.914693 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:28.914633 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:28.914693 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:28.914659 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:28.914850 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:28.914712 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret podName:5f944a82-6944-48d8-92ef-fd83397b4dca nodeName:}" failed. No retries permitted until 2026-07-16 21:51:00.914690953 +0000 UTC m=+66.217394575 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret") pod "global-pull-secret-syncer-4dhl9" (UID: "5f944a82-6944-48d8-92ef-fd83397b4dca") : object "kube-system"/"original-pull-secret" not registered Jul 16 21:50:28.914850 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:28.914735 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs podName:09a03623-03c8-413a-819e-b5638989d278 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:00.914724965 +0000 UTC m=+66.217428587 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs") pod "network-metrics-daemon-9dnfx" (UID: "09a03623-03c8-413a-819e-b5638989d278") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 21:50:29.015287 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:29.015250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:29.015487 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:29.015411 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 21:50:29.015487 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:29.015432 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 21:50:29.015487 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:29.015443 2563 projected.go:196] Error preparing data for projected volume kube-api-access-lhmpl for pod openshift-network-diagnostics/network-check-target-bz4qm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:29.015617 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:29.015501 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl podName:e25ef18d-2760-4765-bf2d-a44eff90c864 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:01.015482715 +0000 UTC m=+66.318186345 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lhmpl" (UniqueName: "kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl") pod "network-check-target-bz4qm" (UID: "e25ef18d-2760-4765-bf2d-a44eff90c864") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 21:50:29.123371 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:29.123339 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:29.123550 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:29.123478 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4dhl9" podUID="5f944a82-6944-48d8-92ef-fd83397b4dca" Jul 16 21:50:29.123550 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:29.123529 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:29.123691 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:29.123633 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bz4qm" podUID="e25ef18d-2760-4765-bf2d-a44eff90c864" Jul 16 21:50:30.075618 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.075538 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-28.ec2.internal" event="NodeReady" Jul 16 21:50:30.076048 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.075694 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 21:50:30.118787 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.118753 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf"] Jul 16 21:50:30.123387 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.123339 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz"] Jul 16 21:50:30.123556 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.123479 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" Jul 16 21:50:30.125026 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.124438 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:50:30.127333 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.126855 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-9mrm2\"" Jul 16 21:50:30.127333 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.127019 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 21:50:30.128404 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.128377 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 21:50:30.128860 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.128840 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 21:50:30.128955 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.128909 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 21:50:30.129017 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.128979 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 21:50:30.129017 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.128913 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmhws\"" Jul 16 21:50:30.130056 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.130033 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd"] Jul 16 21:50:30.130182 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.130162 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.131856 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.131834 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-747cdc9cd4-57tz2"] Jul 16 21:50:30.131984 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.131957 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.135229 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.135200 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 16 21:50:30.135523 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.135495 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 16 21:50:30.135886 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.135868 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mnc95"] Jul 16 21:50:30.136521 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.136501 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 16 21:50:30.136622 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.136538 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 16 21:50:30.136622 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.136571 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 16 21:50:30.136837 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.136817 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.138478 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.138461 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf"] Jul 16 21:50:30.138578 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.138491 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zxmnm"] Jul 16 21:50:30.138745 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.138725 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mnc95" Jul 16 21:50:30.140348 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.140329 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 21:50:30.140445 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.140430 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.140445 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.140392 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 21:50:30.142398 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.142377 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd"] Jul 16 21:50:30.142744 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.142585 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hqltp\"" Jul 16 21:50:30.142744 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.142644 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 21:50:30.143772 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.143747 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 21:50:30.143873 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.143747 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 21:50:30.143873 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.143793 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 21:50:30.144046 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.144030 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 21:50:30.144123 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.144107 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2kl8b\"" Jul 16 21:50:30.144504 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.144482 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 21:50:30.145141 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.145111 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5hcvl\"" Jul 16 21:50:30.146989 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.146970 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 21:50:30.156381 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.156004 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz"] Jul 16 21:50:30.157775 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.157752 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zxmnm"] Jul 16 21:50:30.164547 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.164508 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-747cdc9cd4-57tz2"] Jul 16 21:50:30.170148 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.170121 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mnc95"] Jul 16 21:50:30.223334 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223293 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.223501 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-installation-pull-secrets\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.223501 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223366 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.223501 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223392 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-hub\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.223501 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22b3bbb9-18cb-4e41-b045-62d3f490e549-cert\") pod \"ingress-canary-mnc95\" (UID: \"22b3bbb9-18cb-4e41-b045-62d3f490e549\") " pod="openshift-ingress-canary/ingress-canary-mnc95" Jul 16 21:50:30.223501 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-ca-trust-extracted\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsz62\" (UniqueName: \"kubernetes.io/projected/8072a8eb-d828-4813-9052-b9b37b28d940-kube-api-access-rsz62\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-bound-sa-token\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223592 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/de9c29eb-85e5-41d3-a977-eeb1a86ef084-klusterlet-config\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223613 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-trusted-ca\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8072a8eb-d828-4813-9052-b9b37b28d940-config-volume\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223674 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57nq2\" (UniqueName: \"kubernetes.io/projected/4b056f52-52a2-4192-918f-a51700d7c0a8-kube-api-access-57nq2\") pod \"managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf\" (UID: \"4b056f52-52a2-4192-918f-a51700d7c0a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-ca\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.223721 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223709 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223733 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6vr\" (UniqueName: \"kubernetes.io/projected/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-kube-api-access-dr6vr\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223793 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-image-registry-private-configuration\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223830 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sfp4\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-kube-api-access-4sfp4\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b056f52-52a2-4192-918f-a51700d7c0a8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf\" (UID: \"4b056f52-52a2-4192-918f-a51700d7c0a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9c29eb-85e5-41d3-a977-eeb1a86ef084-tmp\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.223979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtxxw\" (UniqueName: \"kubernetes.io/projected/de9c29eb-85e5-41d3-a977-eeb1a86ef084-kube-api-access-xtxxw\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.224005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.224034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrq9v\" (UniqueName: \"kubernetes.io/projected/22b3bbb9-18cb-4e41-b045-62d3f490e549-kube-api-access-qrq9v\") pod \"ingress-canary-mnc95\" (UID: \"22b3bbb9-18cb-4e41-b045-62d3f490e549\") " pod="openshift-ingress-canary/ingress-canary-mnc95" Jul 16 21:50:30.224094 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.224090 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8072a8eb-d828-4813-9052-b9b37b28d940-tmp-dir\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.224425 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.224152 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-certificates\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.324740 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324701 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-trusted-ca\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.324740 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324744 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8072a8eb-d828-4813-9052-b9b37b28d940-config-volume\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57nq2\" (UniqueName: \"kubernetes.io/projected/4b056f52-52a2-4192-918f-a51700d7c0a8-kube-api-access-57nq2\") pod \"managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf\" (UID: \"4b056f52-52a2-4192-918f-a51700d7c0a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324790 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-ca\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324811 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324832 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6vr\" (UniqueName: \"kubernetes.io/projected/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-kube-api-access-dr6vr\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-image-registry-private-configuration\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324883 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sfp4\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-kube-api-access-4sfp4\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b056f52-52a2-4192-918f-a51700d7c0a8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf\" (UID: \"4b056f52-52a2-4192-918f-a51700d7c0a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9c29eb-85e5-41d3-a977-eeb1a86ef084-tmp\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.324980 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.324975 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtxxw\" (UniqueName: \"kubernetes.io/projected/de9c29eb-85e5-41d3-a977-eeb1a86ef084-kube-api-access-xtxxw\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325000 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325024 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrq9v\" (UniqueName: \"kubernetes.io/projected/22b3bbb9-18cb-4e41-b045-62d3f490e549-kube-api-access-qrq9v\") pod \"ingress-canary-mnc95\" (UID: \"22b3bbb9-18cb-4e41-b045-62d3f490e549\") " pod="openshift-ingress-canary/ingress-canary-mnc95" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325065 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8072a8eb-d828-4813-9052-b9b37b28d940-tmp-dir\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325089 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-certificates\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325211 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-installation-pull-secrets\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325238 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325268 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-hub\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325313 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22b3bbb9-18cb-4e41-b045-62d3f490e549-cert\") pod \"ingress-canary-mnc95\" (UID: \"22b3bbb9-18cb-4e41-b045-62d3f490e549\") " pod="openshift-ingress-canary/ingress-canary-mnc95" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325342 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-ca-trust-extracted\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsz62\" (UniqueName: \"kubernetes.io/projected/8072a8eb-d828-4813-9052-b9b37b28d940-kube-api-access-rsz62\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.325414 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325404 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-bound-sa-token\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.325994 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325425 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8072a8eb-d828-4813-9052-b9b37b28d940-config-volume\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.325994 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.325994 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325557 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/de9c29eb-85e5-41d3-a977-eeb1a86ef084-klusterlet-config\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.325994 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.325932 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/de9c29eb-85e5-41d3-a977-eeb1a86ef084-tmp\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.326929 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.326506 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-ca-trust-extracted\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.326929 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.326637 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8072a8eb-d828-4813-9052-b9b37b28d940-tmp-dir\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.326929 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.326844 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:30.326929 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.326861 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747cdc9cd4-57tz2: secret "image-registry-tls" not found Jul 16 21:50:30.326929 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.326929 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls podName:74e31b83-51ea-448b-9a7d-a3d2c72bfc7c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:30.826911135 +0000 UTC m=+36.129614773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls") pod "image-registry-747cdc9cd4-57tz2" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c") : secret "image-registry-tls" not found Jul 16 21:50:30.327291 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.327197 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.327487 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.327464 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:30.327579 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.327536 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls podName:8072a8eb-d828-4813-9052-b9b37b28d940 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:30.827518456 +0000 UTC m=+36.130222070 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls") pod "dns-default-zxmnm" (UID: "8072a8eb-d828-4813-9052-b9b37b28d940") : secret "dns-default-metrics-tls" not found Jul 16 21:50:30.327975 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.327949 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-trusted-ca\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.328066 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.328033 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-certificates\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.330652 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.330629 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22b3bbb9-18cb-4e41-b045-62d3f490e549-cert\") pod \"ingress-canary-mnc95\" (UID: \"22b3bbb9-18cb-4e41-b045-62d3f490e549\") " pod="openshift-ingress-canary/ingress-canary-mnc95" Jul 16 21:50:30.331063 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.331038 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-ca\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.331172 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.331149 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/de9c29eb-85e5-41d3-a977-eeb1a86ef084-klusterlet-config\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.331521 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.331488 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.331675 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.331655 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b056f52-52a2-4192-918f-a51700d7c0a8-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf\" (UID: \"4b056f52-52a2-4192-918f-a51700d7c0a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" Jul 16 21:50:30.331846 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.331770 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.332013 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.331992 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-hub\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.332539 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.332514 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-installation-pull-secrets\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.332917 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.332895 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-image-registry-private-configuration\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.334835 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.334804 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtxxw\" (UniqueName: \"kubernetes.io/projected/de9c29eb-85e5-41d3-a977-eeb1a86ef084-kube-api-access-xtxxw\") pod \"klusterlet-addon-workmgr-864dfdfb6d-8fbzz\" (UID: \"de9c29eb-85e5-41d3-a977-eeb1a86ef084\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.335632 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.335097 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6vr\" (UniqueName: \"kubernetes.io/projected/0ec4d269-ae8a-49ea-9cf4-2029ea1efc87-kube-api-access-dr6vr\") pod \"cluster-proxy-proxy-agent-bb645b85-pvmnd\" (UID: \"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.336517 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.336116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sfp4\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-kube-api-access-4sfp4\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.336635 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.336605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57nq2\" (UniqueName: \"kubernetes.io/projected/4b056f52-52a2-4192-918f-a51700d7c0a8-kube-api-access-57nq2\") pod \"managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf\" (UID: \"4b056f52-52a2-4192-918f-a51700d7c0a8\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" Jul 16 21:50:30.337795 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.337772 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsz62\" (UniqueName: \"kubernetes.io/projected/8072a8eb-d828-4813-9052-b9b37b28d940-kube-api-access-rsz62\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.338235 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.338214 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-bound-sa-token\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.338399 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.338383 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrq9v\" (UniqueName: \"kubernetes.io/projected/22b3bbb9-18cb-4e41-b045-62d3f490e549-kube-api-access-qrq9v\") pod \"ingress-canary-mnc95\" (UID: \"22b3bbb9-18cb-4e41-b045-62d3f490e549\") " pod="openshift-ingress-canary/ingress-canary-mnc95" Jul 16 21:50:30.447204 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.447167 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" Jul 16 21:50:30.465189 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.465154 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:30.481178 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.481145 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:50:30.495409 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.495370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mnc95" Jul 16 21:50:30.830492 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.830453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:30.830768 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:30.830517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:30.830768 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.830631 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:30.830768 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.830648 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:30.830768 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.830665 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747cdc9cd4-57tz2: secret "image-registry-tls" not found Jul 16 21:50:30.830768 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.830713 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls podName:8072a8eb-d828-4813-9052-b9b37b28d940 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:31.830688333 +0000 UTC m=+37.133391980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls") pod "dns-default-zxmnm" (UID: "8072a8eb-d828-4813-9052-b9b37b28d940") : secret "dns-default-metrics-tls" not found Jul 16 21:50:30.830768 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:30.830735 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls podName:74e31b83-51ea-448b-9a7d-a3d2c72bfc7c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:31.830725533 +0000 UTC m=+37.133429147 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls") pod "image-registry-747cdc9cd4-57tz2" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c") : secret "image-registry-tls" not found Jul 16 21:50:31.123805 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.123769 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:50:31.124235 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.123769 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:50:31.129517 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.129488 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 21:50:31.129676 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.129555 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 21:50:31.130318 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.130264 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qgzlt\"" Jul 16 21:50:31.130605 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.130584 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 21:50:31.636744 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.636715 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf"] Jul 16 21:50:31.639813 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.639784 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mnc95"] Jul 16 21:50:31.640624 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.640602 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz"] Jul 16 21:50:31.648991 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.648969 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd"] Jul 16 21:50:31.652816 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:50:31.652787 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b056f52_52a2_4192_918f_a51700d7c0a8.slice/crio-758e65910e7d6cd85639555ab0e432388937152d9efc479c01c80d367fedd26d WatchSource:0}: Error finding container 758e65910e7d6cd85639555ab0e432388937152d9efc479c01c80d367fedd26d: Status 404 returned error can't find the container with id 758e65910e7d6cd85639555ab0e432388937152d9efc479c01c80d367fedd26d Jul 16 21:50:31.653719 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:50:31.653693 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b3bbb9_18cb_4e41_b045_62d3f490e549.slice/crio-91fff0fcb2b95d35413c5a39f737d61e934f82f2d26433889698fc27beb32c66 WatchSource:0}: Error finding container 91fff0fcb2b95d35413c5a39f737d61e934f82f2d26433889698fc27beb32c66: Status 404 returned error can't find the container with id 91fff0fcb2b95d35413c5a39f737d61e934f82f2d26433889698fc27beb32c66 Jul 16 21:50:31.654454 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:50:31.654420 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ec4d269_ae8a_49ea_9cf4_2029ea1efc87.slice/crio-d296148dd3350d450b35a56d492ad65373ab20dcf81328eca4b8e3864c070d48 WatchSource:0}: Error finding container d296148dd3350d450b35a56d492ad65373ab20dcf81328eca4b8e3864c070d48: Status 404 returned error can't find the container with id d296148dd3350d450b35a56d492ad65373ab20dcf81328eca4b8e3864c070d48 Jul 16 21:50:31.655373 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:50:31.655329 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9c29eb_85e5_41d3_a977_eeb1a86ef084.slice/crio-589bef9ff9e8d86fff13fbb307a4b555e7b096c0af4f455339dabd5133079d9c WatchSource:0}: Error finding container 589bef9ff9e8d86fff13fbb307a4b555e7b096c0af4f455339dabd5133079d9c: Status 404 returned error can't find the container with id 589bef9ff9e8d86fff13fbb307a4b555e7b096c0af4f455339dabd5133079d9c Jul 16 21:50:31.840599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.837875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:31.840599 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:31.837973 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:31.840599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:31.838193 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:31.840599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:31.838209 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747cdc9cd4-57tz2: secret "image-registry-tls" not found Jul 16 21:50:31.840599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:31.838302 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls podName:74e31b83-51ea-448b-9a7d-a3d2c72bfc7c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:33.838256679 +0000 UTC m=+39.140960308 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls") pod "image-registry-747cdc9cd4-57tz2" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c") : secret "image-registry-tls" not found Jul 16 21:50:31.840599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:31.838819 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:31.840599 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:31.838876 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls podName:8072a8eb-d828-4813-9052-b9b37b28d940 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:33.838853765 +0000 UTC m=+39.141557396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls") pod "dns-default-zxmnm" (UID: "8072a8eb-d828-4813-9052-b9b37b28d940") : secret "dns-default-metrics-tls" not found Jul 16 21:50:32.393907 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:32.393653 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" event={"ID":"de9c29eb-85e5-41d3-a977-eeb1a86ef084","Type":"ContainerStarted","Data":"589bef9ff9e8d86fff13fbb307a4b555e7b096c0af4f455339dabd5133079d9c"} Jul 16 21:50:32.397940 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:32.397904 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" event={"ID":"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87","Type":"ContainerStarted","Data":"d296148dd3350d450b35a56d492ad65373ab20dcf81328eca4b8e3864c070d48"} Jul 16 21:50:32.400336 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:32.400301 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" event={"ID":"4b056f52-52a2-4192-918f-a51700d7c0a8","Type":"ContainerStarted","Data":"758e65910e7d6cd85639555ab0e432388937152d9efc479c01c80d367fedd26d"} Jul 16 21:50:32.405214 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:32.405179 2563 generic.go:356] "Generic (PLEG): container finished" podID="2055e987-d811-4511-a7e8-75efd27281b2" containerID="b50ae6842038b16f3c4a9e5cba63e5e74ce3ed88bb22dfcc03a893bdce698765" exitCode=0 Jul 16 21:50:32.406283 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:32.406201 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerDied","Data":"b50ae6842038b16f3c4a9e5cba63e5e74ce3ed88bb22dfcc03a893bdce698765"} Jul 16 21:50:32.407922 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:32.407894 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mnc95" event={"ID":"22b3bbb9-18cb-4e41-b045-62d3f490e549","Type":"ContainerStarted","Data":"91fff0fcb2b95d35413c5a39f737d61e934f82f2d26433889698fc27beb32c66"} Jul 16 21:50:33.416148 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:33.416078 2563 generic.go:356] "Generic (PLEG): container finished" podID="2055e987-d811-4511-a7e8-75efd27281b2" containerID="71c6b5a92ca632712b980147411d191e755e868390b7f720b10c048a11455162" exitCode=0 Jul 16 21:50:33.416688 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:33.416162 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerDied","Data":"71c6b5a92ca632712b980147411d191e755e868390b7f720b10c048a11455162"} Jul 16 21:50:33.867583 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:33.867543 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:33.867759 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:33.867623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:33.867819 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:33.867783 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:33.867819 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:33.867798 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747cdc9cd4-57tz2: secret "image-registry-tls" not found Jul 16 21:50:33.867916 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:33.867860 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls podName:74e31b83-51ea-448b-9a7d-a3d2c72bfc7c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:37.867841359 +0000 UTC m=+43.170544983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls") pod "image-registry-747cdc9cd4-57tz2" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c") : secret "image-registry-tls" not found Jul 16 21:50:33.868413 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:33.868387 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:33.868510 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:33.868452 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls podName:8072a8eb-d828-4813-9052-b9b37b28d940 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:37.868435761 +0000 UTC m=+43.171139372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls") pod "dns-default-zxmnm" (UID: "8072a8eb-d828-4813-9052-b9b37b28d940") : secret "dns-default-metrics-tls" not found Jul 16 21:50:34.427710 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:34.426778 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mwqts" event={"ID":"2055e987-d811-4511-a7e8-75efd27281b2","Type":"ContainerStarted","Data":"8703112f4ed8d8c099d35a43add968bf110247bc9af8dad25434b9964ec1278c"} Jul 16 21:50:34.466643 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:34.466176 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mwqts" podStartSLOduration=9.375642586 podStartE2EDuration="39.466154015s" totalImagesPullingTime="30.090511429s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:34.463700102 +0000 UTC m=+39.766403758" watchObservedRunningTime="2026-07-16 21:50:34.466154015 +0000 UTC m=+39.768857647" Jul 16 21:50:37.901882 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:37.901838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:37.902383 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:37.901929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:37.902383 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:37.902019 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:37.902383 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:37.902097 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls podName:8072a8eb-d828-4813-9052-b9b37b28d940 nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.902080225 +0000 UTC m=+51.204783858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls") pod "dns-default-zxmnm" (UID: "8072a8eb-d828-4813-9052-b9b37b28d940") : secret "dns-default-metrics-tls" not found Jul 16 21:50:37.902383 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:37.902096 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:37.902383 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:37.902120 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747cdc9cd4-57tz2: secret "image-registry-tls" not found Jul 16 21:50:37.902383 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:37.902155 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls podName:74e31b83-51ea-448b-9a7d-a3d2c72bfc7c nodeName:}" failed. No retries permitted until 2026-07-16 21:50:45.90214409 +0000 UTC m=+51.204847712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls") pod "image-registry-747cdc9cd4-57tz2" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c") : secret "image-registry-tls" not found Jul 16 21:50:40.444068 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.444027 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" event={"ID":"de9c29eb-85e5-41d3-a977-eeb1a86ef084","Type":"ContainerStarted","Data":"8a42bc73b1b50f077e24b00fe06f38d6e3de949b17725303278d094ad0f0c917"} Jul 16 21:50:40.444569 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.444230 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:40.446179 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.446153 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" Jul 16 21:50:40.446465 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.446376 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" event={"ID":"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87","Type":"ContainerStarted","Data":"39198e58f08eea91153ebda6ba393aa5928668dc147647fa2e585959c39ed32e"} Jul 16 21:50:40.446465 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.446411 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" event={"ID":"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87","Type":"ContainerStarted","Data":"1716dfa4c84e1efda929a3861aebbc4e7f85e3debc7a3cd48b28a75f8a8f5fac"} Jul 16 21:50:40.446465 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.446428 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" event={"ID":"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87","Type":"ContainerStarted","Data":"3c2f1414d3fefc2061af3dec9faf6caea870605a230b5c263215e8da56bab140"} Jul 16 21:50:40.447804 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.447784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" event={"ID":"4b056f52-52a2-4192-918f-a51700d7c0a8","Type":"ContainerStarted","Data":"ae2c12feff024614fa8d6525ef5ecfacaf7c07575b2e245456545c400aa4eb8f"} Jul 16 21:50:40.449059 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.449038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mnc95" event={"ID":"22b3bbb9-18cb-4e41-b045-62d3f490e549","Type":"ContainerStarted","Data":"00addd2332d277791355452c27bbb1316d0fc792499ec37b4746c8788cbe9061"} Jul 16 21:50:40.491472 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.491419 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-864dfdfb6d-8fbzz" podStartSLOduration=32.69621197 podStartE2EDuration="40.49140391s" totalImagesPullingTime="7.79519194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:40.488815399 +0000 UTC m=+45.791519026" watchObservedRunningTime="2026-07-16 21:50:40.49140391 +0000 UTC m=+45.794107539" Jul 16 21:50:40.510421 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.510366 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-c8ffd7dfd-sdtqf" podStartSLOduration=32.726561013 podStartE2EDuration="40.510351942s" totalImagesPullingTime="7.783790929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:40.509703144 +0000 UTC m=+45.812406775" watchObservedRunningTime="2026-07-16 21:50:40.510351942 +0000 UTC m=+45.813055572" Jul 16 21:50:40.598231 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.598168 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mnc95" podStartSLOduration=2.816068393 podStartE2EDuration="10.598148816s" totalImagesPullingTime="7.782080423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:40.59799378 +0000 UTC m=+45.900697469" watchObservedRunningTime="2026-07-16 21:50:40.598148816 +0000 UTC m=+45.900852449" Jul 16 21:50:40.598959 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:40.598920 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" podStartSLOduration=32.816486272 podStartE2EDuration="40.598909827s" totalImagesPullingTime="7.782423555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:50:40.570815161 +0000 UTC m=+45.873518790" watchObservedRunningTime="2026-07-16 21:50:40.598909827 +0000 UTC m=+45.901613449" Jul 16 21:50:45.968839 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:45.968792 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:50:45.969224 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:45.968853 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:50:45.969224 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:45.968942 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:50:45.969224 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:45.968943 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:50:45.969224 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:45.969018 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls podName:8072a8eb-d828-4813-9052-b9b37b28d940 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:01.969002146 +0000 UTC m=+67.271705755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls") pod "dns-default-zxmnm" (UID: "8072a8eb-d828-4813-9052-b9b37b28d940") : secret "dns-default-metrics-tls" not found Jul 16 21:50:45.969224 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:45.968955 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747cdc9cd4-57tz2: secret "image-registry-tls" not found Jul 16 21:50:45.969224 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:50:45.969076 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls podName:74e31b83-51ea-448b-9a7d-a3d2c72bfc7c nodeName:}" failed. No retries permitted until 2026-07-16 21:51:01.969065391 +0000 UTC m=+67.271769000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls") pod "image-registry-747cdc9cd4-57tz2" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c") : secret "image-registry-tls" not found Jul 16 21:50:56.384355 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:50:56.384322 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtgfw" Jul 16 21:51:00.995569 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:00.995525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:51:00.996003 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:00.995695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:51:00.998608 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:00.998582 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 21:51:00.998744 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:00.998616 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 21:51:01.006239 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:01.006201 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 21:51:01.006386 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:01.006315 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs podName:09a03623-03c8-413a-819e-b5638989d278 nodeName:}" failed. No retries permitted until 2026-07-16 21:52:05.00629098 +0000 UTC m=+130.308994607 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs") pod "network-metrics-daemon-9dnfx" (UID: "09a03623-03c8-413a-819e-b5638989d278") : secret "metrics-daemon-secret" not found Jul 16 21:51:01.009659 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.009636 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5f944a82-6944-48d8-92ef-fd83397b4dca-original-pull-secret\") pod \"global-pull-secret-syncer-4dhl9\" (UID: \"5f944a82-6944-48d8-92ef-fd83397b4dca\") " pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:51:01.096235 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.096192 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:51:01.099581 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.099562 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 21:51:01.109848 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.109823 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 21:51:01.119591 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.119568 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhmpl\" (UniqueName: \"kubernetes.io/projected/e25ef18d-2760-4765-bf2d-a44eff90c864-kube-api-access-lhmpl\") pod \"network-check-target-bz4qm\" (UID: \"e25ef18d-2760-4765-bf2d-a44eff90c864\") " pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:51:01.135682 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.135652 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4dhl9" Jul 16 21:51:01.147426 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.147397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qgzlt\"" Jul 16 21:51:01.152451 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.152426 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:51:01.269112 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.269034 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4dhl9"] Jul 16 21:51:01.287308 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.287263 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bz4qm"] Jul 16 21:51:01.290629 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:51:01.290597 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25ef18d_2760_4765_bf2d_a44eff90c864.slice/crio-2dcc6220a8e513348a594dba2a3d3acf2017037d13dc825424c8098872f44437 WatchSource:0}: Error finding container 2dcc6220a8e513348a594dba2a3d3acf2017037d13dc825424c8098872f44437: Status 404 returned error can't find the container with id 2dcc6220a8e513348a594dba2a3d3acf2017037d13dc825424c8098872f44437 Jul 16 21:51:01.327715 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.327684 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cmvdd"] Jul 16 21:51:01.330383 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.330365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.336851 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.336547 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 21:51:01.336940 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.336890 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 21:51:01.337002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.336956 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 21:51:01.337054 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.336992 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 21:51:01.337054 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.336963 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jgk6d\"" Jul 16 21:51:01.353477 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.353444 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmvdd"] Jul 16 21:51:01.500290 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.500230 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.500290 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.500290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.500506 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.500345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/032680fc-eea8-4189-94e3-3afbdbcb3381-crio-socket\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.500506 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.500364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/032680fc-eea8-4189-94e3-3afbdbcb3381-data-volume\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.500506 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.500468 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7wl\" (UniqueName: \"kubernetes.io/projected/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-api-access-bq7wl\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.512457 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.512410 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bz4qm" event={"ID":"e25ef18d-2760-4765-bf2d-a44eff90c864","Type":"ContainerStarted","Data":"2dcc6220a8e513348a594dba2a3d3acf2017037d13dc825424c8098872f44437"} Jul 16 21:51:01.513542 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.513513 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4dhl9" event={"ID":"5f944a82-6944-48d8-92ef-fd83397b4dca","Type":"ContainerStarted","Data":"4703561fccecdf7cdf7a5d3af1098191ada59b6e8b8a16c81c66a77add6ae640"} Jul 16 21:51:01.601217 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.601121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/032680fc-eea8-4189-94e3-3afbdbcb3381-crio-socket\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.601217 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.601167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/032680fc-eea8-4189-94e3-3afbdbcb3381-data-volume\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.601460 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.601256 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/032680fc-eea8-4189-94e3-3afbdbcb3381-crio-socket\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.601460 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.601343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7wl\" (UniqueName: \"kubernetes.io/projected/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-api-access-bq7wl\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.601460 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.601407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.601460 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.601427 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.601650 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:01.601507 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:51:01.601650 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:01.601512 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:51:01.601650 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.601541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/032680fc-eea8-4189-94e3-3afbdbcb3381-data-volume\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:01.601650 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:01.601572 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:02.10155606 +0000 UTC m=+67.404259669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : configmap "kube-rbac-proxy" not found Jul 16 21:51:01.601650 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:01.601587 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:02.101580708 +0000 UTC m=+67.404284317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : secret "insights-runtime-extractor-tls" not found Jul 16 21:51:01.615215 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:01.615182 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7wl\" (UniqueName: \"kubernetes.io/projected/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-api-access-bq7wl\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:02.005348 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:02.005035 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:51:02.005348 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:02.005119 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:51:02.005348 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.005172 2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 21:51:02.005348 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.005197 2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-747cdc9cd4-57tz2: secret "image-registry-tls" not found Jul 16 21:51:02.005348 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.005229 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 21:51:02.005348 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.005266 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls podName:74e31b83-51ea-448b-9a7d-a3d2c72bfc7c nodeName:}" failed. No retries permitted until 2026-07-16 21:51:34.005242487 +0000 UTC m=+99.307946110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls") pod "image-registry-747cdc9cd4-57tz2" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c") : secret "image-registry-tls" not found Jul 16 21:51:02.005348 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.005301 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls podName:8072a8eb-d828-4813-9052-b9b37b28d940 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:34.005291441 +0000 UTC m=+99.307995057 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls") pod "dns-default-zxmnm" (UID: "8072a8eb-d828-4813-9052-b9b37b28d940") : secret "dns-default-metrics-tls" not found Jul 16 21:51:02.106407 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:02.106367 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:02.106596 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:02.106420 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:02.106596 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.106514 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:51:02.106596 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.106547 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:51:02.106596 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.106588 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:03.106572902 +0000 UTC m=+68.409276511 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : configmap "kube-rbac-proxy" not found Jul 16 21:51:02.106768 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:02.106611 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:03.106593763 +0000 UTC m=+68.409297376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : secret "insights-runtime-extractor-tls" not found Jul 16 21:51:03.116709 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:03.116664 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:03.116709 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:03.116706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:03.117362 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:03.116852 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:51:03.117362 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:03.116921 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:05.116904651 +0000 UTC m=+70.419608272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : configmap "kube-rbac-proxy" not found Jul 16 21:51:03.117362 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:03.117022 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:51:03.117362 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:03.117090 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:05.11707279 +0000 UTC m=+70.419776416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : secret "insights-runtime-extractor-tls" not found Jul 16 21:51:03.126809 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:03.126781 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4bxxg_64f5abd7-58f7-4b0a-94db-9a3a992d0f66/dns-node-resolver/0.log" Jul 16 21:51:04.520072 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:04.520041 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-smdqg_3a9e8556-7305-4e0a-8e45-4f77a30f88c6/node-ca/0.log" Jul 16 21:51:05.134325 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:05.134290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:05.134520 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:05.134331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:05.134520 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:05.134450 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:51:05.134520 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:05.134461 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:51:05.134665 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:05.134526 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:09.134507992 +0000 UTC m=+74.437211601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : secret "insights-runtime-extractor-tls" not found Jul 16 21:51:05.134665 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:05.134542 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:09.134535951 +0000 UTC m=+74.437239560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : configmap "kube-rbac-proxy" not found Jul 16 21:51:05.150067 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:05.150033 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mnc95_22b3bbb9-18cb-4e41-b045-62d3f490e549/serve-healthcheck-canary/0.log" Jul 16 21:51:06.532468 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:06.532420 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bz4qm" event={"ID":"e25ef18d-2760-4765-bf2d-a44eff90c864","Type":"ContainerStarted","Data":"f9296d0f49f5fcc3a19916995bc8eb3ac63da53e0536402f457e804227b1cdd0"} Jul 16 21:51:06.532916 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:06.532560 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:51:06.533843 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:06.533819 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4dhl9" event={"ID":"5f944a82-6944-48d8-92ef-fd83397b4dca","Type":"ContainerStarted","Data":"82904e98efc19a69f0d37d986be83ca1a3a2ca104a3535238cc58fd54b6c49ac"} Jul 16 21:51:06.551321 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:06.551244 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bz4qm" podStartSLOduration=67.292782313 podStartE2EDuration="1m11.55123067s" totalImagesPullingTime="4.258448357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:06.550841176 +0000 UTC m=+71.853544810" watchObservedRunningTime="2026-07-16 21:51:06.55123067 +0000 UTC m=+71.853934298" Jul 16 21:51:06.573831 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:06.573776 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4dhl9" podStartSLOduration=66.29175952 podStartE2EDuration="1m10.573759234s" totalImagesPullingTime="4.281999714s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:49:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:06.572922665 +0000 UTC m=+71.875626323" watchObservedRunningTime="2026-07-16 21:51:06.573759234 +0000 UTC m=+71.876462863" Jul 16 21:51:09.169861 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:09.169823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:09.169861 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:09.169870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:09.170377 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:09.169963 2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 21:51:09.170377 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:09.169986 2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 21:51:09.170377 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:09.170036 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:17.170014258 +0000 UTC m=+82.472717872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : configmap "kube-rbac-proxy" not found Jul 16 21:51:09.170377 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:51:09.170054 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls podName:032680fc-eea8-4189-94e3-3afbdbcb3381 nodeName:}" failed. No retries permitted until 2026-07-16 21:51:17.170045771 +0000 UTC m=+82.472749387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cmvdd" (UID: "032680fc-eea8-4189-94e3-3afbdbcb3381") : secret "insights-runtime-extractor-tls" not found Jul 16 21:51:17.225790 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:17.225745 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:17.225790 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:17.225787 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:17.226491 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:17.226464 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/032680fc-eea8-4189-94e3-3afbdbcb3381-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:17.228082 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:17.228054 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/032680fc-eea8-4189-94e3-3afbdbcb3381-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cmvdd\" (UID: \"032680fc-eea8-4189-94e3-3afbdbcb3381\") " pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:17.238976 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:17.238949 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cmvdd" Jul 16 21:51:17.402623 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:17.402590 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cmvdd"] Jul 16 21:51:17.424770 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:51:17.424733 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod032680fc_eea8_4189_94e3_3afbdbcb3381.slice/crio-e52df3b28023da1373d750bda02fff1b5850b4770196406dcc4646729b837243 WatchSource:0}: Error finding container e52df3b28023da1373d750bda02fff1b5850b4770196406dcc4646729b837243: Status 404 returned error can't find the container with id e52df3b28023da1373d750bda02fff1b5850b4770196406dcc4646729b837243 Jul 16 21:51:17.565676 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:17.565585 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmvdd" event={"ID":"032680fc-eea8-4189-94e3-3afbdbcb3381","Type":"ContainerStarted","Data":"e52df3b28023da1373d750bda02fff1b5850b4770196406dcc4646729b837243"} Jul 16 21:51:22.584725 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:22.584677 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmvdd" event={"ID":"032680fc-eea8-4189-94e3-3afbdbcb3381","Type":"ContainerStarted","Data":"e67b11401bf9757f600a7db24e24f7db4dcb7388967fd3467f2130861d63c701"} Jul 16 21:51:25.596607 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:25.596572 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmvdd" event={"ID":"032680fc-eea8-4189-94e3-3afbdbcb3381","Type":"ContainerStarted","Data":"89bcd7e21130675988bbb683342cc0a2255d0fb303ad6b803cd9f9b8dc0783b6"} Jul 16 21:51:29.612146 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:29.612109 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cmvdd" event={"ID":"032680fc-eea8-4189-94e3-3afbdbcb3381","Type":"ContainerStarted","Data":"acc72344077affab4bb920c422e5c181344f6eacab000e0bbe2362f49fbc3ddd"} Jul 16 21:51:29.634457 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:29.634401 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cmvdd" podStartSLOduration=17.278976446 podStartE2EDuration="28.634385977s" totalImagesPullingTime="11.355409531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:51:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:29.633069109 +0000 UTC m=+94.935772740" watchObservedRunningTime="2026-07-16 21:51:29.634385977 +0000 UTC m=+94.937089606" Jul 16 21:51:34.070373 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.070335 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:51:34.070835 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.070391 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:51:34.072701 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.072671 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8072a8eb-d828-4813-9052-b9b37b28d940-metrics-tls\") pod \"dns-default-zxmnm\" (UID: \"8072a8eb-d828-4813-9052-b9b37b28d940\") " pod="openshift-dns/dns-default-zxmnm" Jul 16 21:51:34.072701 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.072691 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"image-registry-747cdc9cd4-57tz2\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:51:34.090555 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.090528 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hqltp\"" Jul 16 21:51:34.098579 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.098556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:51:34.104111 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.104092 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2kl8b\"" Jul 16 21:51:34.111519 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.111492 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zxmnm" Jul 16 21:51:34.236385 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.236347 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-747cdc9cd4-57tz2"] Jul 16 21:51:34.238368 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:51:34.238339 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e31b83_51ea_448b_9a7d_a3d2c72bfc7c.slice/crio-6aa27912130e235462c61a937fe1bae878d13a2bf3f8c601eab1d0151091b796 WatchSource:0}: Error finding container 6aa27912130e235462c61a937fe1bae878d13a2bf3f8c601eab1d0151091b796: Status 404 returned error can't find the container with id 6aa27912130e235462c61a937fe1bae878d13a2bf3f8c601eab1d0151091b796 Jul 16 21:51:34.252408 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.252384 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zxmnm"] Jul 16 21:51:34.255246 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:51:34.255219 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8072a8eb_d828_4813_9052_b9b37b28d940.slice/crio-0ae11e44e4b1f2722fbf59484f3cf12c48a22c7037eebf0ddbed3d576c3e01fa WatchSource:0}: Error finding container 0ae11e44e4b1f2722fbf59484f3cf12c48a22c7037eebf0ddbed3d576c3e01fa: Status 404 returned error can't find the container with id 0ae11e44e4b1f2722fbf59484f3cf12c48a22c7037eebf0ddbed3d576c3e01fa Jul 16 21:51:34.628066 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.628030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxmnm" event={"ID":"8072a8eb-d828-4813-9052-b9b37b28d940","Type":"ContainerStarted","Data":"0ae11e44e4b1f2722fbf59484f3cf12c48a22c7037eebf0ddbed3d576c3e01fa"} Jul 16 21:51:34.629576 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.629545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" event={"ID":"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c","Type":"ContainerStarted","Data":"a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2"} Jul 16 21:51:34.629698 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.629593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" event={"ID":"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c","Type":"ContainerStarted","Data":"6aa27912130e235462c61a937fe1bae878d13a2bf3f8c601eab1d0151091b796"} Jul 16 21:51:34.629698 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.629659 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:51:34.666492 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.666392 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" podStartSLOduration=98.666375872 podStartE2EDuration="1m38.666375872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:34.665378475 +0000 UTC m=+99.968082105" watchObservedRunningTime="2026-07-16 21:51:34.666375872 +0000 UTC m=+99.969079503" Jul 16 21:51:34.751660 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.751624 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sgrpx"] Jul 16 21:51:34.755255 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.755228 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.770033 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.769997 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 21:51:34.770981 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.770961 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 21:51:34.771135 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.771117 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 21:51:34.774261 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.774241 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 21:51:34.774402 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.774294 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 21:51:34.774468 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.774438 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dzgcx\"" Jul 16 21:51:34.774683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.774660 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 21:51:34.876561 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-sys\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.876757 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.876757 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876646 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-textfile\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.876757 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-root\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.876916 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876760 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-wtmp\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.876916 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.876916 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876852 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-tls\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.876916 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbr6z\" (UniqueName: \"kubernetes.io/projected/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-kube-api-access-fbr6z\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.877108 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.876948 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-metrics-client-ca\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978290 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-sys\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978290 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978541 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978332 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-sys\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978541 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978388 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-textfile\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978541 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-root\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978541 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-wtmp\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978541 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978541 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978512 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-tls\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978808 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978554 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-root\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978808 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978571 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbr6z\" (UniqueName: \"kubernetes.io/projected/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-kube-api-access-fbr6z\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978808 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978638 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-metrics-client-ca\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978808 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978646 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-wtmp\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.978975 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.978825 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-textfile\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.979363 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.979333 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-accelerators-collector-config\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.979473 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.979367 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-metrics-client-ca\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.980833 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.980812 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.981036 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.981016 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-node-exporter-tls\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:34.992653 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:34.992623 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbr6z\" (UniqueName: \"kubernetes.io/projected/219597ee-9703-4cc8-9d5d-97cb5af8bbe4-kube-api-access-fbr6z\") pod \"node-exporter-sgrpx\" (UID: \"219597ee-9703-4cc8-9d5d-97cb5af8bbe4\") " pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:35.065886 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:35.065853 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sgrpx" Jul 16 21:51:35.635677 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:35.635631 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgrpx" event={"ID":"219597ee-9703-4cc8-9d5d-97cb5af8bbe4","Type":"ContainerStarted","Data":"ba76b872a0837723f9c10d05d28e27f5766eb4e91225b8088c018c9bd637c5b0"} Jul 16 21:51:36.640759 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:36.640719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxmnm" event={"ID":"8072a8eb-d828-4813-9052-b9b37b28d940","Type":"ContainerStarted","Data":"17d9df1012a68d6c637da203829ee55060a38ac5926c24c8cc0932941a3d9fdd"} Jul 16 21:51:37.539284 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:37.539234 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bz4qm" Jul 16 21:51:37.645797 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:37.645762 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zxmnm" event={"ID":"8072a8eb-d828-4813-9052-b9b37b28d940","Type":"ContainerStarted","Data":"bdd1281a58a228a5d04bbdf8a3af38e14ecd9992b6367cf7155e46828bd4412d"} Jul 16 21:51:37.646222 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:37.645893 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zxmnm" Jul 16 21:51:37.647436 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:37.647410 2563 generic.go:356] "Generic (PLEG): container finished" podID="219597ee-9703-4cc8-9d5d-97cb5af8bbe4" containerID="8a670ad1511edd747cb7a3f4ac1d2db5ef04b2bca75bee591c1b93ae72ef6fb1" exitCode=0 Jul 16 21:51:37.647575 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:37.647444 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgrpx" event={"ID":"219597ee-9703-4cc8-9d5d-97cb5af8bbe4","Type":"ContainerDied","Data":"8a670ad1511edd747cb7a3f4ac1d2db5ef04b2bca75bee591c1b93ae72ef6fb1"} Jul 16 21:51:37.681788 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:37.681699 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zxmnm" podStartSLOduration=65.798306864 podStartE2EDuration="1m7.681683321s" totalImagesPullingTime="1.883376457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:37.679944238 +0000 UTC m=+102.982647868" watchObservedRunningTime="2026-07-16 21:51:37.681683321 +0000 UTC m=+102.984386951" Jul 16 21:51:38.652749 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:38.652701 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgrpx" event={"ID":"219597ee-9703-4cc8-9d5d-97cb5af8bbe4","Type":"ContainerStarted","Data":"08b34f7531ba86be1c06fd298a45917af59e712e74415af1d3e813ba0374ccff"} Jul 16 21:51:38.653132 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:38.652774 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sgrpx" event={"ID":"219597ee-9703-4cc8-9d5d-97cb5af8bbe4","Type":"ContainerStarted","Data":"4aecebb00ef219dde77650b5bafaa476f7c9912b850d621a461fc1ddb66123a7"} Jul 16 21:51:38.676769 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:38.676711 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sgrpx" podStartSLOduration=2.73324643 podStartE2EDuration="4.676696961s" totalImagesPullingTime="1.84455486s" totalInitContainerRuntime="98.895671ms" isStatefulPod=true podCreationTimestamp="2026-07-16 21:51:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:51:38.675542149 +0000 UTC m=+103.978245798" watchObservedRunningTime="2026-07-16 21:51:38.676696961 +0000 UTC m=+103.979400591" Jul 16 21:51:47.466776 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:47.466739 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-747cdc9cd4-57tz2"] Jul 16 21:51:47.655260 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:47.655231 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zxmnm" Jul 16 21:51:57.472413 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:51:57.472381 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:52:05.014529 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:05.014474 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:52:05.016808 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:05.016776 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09a03623-03c8-413a-819e-b5638989d278-metrics-certs\") pod \"network-metrics-daemon-9dnfx\" (UID: \"09a03623-03c8-413a-819e-b5638989d278\") " pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:52:05.259074 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:05.259040 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wmhws\"" Jul 16 21:52:05.266461 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:05.266403 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9dnfx" Jul 16 21:52:05.445129 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:05.445096 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9dnfx"] Jul 16 21:52:05.448786 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:52:05.448751 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a03623_03c8_413a_819e_b5638989d278.slice/crio-b2bf8a7b40c4c3422239bb71bfa2d7b41aec5242ea79111b5a879577cb90a1cc WatchSource:0}: Error finding container b2bf8a7b40c4c3422239bb71bfa2d7b41aec5242ea79111b5a879577cb90a1cc: Status 404 returned error can't find the container with id b2bf8a7b40c4c3422239bb71bfa2d7b41aec5242ea79111b5a879577cb90a1cc Jul 16 21:52:05.741451 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:05.741413 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9dnfx" event={"ID":"09a03623-03c8-413a-819e-b5638989d278","Type":"ContainerStarted","Data":"b2bf8a7b40c4c3422239bb71bfa2d7b41aec5242ea79111b5a879577cb90a1cc"} Jul 16 21:52:06.746503 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:06.746413 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9dnfx" event={"ID":"09a03623-03c8-413a-819e-b5638989d278","Type":"ContainerStarted","Data":"8a6747c75ab39b500b50dcdc1e3981cda5ccb446c963fb79d5e1d03879fd7d9d"} Jul 16 21:52:06.746503 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:06.746478 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9dnfx" event={"ID":"09a03623-03c8-413a-819e-b5638989d278","Type":"ContainerStarted","Data":"1ac25e67e50f557962c071bf921d5c48ce3a951023f1e64cb6e76179a4ccdcae"} Jul 16 21:52:06.767186 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:06.767135 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9dnfx" podStartSLOduration=130.83549917 podStartE2EDuration="2m11.767118711s" totalImagesPullingTime="931.619541ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:52:06.76598115 +0000 UTC m=+132.068684784" watchObservedRunningTime="2026-07-16 21:52:06.767118711 +0000 UTC m=+132.069822340" Jul 16 21:52:10.482659 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:10.482612 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" podUID="0ec4d269-ae8a-49ea-9cf4-2029ea1efc87" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 21:52:12.486235 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.486190 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" podUID="74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" containerName="registry" containerID="cri-o://a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2" gracePeriod=30 Jul 16 21:52:12.730112 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.730086 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:52:12.771154 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.771076 2563 generic.go:356] "Generic (PLEG): container finished" podID="74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" containerID="a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2" exitCode=0 Jul 16 21:52:12.771154 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.771136 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" Jul 16 21:52:12.771353 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.771148 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" event={"ID":"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c","Type":"ContainerDied","Data":"a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2"} Jul 16 21:52:12.771353 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.771202 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-747cdc9cd4-57tz2" event={"ID":"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c","Type":"ContainerDied","Data":"6aa27912130e235462c61a937fe1bae878d13a2bf3f8c601eab1d0151091b796"} Jul 16 21:52:12.771353 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.771224 2563 scope.go:117] "RemoveContainer" containerID="a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2" Jul 16 21:52:12.775770 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.775745 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-bound-sa-token\") pod \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " Jul 16 21:52:12.775912 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.775778 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-installation-pull-secrets\") pod \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " Jul 16 21:52:12.775912 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.775803 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-certificates\") pod \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " Jul 16 21:52:12.775912 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.775876 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-image-registry-private-configuration\") pod \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " Jul 16 21:52:12.775912 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.775905 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") pod \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " Jul 16 21:52:12.776125 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.775929 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-trusted-ca\") pod \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " Jul 16 21:52:12.776125 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.775969 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-ca-trust-extracted\") pod \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " Jul 16 21:52:12.776125 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.775997 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4sfp4\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-kube-api-access-4sfp4\") pod \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\" (UID: \"74e31b83-51ea-448b-9a7d-a3d2c72bfc7c\") " Jul 16 21:52:12.776550 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.776510 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:52:12.776905 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.776866 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 21:52:12.778959 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.778909 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:52:12.779070 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.778922 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:52:12.779242 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.779215 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:52:12.779340 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.779299 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:52:12.779654 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.779627 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-kube-api-access-4sfp4" (OuterVolumeSpecName: "kube-api-access-4sfp4") pod "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c"). InnerVolumeSpecName "kube-api-access-4sfp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:52:12.783686 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.783654 2563 scope.go:117] "RemoveContainer" containerID="a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2" Jul 16 21:52:12.784117 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:52:12.784078 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2\": container with ID starting with a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2 not found: ID does not exist" containerID="a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2" Jul 16 21:52:12.784215 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.784129 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2"} err="failed to get container status \"a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2\": rpc error: code = NotFound desc = could not find container \"a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2\": container with ID starting with a200e53488a6c67d9c931dd9593b4ddee0613dbca6da8dde661d9b303f8ba9c2 not found: ID does not exist" Jul 16 21:52:12.785944 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.785914 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" (UID: "74e31b83-51ea-448b-9a7d-a3d2c72bfc7c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 21:52:12.878352 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.878298 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-image-registry-private-configuration\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:52:12.878352 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.878344 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-tls\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:52:12.878352 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.878356 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-trusted-ca\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:52:12.878352 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.878365 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-ca-trust-extracted\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:52:12.878622 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.878374 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4sfp4\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-kube-api-access-4sfp4\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:52:12.878622 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.878382 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-bound-sa-token\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:52:12.878622 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.878392 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-installation-pull-secrets\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:52:12.878622 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:12.878400 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c-registry-certificates\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:52:13.093823 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:13.093784 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-747cdc9cd4-57tz2"] Jul 16 21:52:13.098098 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:13.098068 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-747cdc9cd4-57tz2"] Jul 16 21:52:13.127683 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:13.127652 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" path="/var/lib/kubelet/pods/74e31b83-51ea-448b-9a7d-a3d2c72bfc7c/volumes" Jul 16 21:52:20.482329 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:20.482260 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" podUID="0ec4d269-ae8a-49ea-9cf4-2029ea1efc87" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 21:52:30.483139 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:30.483087 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" podUID="0ec4d269-ae8a-49ea-9cf4-2029ea1efc87" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 16 21:52:30.483604 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:30.483169 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" Jul 16 21:52:30.483649 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:30.483629 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"39198e58f08eea91153ebda6ba393aa5928668dc147647fa2e585959c39ed32e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 16 21:52:30.483684 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:30.483664 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" podUID="0ec4d269-ae8a-49ea-9cf4-2029ea1efc87" containerName="service-proxy" containerID="cri-o://39198e58f08eea91153ebda6ba393aa5928668dc147647fa2e585959c39ed32e" gracePeriod=30 Jul 16 21:52:30.834078 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:30.833989 2563 generic.go:356] "Generic (PLEG): container finished" podID="0ec4d269-ae8a-49ea-9cf4-2029ea1efc87" containerID="39198e58f08eea91153ebda6ba393aa5928668dc147647fa2e585959c39ed32e" exitCode=2 Jul 16 21:52:30.834078 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:30.834056 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" event={"ID":"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87","Type":"ContainerDied","Data":"39198e58f08eea91153ebda6ba393aa5928668dc147647fa2e585959c39ed32e"} Jul 16 21:52:30.834293 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:52:30.834101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bb645b85-pvmnd" event={"ID":"0ec4d269-ae8a-49ea-9cf4-2029ea1efc87","Type":"ContainerStarted","Data":"014973ee70c6f232e03392a15290c46eb0955eb92a878cb7530e69dc1f4795c4"} Jul 16 21:54:55.022555 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:54:55.022525 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 21:54:55.024100 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:54:55.024078 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 21:54:55.025568 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:54:55.025550 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 21:57:12.119806 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.119769 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-ww5pn"] Jul 16 21:57:12.120297 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.120008 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" containerName="registry" Jul 16 21:57:12.120297 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.120019 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" containerName="registry" Jul 16 21:57:12.120297 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.120076 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e31b83-51ea-448b-9a7d-a3d2c72bfc7c" containerName="registry" Jul 16 21:57:12.122837 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.122821 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:12.128787 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.128764 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 16 21:57:12.129877 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.129857 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 16 21:57:12.129991 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.129926 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 16 21:57:12.129991 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.129928 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-jgn7m\"" Jul 16 21:57:12.186358 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.186325 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-ww5pn"] Jul 16 21:57:12.221228 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.221196 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-psgxf"] Jul 16 21:57:12.224158 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.224140 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:12.225394 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.225367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637773de-3bb7-462e-95b1-c91bba0a1339-cert\") pod \"kserve-controller-manager-84cf6d888d-ww5pn\" (UID: \"637773de-3bb7-462e-95b1-c91bba0a1339\") " pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:12.225553 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.225404 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2gx\" (UniqueName: \"kubernetes.io/projected/637773de-3bb7-462e-95b1-c91bba0a1339-kube-api-access-vr2gx\") pod \"kserve-controller-manager-84cf6d888d-ww5pn\" (UID: \"637773de-3bb7-462e-95b1-c91bba0a1339\") " pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:12.229609 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.229586 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-8867j\"" Jul 16 21:57:12.229966 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.229938 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 16 21:57:12.264399 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.264340 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-psgxf"] Jul 16 21:57:12.326628 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.326587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q62n\" (UniqueName: \"kubernetes.io/projected/4784ec1a-0d8e-4fab-b7bb-d1be8bfef904-kube-api-access-7q62n\") pod \"seaweedfs-64568bcd49-psgxf\" (UID: \"4784ec1a-0d8e-4fab-b7bb-d1be8bfef904\") " pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:12.326805 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.326634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4784ec1a-0d8e-4fab-b7bb-d1be8bfef904-data\") pod \"seaweedfs-64568bcd49-psgxf\" (UID: \"4784ec1a-0d8e-4fab-b7bb-d1be8bfef904\") " pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:12.326805 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.326667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637773de-3bb7-462e-95b1-c91bba0a1339-cert\") pod \"kserve-controller-manager-84cf6d888d-ww5pn\" (UID: \"637773de-3bb7-462e-95b1-c91bba0a1339\") " pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:12.326805 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.326709 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2gx\" (UniqueName: \"kubernetes.io/projected/637773de-3bb7-462e-95b1-c91bba0a1339-kube-api-access-vr2gx\") pod \"kserve-controller-manager-84cf6d888d-ww5pn\" (UID: \"637773de-3bb7-462e-95b1-c91bba0a1339\") " pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:12.329178 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.329155 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637773de-3bb7-462e-95b1-c91bba0a1339-cert\") pod \"kserve-controller-manager-84cf6d888d-ww5pn\" (UID: \"637773de-3bb7-462e-95b1-c91bba0a1339\") " pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:12.346845 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.346816 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2gx\" (UniqueName: \"kubernetes.io/projected/637773de-3bb7-462e-95b1-c91bba0a1339-kube-api-access-vr2gx\") pod \"kserve-controller-manager-84cf6d888d-ww5pn\" (UID: \"637773de-3bb7-462e-95b1-c91bba0a1339\") " pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:12.427843 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.427742 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q62n\" (UniqueName: \"kubernetes.io/projected/4784ec1a-0d8e-4fab-b7bb-d1be8bfef904-kube-api-access-7q62n\") pod \"seaweedfs-64568bcd49-psgxf\" (UID: \"4784ec1a-0d8e-4fab-b7bb-d1be8bfef904\") " pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:12.427843 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.427783 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4784ec1a-0d8e-4fab-b7bb-d1be8bfef904-data\") pod \"seaweedfs-64568bcd49-psgxf\" (UID: \"4784ec1a-0d8e-4fab-b7bb-d1be8bfef904\") " pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:12.428113 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.428096 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4784ec1a-0d8e-4fab-b7bb-d1be8bfef904-data\") pod \"seaweedfs-64568bcd49-psgxf\" (UID: \"4784ec1a-0d8e-4fab-b7bb-d1be8bfef904\") " pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:12.432775 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.432754 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:12.441147 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.441122 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q62n\" (UniqueName: \"kubernetes.io/projected/4784ec1a-0d8e-4fab-b7bb-d1be8bfef904-kube-api-access-7q62n\") pod \"seaweedfs-64568bcd49-psgxf\" (UID: \"4784ec1a-0d8e-4fab-b7bb-d1be8bfef904\") " pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:12.533095 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.533065 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:12.562933 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.562891 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-ww5pn"] Jul 16 21:57:12.568030 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:57:12.567995 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637773de_3bb7_462e_95b1_c91bba0a1339.slice/crio-c22258b3e8dd533c4435766fa677f06c0df4721275804c2e0e436f6de155145a WatchSource:0}: Error finding container c22258b3e8dd533c4435766fa677f06c0df4721275804c2e0e436f6de155145a: Status 404 returned error can't find the container with id c22258b3e8dd533c4435766fa677f06c0df4721275804c2e0e436f6de155145a Jul 16 21:57:12.569531 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.569508 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 21:57:12.666680 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.666643 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-psgxf"] Jul 16 21:57:12.671137 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:57:12.671114 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4784ec1a_0d8e_4fab_b7bb_d1be8bfef904.slice/crio-4ebd13e43ae499261b805fb973862552c5a5b6bb683d894013600cab02e5b196 WatchSource:0}: Error finding container 4ebd13e43ae499261b805fb973862552c5a5b6bb683d894013600cab02e5b196: Status 404 returned error can't find the container with id 4ebd13e43ae499261b805fb973862552c5a5b6bb683d894013600cab02e5b196 Jul 16 21:57:12.739598 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.739503 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" event={"ID":"637773de-3bb7-462e-95b1-c91bba0a1339","Type":"ContainerStarted","Data":"c22258b3e8dd533c4435766fa677f06c0df4721275804c2e0e436f6de155145a"} Jul 16 21:57:12.740577 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:12.740549 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-psgxf" event={"ID":"4784ec1a-0d8e-4fab-b7bb-d1be8bfef904","Type":"ContainerStarted","Data":"4ebd13e43ae499261b805fb973862552c5a5b6bb683d894013600cab02e5b196"} Jul 16 21:57:16.760752 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:16.760714 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" event={"ID":"637773de-3bb7-462e-95b1-c91bba0a1339","Type":"ContainerStarted","Data":"1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710"} Jul 16 21:57:16.761203 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:16.760812 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:16.762041 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:16.762019 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-psgxf" event={"ID":"4784ec1a-0d8e-4fab-b7bb-d1be8bfef904","Type":"ContainerStarted","Data":"d0fe49f2961788e5f7f167d3a34f165f24b5730587ae75a9b5a709070510553e"} Jul 16 21:57:16.762160 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:16.762144 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:16.785052 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:16.784998 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" podStartSLOduration=1.09933347 podStartE2EDuration="4.784982375s" totalImagesPullingTime="3.685648905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:16.784537481 +0000 UTC m=+442.087241112" watchObservedRunningTime="2026-07-16 21:57:16.784982375 +0000 UTC m=+442.087686006" Jul 16 21:57:16.812783 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:16.812654 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-psgxf" podStartSLOduration=1.144701646 podStartE2EDuration="4.812635922s" totalImagesPullingTime="3.667934276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:16.811886509 +0000 UTC m=+442.114590140" watchObservedRunningTime="2026-07-16 21:57:16.812635922 +0000 UTC m=+442.115339585" Jul 16 21:57:22.767497 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:22.767420 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-psgxf" Jul 16 21:57:47.770929 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:47.770898 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:56.140288 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.140244 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-ww5pn"] Jul 16 21:57:56.140779 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.140508 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" podUID="637773de-3bb7-462e-95b1-c91bba0a1339" containerName="manager" containerID="cri-o://1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710" gracePeriod=10 Jul 16 21:57:56.168877 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.168845 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-5jrjb"] Jul 16 21:57:56.170666 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.170649 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:56.185369 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.185339 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-5jrjb"] Jul 16 21:57:56.328739 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.328707 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll64b\" (UniqueName: \"kubernetes.io/projected/2fbb5c6f-148d-4da0-8224-a4becf96b44c-kube-api-access-ll64b\") pod \"kserve-controller-manager-84cf6d888d-5jrjb\" (UID: \"2fbb5c6f-148d-4da0-8224-a4becf96b44c\") " pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:56.328905 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.328766 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fbb5c6f-148d-4da0-8224-a4becf96b44c-cert\") pod \"kserve-controller-manager-84cf6d888d-5jrjb\" (UID: \"2fbb5c6f-148d-4da0-8224-a4becf96b44c\") " pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:56.378582 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.378557 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:56.429705 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.429612 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll64b\" (UniqueName: \"kubernetes.io/projected/2fbb5c6f-148d-4da0-8224-a4becf96b44c-kube-api-access-ll64b\") pod \"kserve-controller-manager-84cf6d888d-5jrjb\" (UID: \"2fbb5c6f-148d-4da0-8224-a4becf96b44c\") " pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:56.429705 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.429667 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fbb5c6f-148d-4da0-8224-a4becf96b44c-cert\") pod \"kserve-controller-manager-84cf6d888d-5jrjb\" (UID: \"2fbb5c6f-148d-4da0-8224-a4becf96b44c\") " pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:56.431940 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.431910 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2fbb5c6f-148d-4da0-8224-a4becf96b44c-cert\") pod \"kserve-controller-manager-84cf6d888d-5jrjb\" (UID: \"2fbb5c6f-148d-4da0-8224-a4becf96b44c\") " pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:56.439342 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.439313 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll64b\" (UniqueName: \"kubernetes.io/projected/2fbb5c6f-148d-4da0-8224-a4becf96b44c-kube-api-access-ll64b\") pod \"kserve-controller-manager-84cf6d888d-5jrjb\" (UID: \"2fbb5c6f-148d-4da0-8224-a4becf96b44c\") " pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:56.527730 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.527685 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:56.530647 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.530622 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637773de-3bb7-462e-95b1-c91bba0a1339-cert\") pod \"637773de-3bb7-462e-95b1-c91bba0a1339\" (UID: \"637773de-3bb7-462e-95b1-c91bba0a1339\") " Jul 16 21:57:56.530770 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.530683 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr2gx\" (UniqueName: \"kubernetes.io/projected/637773de-3bb7-462e-95b1-c91bba0a1339-kube-api-access-vr2gx\") pod \"637773de-3bb7-462e-95b1-c91bba0a1339\" (UID: \"637773de-3bb7-462e-95b1-c91bba0a1339\") " Jul 16 21:57:56.532845 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.532822 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/637773de-3bb7-462e-95b1-c91bba0a1339-kube-api-access-vr2gx" (OuterVolumeSpecName: "kube-api-access-vr2gx") pod "637773de-3bb7-462e-95b1-c91bba0a1339" (UID: "637773de-3bb7-462e-95b1-c91bba0a1339"). InnerVolumeSpecName "kube-api-access-vr2gx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 21:57:56.532929 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.532848 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/637773de-3bb7-462e-95b1-c91bba0a1339-cert" (OuterVolumeSpecName: "cert") pod "637773de-3bb7-462e-95b1-c91bba0a1339" (UID: "637773de-3bb7-462e-95b1-c91bba0a1339"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 21:57:56.631825 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.631795 2563 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/637773de-3bb7-462e-95b1-c91bba0a1339-cert\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:57:56.631825 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.631823 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr2gx\" (UniqueName: \"kubernetes.io/projected/637773de-3bb7-462e-95b1-c91bba0a1339-kube-api-access-vr2gx\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 21:57:56.652167 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.652133 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-5jrjb"] Jul 16 21:57:56.655591 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:57:56.655565 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fbb5c6f_148d_4da0_8224_a4becf96b44c.slice/crio-f359ea36143669c4aaf55a28962030dc04642a10f5423787254905298503e381 WatchSource:0}: Error finding container f359ea36143669c4aaf55a28962030dc04642a10f5423787254905298503e381: Status 404 returned error can't find the container with id f359ea36143669c4aaf55a28962030dc04642a10f5423787254905298503e381 Jul 16 21:57:56.891685 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.891653 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" event={"ID":"2fbb5c6f-148d-4da0-8224-a4becf96b44c","Type":"ContainerStarted","Data":"f359ea36143669c4aaf55a28962030dc04642a10f5423787254905298503e381"} Jul 16 21:57:56.892875 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.892846 2563 generic.go:356] "Generic (PLEG): container finished" podID="637773de-3bb7-462e-95b1-c91bba0a1339" containerID="1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710" exitCode=0 Jul 16 21:57:56.893002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.892881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" event={"ID":"637773de-3bb7-462e-95b1-c91bba0a1339","Type":"ContainerDied","Data":"1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710"} Jul 16 21:57:56.893002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.892895 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" Jul 16 21:57:56.893002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.892912 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-ww5pn" event={"ID":"637773de-3bb7-462e-95b1-c91bba0a1339","Type":"ContainerDied","Data":"c22258b3e8dd533c4435766fa677f06c0df4721275804c2e0e436f6de155145a"} Jul 16 21:57:56.893002 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.892934 2563 scope.go:117] "RemoveContainer" containerID="1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710" Jul 16 21:57:56.905709 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.905691 2563 scope.go:117] "RemoveContainer" containerID="1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710" Jul 16 21:57:56.906025 ip-10-0-139-28 kubenswrapper[2563]: E0716 21:57:56.906004 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710\": container with ID starting with 1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710 not found: ID does not exist" containerID="1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710" Jul 16 21:57:56.906112 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.906033 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710"} err="failed to get container status \"1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710\": rpc error: code = NotFound desc = could not find container \"1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710\": container with ID starting with 1de5fea47f2d41c18996551bd0f4eb2c3585ffff36ede9a4e7cf6709d9a08710 not found: ID does not exist" Jul 16 21:57:56.918287 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.918257 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-ww5pn"] Jul 16 21:57:56.922145 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:56.922121 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-84cf6d888d-ww5pn"] Jul 16 21:57:57.128445 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:57.128413 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="637773de-3bb7-462e-95b1-c91bba0a1339" path="/var/lib/kubelet/pods/637773de-3bb7-462e-95b1-c91bba0a1339/volumes" Jul 16 21:57:57.897528 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:57.897495 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" event={"ID":"2fbb5c6f-148d-4da0-8224-a4becf96b44c","Type":"ContainerStarted","Data":"cd9edf9920ccbeba0431a03e47c689474ecb49e02feee15d06061e528694e71c"} Jul 16 21:57:57.897988 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:57.897562 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:57:57.916990 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:57:57.916939 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" podStartSLOduration=1.560250788 podStartE2EDuration="1.916923635s" totalImagesPullingTime="356.672847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:57:57.916105815 +0000 UTC m=+483.218809448" watchObservedRunningTime="2026-07-16 21:57:57.916923635 +0000 UTC m=+483.219627273" Jul 16 21:58:28.906420 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:28.906386 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-84cf6d888d-5jrjb" Jul 16 21:58:29.994218 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:29.994181 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-dtp64"] Jul 16 21:58:29.994708 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:29.994533 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="637773de-3bb7-462e-95b1-c91bba0a1339" containerName="manager" Jul 16 21:58:29.994708 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:29.994552 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="637773de-3bb7-462e-95b1-c91bba0a1339" containerName="manager" Jul 16 21:58:29.994708 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:29.994632 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="637773de-3bb7-462e-95b1-c91bba0a1339" containerName="manager" Jul 16 21:58:29.997541 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:29.997518 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:30.001471 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.001441 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 16 21:58:30.001622 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.001559 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-2vd8h\"" Jul 16 21:58:30.021841 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.021810 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-dtp64"] Jul 16 21:58:30.051993 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.051959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c1ea9c2-80a5-4f9a-8109-e77e08ca3548-tls-certs\") pod \"model-serving-api-fd65d7d6-dtp64\" (UID: \"8c1ea9c2-80a5-4f9a-8109-e77e08ca3548\") " pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:30.052161 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.052026 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4sc5\" (UniqueName: \"kubernetes.io/projected/8c1ea9c2-80a5-4f9a-8109-e77e08ca3548-kube-api-access-q4sc5\") pod \"model-serving-api-fd65d7d6-dtp64\" (UID: \"8c1ea9c2-80a5-4f9a-8109-e77e08ca3548\") " pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:30.153038 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.153001 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4sc5\" (UniqueName: \"kubernetes.io/projected/8c1ea9c2-80a5-4f9a-8109-e77e08ca3548-kube-api-access-q4sc5\") pod \"model-serving-api-fd65d7d6-dtp64\" (UID: \"8c1ea9c2-80a5-4f9a-8109-e77e08ca3548\") " pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:30.153218 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.153049 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c1ea9c2-80a5-4f9a-8109-e77e08ca3548-tls-certs\") pod \"model-serving-api-fd65d7d6-dtp64\" (UID: \"8c1ea9c2-80a5-4f9a-8109-e77e08ca3548\") " pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:30.155504 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.155484 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c1ea9c2-80a5-4f9a-8109-e77e08ca3548-tls-certs\") pod \"model-serving-api-fd65d7d6-dtp64\" (UID: \"8c1ea9c2-80a5-4f9a-8109-e77e08ca3548\") " pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:30.163123 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.163099 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4sc5\" (UniqueName: \"kubernetes.io/projected/8c1ea9c2-80a5-4f9a-8109-e77e08ca3548-kube-api-access-q4sc5\") pod \"model-serving-api-fd65d7d6-dtp64\" (UID: \"8c1ea9c2-80a5-4f9a-8109-e77e08ca3548\") " pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:30.308161 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.308077 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:30.443659 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:30.443628 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-dtp64"] Jul 16 21:58:30.446618 ip-10-0-139-28 kubenswrapper[2563]: W0716 21:58:30.446586 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1ea9c2_80a5_4f9a_8109_e77e08ca3548.slice/crio-70d63f60061b117b2e4052382d400b97d66e200eee162c3cee951dde74d6f10c WatchSource:0}: Error finding container 70d63f60061b117b2e4052382d400b97d66e200eee162c3cee951dde74d6f10c: Status 404 returned error can't find the container with id 70d63f60061b117b2e4052382d400b97d66e200eee162c3cee951dde74d6f10c Jul 16 21:58:31.006771 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:31.006728 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-dtp64" event={"ID":"8c1ea9c2-80a5-4f9a-8109-e77e08ca3548","Type":"ContainerStarted","Data":"70d63f60061b117b2e4052382d400b97d66e200eee162c3cee951dde74d6f10c"} Jul 16 21:58:33.014485 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:33.014445 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-dtp64" event={"ID":"8c1ea9c2-80a5-4f9a-8109-e77e08ca3548","Type":"ContainerStarted","Data":"fdd367f48510d0364ee0f00ece16fc8d4d0ed55f5588b1d3ad396cc99dc2689c"} Jul 16 21:58:33.014901 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:33.014548 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:58:33.033772 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:33.033731 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-dtp64" podStartSLOduration=2.4806528549999998 podStartE2EDuration="4.033711896s" totalImagesPullingTime="1.553059041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:58:33.033261232 +0000 UTC m=+518.335964863" watchObservedRunningTime="2026-07-16 21:58:33.033711896 +0000 UTC m=+518.336415528" Jul 16 21:58:44.022568 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:58:44.022538 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-dtp64" Jul 16 21:59:55.043912 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:59:55.043879 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 21:59:55.044553 ip-10-0-139-28 kubenswrapper[2563]: I0716 21:59:55.044060 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 22:00:26.803450 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.803367 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr"] Jul 16 22:00:26.806227 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.806208 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:26.808756 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.808724 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 16 22:00:26.809014 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.808996 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 16 22:00:26.816378 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.816348 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr"] Jul 16 22:00:26.871456 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.871409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-data\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:26.871647 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.871472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:26.871647 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.871555 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzpck\" (UniqueName: \"kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-kube-api-access-qzpck\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:26.971883 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.971842 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzpck\" (UniqueName: \"kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-kube-api-access-qzpck\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:26.972014 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.971901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-data\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:26.972014 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.971949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:26.972125 ip-10-0-139-28 kubenswrapper[2563]: E0716 22:00:26.972078 2563 projected.go:266] Couldn't get secret kserve/seaweedfs-tls-serving: secret "seaweedfs-tls-serving" not found Jul 16 22:00:26.972125 ip-10-0-139-28 kubenswrapper[2563]: E0716 22:00:26.972097 2563 projected.go:196] Error preparing data for projected volume seaweedfs-tls-serving for pod kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr: secret "seaweedfs-tls-serving" not found Jul 16 22:00:26.972219 ip-10-0-139-28 kubenswrapper[2563]: E0716 22:00:26.972168 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-seaweedfs-tls-serving podName:8dc80337-5481-424e-bd2d-4d0f2b0e6f89 nodeName:}" failed. No retries permitted until 2026-07-16 22:00:27.472144584 +0000 UTC m=+632.774848197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "seaweedfs-tls-serving" (UniqueName: "kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-seaweedfs-tls-serving") pod "seaweedfs-tls-serving-67b7477c6d-l4zmr" (UID: "8dc80337-5481-424e-bd2d-4d0f2b0e6f89") : secret "seaweedfs-tls-serving" not found Jul 16 22:00:26.972419 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.972395 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-data\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:26.981105 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:26.981083 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzpck\" (UniqueName: \"kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-kube-api-access-qzpck\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:27.476559 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:27.476508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:27.478878 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:27.478849 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/8dc80337-5481-424e-bd2d-4d0f2b0e6f89-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-l4zmr\" (UID: \"8dc80337-5481-424e-bd2d-4d0f2b0e6f89\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:27.719993 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:27.719954 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" Jul 16 22:00:27.847515 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:27.847483 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr"] Jul 16 22:00:27.850839 ip-10-0-139-28 kubenswrapper[2563]: W0716 22:00:27.850809 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc80337_5481_424e_bd2d_4d0f2b0e6f89.slice/crio-7414a17abcdc08aa07d0b1c42bd9d9cda9c66979b9922f57b9f8ddd14c681bac WatchSource:0}: Error finding container 7414a17abcdc08aa07d0b1c42bd9d9cda9c66979b9922f57b9f8ddd14c681bac: Status 404 returned error can't find the container with id 7414a17abcdc08aa07d0b1c42bd9d9cda9c66979b9922f57b9f8ddd14c681bac Jul 16 22:00:28.400154 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:28.400116 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" event={"ID":"8dc80337-5481-424e-bd2d-4d0f2b0e6f89","Type":"ContainerStarted","Data":"361f148c573b2b92477f82c3a253aca7ee9ada465a41970635740efdbbeb3938"} Jul 16 22:00:28.400355 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:28.400173 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" event={"ID":"8dc80337-5481-424e-bd2d-4d0f2b0e6f89","Type":"ContainerStarted","Data":"7414a17abcdc08aa07d0b1c42bd9d9cda9c66979b9922f57b9f8ddd14c681bac"} Jul 16 22:00:28.421387 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:00:28.421334 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-l4zmr" podStartSLOduration=2.09283192 podStartE2EDuration="2.421315512s" totalImagesPullingTime="328.483592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:00:28.420679355 +0000 UTC m=+633.723382969" watchObservedRunningTime="2026-07-16 22:00:28.421315512 +0000 UTC m=+633.724019166" Jul 16 22:04:12.046636 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.046597 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch"] Jul 16 22:04:12.049881 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.049861 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.053885 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.053856 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\"" Jul 16 22:04:12.054202 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.054176 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 16 22:04:12.054337 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.053875 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 16 22:04:12.054406 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.054066 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\"" Jul 16 22:04:12.058183 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.054485 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-lxc2m\"" Jul 16 22:04:12.061093 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.061066 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch"] Jul 16 22:04:12.099522 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.099485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.099700 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.099539 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.099700 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.099606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv2pj\" (UniqueName: \"kubernetes.io/projected/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-api-access-qv2pj\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.200072 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.200028 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv2pj\" (UniqueName: \"kubernetes.io/projected/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-api-access-qv2pj\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.200257 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.200191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.200257 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.200242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.200948 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.200924 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.202663 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.202638 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.209890 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.209861 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv2pj\" (UniqueName: \"kubernetes.io/projected/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-api-access-qv2pj\") pod \"message-dumper-predictor-6575bcfdfd-qtpch\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.363795 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.363767 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:12.492632 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.492598 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch"] Jul 16 22:04:12.497296 ip-10-0-139-28 kubenswrapper[2563]: W0716 22:04:12.497253 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae592ac_cec9_43f9_b5b6_c6ef9d1aa641.slice/crio-24c34e0d31b8806de2ec70926ff0ffd093517c758ff94b9cccac52417f05fd22 WatchSource:0}: Error finding container 24c34e0d31b8806de2ec70926ff0ffd093517c758ff94b9cccac52417f05fd22: Status 404 returned error can't find the container with id 24c34e0d31b8806de2ec70926ff0ffd093517c758ff94b9cccac52417f05fd22 Jul 16 22:04:12.499311 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:12.499267 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 22:04:13.153721 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:13.153686 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" event={"ID":"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641","Type":"ContainerStarted","Data":"24c34e0d31b8806de2ec70926ff0ffd093517c758ff94b9cccac52417f05fd22"} Jul 16 22:04:14.159353 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:14.159317 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" event={"ID":"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641","Type":"ContainerStarted","Data":"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6"} Jul 16 22:04:16.168968 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:16.168932 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" event={"ID":"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641","Type":"ContainerStarted","Data":"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6"} Jul 16 22:04:16.169473 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:16.168998 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:16.169473 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:16.169053 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:16.170968 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:16.170948 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:16.195142 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:16.195087 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" podStartSLOduration=0.802183829 podStartE2EDuration="4.195068943s" totalImagesPullingTime="3.392885114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:04:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:04:16.19384538 +0000 UTC m=+861.496549011" watchObservedRunningTime="2026-07-16 22:04:16.195068943 +0000 UTC m=+861.497772576" Jul 16 22:04:23.185510 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:23.185471 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:04:55.064176 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:55.064105 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 22:04:55.065304 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:04:55.065264 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 22:06:07.117546 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.117518 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-6575bcfdfd-qtpch_7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641/kserve-container/0.log" Jul 16 22:06:07.577931 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.577843 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch"] Jul 16 22:06:07.578145 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.578116 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerName="kserve-container" containerID="cri-o://583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6" gracePeriod=30 Jul 16 22:06:07.578249 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.578157 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerName="kube-rbac-proxy" containerID="cri-o://3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6" gracePeriod=30 Jul 16 22:06:07.819844 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.819817 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:06:07.954654 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.954617 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv2pj\" (UniqueName: \"kubernetes.io/projected/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-api-access-qv2pj\") pod \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " Jul 16 22:06:07.954828 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.954679 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-rbac-proxy-sar-config\") pod \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " Jul 16 22:06:07.954828 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.954723 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-proxy-tls\") pod \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\" (UID: \"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641\") " Jul 16 22:06:07.955094 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.955065 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" (UID: "7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 22:06:07.956955 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.956924 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" (UID: "7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 22:06:07.957075 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:07.956980 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-api-access-qv2pj" (OuterVolumeSpecName: "kube-api-access-qv2pj") pod "7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" (UID: "7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641"). InnerVolumeSpecName "kube-api-access-qv2pj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 22:06:08.055735 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.055691 2563 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-rbac-proxy-sar-config\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 22:06:08.055735 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.055728 2563 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-proxy-tls\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 22:06:08.055735 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.055740 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv2pj\" (UniqueName: \"kubernetes.io/projected/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641-kube-api-access-qv2pj\") on node \"ip-10-0-139-28.ec2.internal\" DevicePath \"\"" Jul 16 22:06:08.561042 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.561004 2563 generic.go:356] "Generic (PLEG): container finished" podID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerID="3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6" exitCode=2 Jul 16 22:06:08.561042 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.561031 2563 generic.go:356] "Generic (PLEG): container finished" podID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerID="583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6" exitCode=2 Jul 16 22:06:08.561654 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.561054 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" Jul 16 22:06:08.561654 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.561091 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" event={"ID":"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641","Type":"ContainerDied","Data":"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6"} Jul 16 22:06:08.561654 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.561166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" event={"ID":"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641","Type":"ContainerDied","Data":"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6"} Jul 16 22:06:08.561654 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.561205 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch" event={"ID":"7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641","Type":"ContainerDied","Data":"24c34e0d31b8806de2ec70926ff0ffd093517c758ff94b9cccac52417f05fd22"} Jul 16 22:06:08.561654 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.561228 2563 scope.go:117] "RemoveContainer" containerID="3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6" Jul 16 22:06:08.569670 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.569648 2563 scope.go:117] "RemoveContainer" containerID="583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6" Jul 16 22:06:08.576973 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.576954 2563 scope.go:117] "RemoveContainer" containerID="3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6" Jul 16 22:06:08.577217 ip-10-0-139-28 kubenswrapper[2563]: E0716 22:06:08.577201 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6\": container with ID starting with 3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6 not found: ID does not exist" containerID="3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6" Jul 16 22:06:08.577260 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.577226 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6"} err="failed to get container status \"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6\": rpc error: code = NotFound desc = could not find container \"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6\": container with ID starting with 3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6 not found: ID does not exist" Jul 16 22:06:08.577260 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.577242 2563 scope.go:117] "RemoveContainer" containerID="583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6" Jul 16 22:06:08.577517 ip-10-0-139-28 kubenswrapper[2563]: E0716 22:06:08.577498 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6\": container with ID starting with 583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6 not found: ID does not exist" containerID="583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6" Jul 16 22:06:08.577567 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.577523 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6"} err="failed to get container status \"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6\": rpc error: code = NotFound desc = could not find container \"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6\": container with ID starting with 583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6 not found: ID does not exist" Jul 16 22:06:08.577567 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.577541 2563 scope.go:117] "RemoveContainer" containerID="3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6" Jul 16 22:06:08.577726 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.577709 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6"} err="failed to get container status \"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6\": rpc error: code = NotFound desc = could not find container \"3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6\": container with ID starting with 3907da76b79e8095b82cf50040b714589e4f08b954b2e3dfbe8352daa68a93c6 not found: ID does not exist" Jul 16 22:06:08.577767 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.577727 2563 scope.go:117] "RemoveContainer" containerID="583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6" Jul 16 22:06:08.577913 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.577891 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6"} err="failed to get container status \"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6\": rpc error: code = NotFound desc = could not find container \"583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6\": container with ID starting with 583b26310c714ff0949a830228ce47f413b02ccddccfeb121b6cd89bab0190b6 not found: ID does not exist" Jul 16 22:06:08.586299 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.586260 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch"] Jul 16 22:06:08.593630 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:08.593607 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-qtpch"] Jul 16 22:06:09.128042 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:06:09.128007 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" path="/var/lib/kubelet/pods/7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641/volumes" Jul 16 22:09:55.082848 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:09:55.082757 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 22:09:55.089407 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:09:55.089366 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 22:14:55.110145 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:14:55.110116 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 22:14:55.112401 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:14:55.112378 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 22:16:34.100741 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.100698 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wsh68/must-gather-hprg4"] Jul 16 22:16:34.101306 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.101084 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerName="kserve-container" Jul 16 22:16:34.101306 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.101101 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerName="kserve-container" Jul 16 22:16:34.101306 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.101130 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerName="kube-rbac-proxy" Jul 16 22:16:34.101306 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.101139 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerName="kube-rbac-proxy" Jul 16 22:16:34.101306 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.101198 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerName="kube-rbac-proxy" Jul 16 22:16:34.101306 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.101211 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ae592ac-cec9-43f9-b5b6-c6ef9d1aa641" containerName="kserve-container" Jul 16 22:16:34.103216 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.103192 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wsh68/must-gather-hprg4" Jul 16 22:16:34.105600 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.105578 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wsh68\"/\"default-dockercfg-2x8kc\"" Jul 16 22:16:34.105711 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.105692 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wsh68\"/\"openshift-service-ca.crt\"" Jul 16 22:16:34.106255 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.106238 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wsh68\"/\"kube-root-ca.crt\"" Jul 16 22:16:34.112612 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.112591 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wsh68/must-gather-hprg4"] Jul 16 22:16:34.214674 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.214634 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx7kh\" (UniqueName: \"kubernetes.io/projected/c824f568-473d-47dc-a512-f35225bb154d-kube-api-access-qx7kh\") pod \"must-gather-hprg4\" (UID: \"c824f568-473d-47dc-a512-f35225bb154d\") " pod="openshift-must-gather-wsh68/must-gather-hprg4" Jul 16 22:16:34.214674 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.214676 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c824f568-473d-47dc-a512-f35225bb154d-must-gather-output\") pod \"must-gather-hprg4\" (UID: \"c824f568-473d-47dc-a512-f35225bb154d\") " pod="openshift-must-gather-wsh68/must-gather-hprg4" Jul 16 22:16:34.315955 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.315908 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx7kh\" (UniqueName: \"kubernetes.io/projected/c824f568-473d-47dc-a512-f35225bb154d-kube-api-access-qx7kh\") pod \"must-gather-hprg4\" (UID: \"c824f568-473d-47dc-a512-f35225bb154d\") " pod="openshift-must-gather-wsh68/must-gather-hprg4" Jul 16 22:16:34.315955 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.315952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c824f568-473d-47dc-a512-f35225bb154d-must-gather-output\") pod \"must-gather-hprg4\" (UID: \"c824f568-473d-47dc-a512-f35225bb154d\") " pod="openshift-must-gather-wsh68/must-gather-hprg4" Jul 16 22:16:34.316262 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.316243 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c824f568-473d-47dc-a512-f35225bb154d-must-gather-output\") pod \"must-gather-hprg4\" (UID: \"c824f568-473d-47dc-a512-f35225bb154d\") " pod="openshift-must-gather-wsh68/must-gather-hprg4" Jul 16 22:16:34.324402 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.324371 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx7kh\" (UniqueName: \"kubernetes.io/projected/c824f568-473d-47dc-a512-f35225bb154d-kube-api-access-qx7kh\") pod \"must-gather-hprg4\" (UID: \"c824f568-473d-47dc-a512-f35225bb154d\") " pod="openshift-must-gather-wsh68/must-gather-hprg4" Jul 16 22:16:34.412057 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.412018 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wsh68/must-gather-hprg4" Jul 16 22:16:34.540778 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.540744 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wsh68/must-gather-hprg4"] Jul 16 22:16:34.545415 ip-10-0-139-28 kubenswrapper[2563]: W0716 22:16:34.544391 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc824f568_473d_47dc_a512_f35225bb154d.slice/crio-686bcad4d837a07c70535e5e8df710753ea24c62c33660b9896fafa3a0de4aba WatchSource:0}: Error finding container 686bcad4d837a07c70535e5e8df710753ea24c62c33660b9896fafa3a0de4aba: Status 404 returned error can't find the container with id 686bcad4d837a07c70535e5e8df710753ea24c62c33660b9896fafa3a0de4aba Jul 16 22:16:34.547443 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.547421 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 22:16:34.681907 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:34.681822 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wsh68/must-gather-hprg4" event={"ID":"c824f568-473d-47dc-a512-f35225bb154d","Type":"ContainerStarted","Data":"686bcad4d837a07c70535e5e8df710753ea24c62c33660b9896fafa3a0de4aba"} Jul 16 22:16:35.689436 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:35.689402 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wsh68/must-gather-hprg4" event={"ID":"c824f568-473d-47dc-a512-f35225bb154d","Type":"ContainerStarted","Data":"23dab5a821337c87c69b49e6a401d5a98e6c6adc7f676e527a710618c2b7ee39"} Jul 16 22:16:35.689856 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:35.689447 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wsh68/must-gather-hprg4" event={"ID":"c824f568-473d-47dc-a512-f35225bb154d","Type":"ContainerStarted","Data":"73e8f6d9ff26eb1ff1c5c6e604336cc14da04f6fb480d06d27794acf27c59f35"} Jul 16 22:16:35.706836 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:35.706773 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wsh68/must-gather-hprg4" podStartSLOduration=1.094302192 podStartE2EDuration="1.706751784s" totalImagesPullingTime="612.449592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:16:35.705192054 +0000 UTC m=+1601.007895697" watchObservedRunningTime="2026-07-16 22:16:35.706751784 +0000 UTC m=+1601.009455415" Jul 16 22:16:36.595964 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:36.595915 2563 ???:1] "http: TLS handshake error from 10.0.139.28:33428: EOF" Jul 16 22:16:36.601877 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:36.601841 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4dhl9_5f944a82-6944-48d8-92ef-fd83397b4dca/global-pull-secret-syncer/0.log" Jul 16 22:16:36.851813 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:36.851729 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h49hk_c70bb310-56c5-47c2-905b-639816538960/konnectivity-agent/0.log" Jul 16 22:16:36.979705 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:36.979674 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-28.ec2.internal_089fec5c138becb10b4b84131314bfc6/haproxy/0.log" Jul 16 22:16:41.449913 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:41.449883 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgrpx_219597ee-9703-4cc8-9d5d-97cb5af8bbe4/node-exporter/0.log" Jul 16 22:16:41.474212 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:41.474182 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgrpx_219597ee-9703-4cc8-9d5d-97cb5af8bbe4/kube-rbac-proxy/0.log" Jul 16 22:16:41.507390 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:41.507363 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sgrpx_219597ee-9703-4cc8-9d5d-97cb5af8bbe4/init-textfile/0.log" Jul 16 22:16:45.208467 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.208431 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh"] Jul 16 22:16:45.214742 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.214712 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.221358 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.221325 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh"] Jul 16 22:16:45.308772 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.308735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-podres\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.308961 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.308782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-proc\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.308961 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.308812 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzcml\" (UniqueName: \"kubernetes.io/projected/38568ac2-f5ca-438e-9897-bf9c668ef728-kube-api-access-qzcml\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.308961 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.308856 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-sys\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.308961 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.308902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-lib-modules\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.409634 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.409602 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzcml\" (UniqueName: \"kubernetes.io/projected/38568ac2-f5ca-438e-9897-bf9c668ef728-kube-api-access-qzcml\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.409634 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.409647 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-sys\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.409850 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.409721 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-sys\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.409850 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.409818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-lib-modules\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.409931 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.409877 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-podres\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.409931 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.409901 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-proc\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.410004 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.409973 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-proc\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.410004 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.409975 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-lib-modules\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.410077 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.410029 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38568ac2-f5ca-438e-9897-bf9c668ef728-podres\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.419090 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.419067 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzcml\" (UniqueName: \"kubernetes.io/projected/38568ac2-f5ca-438e-9897-bf9c668ef728-kube-api-access-qzcml\") pod \"perf-node-gather-daemonset-8ztrh\" (UID: \"38568ac2-f5ca-438e-9897-bf9c668ef728\") " pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.527499 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.527414 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:45.691606 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.691568 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh"] Jul 16 22:16:45.698236 ip-10-0-139-28 kubenswrapper[2563]: W0716 22:16:45.698205 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38568ac2_f5ca_438e_9897_bf9c668ef728.slice/crio-7737c6f792d140c12a433a836f9f3854ce3a2ef169d396f0fd1c2814543269fe WatchSource:0}: Error finding container 7737c6f792d140c12a433a836f9f3854ce3a2ef169d396f0fd1c2814543269fe: Status 404 returned error can't find the container with id 7737c6f792d140c12a433a836f9f3854ce3a2ef169d396f0fd1c2814543269fe Jul 16 22:16:45.742253 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.742101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" event={"ID":"38568ac2-f5ca-438e-9897-bf9c668ef728","Type":"ContainerStarted","Data":"7737c6f792d140c12a433a836f9f3854ce3a2ef169d396f0fd1c2814543269fe"} Jul 16 22:16:45.934230 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.934199 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zxmnm_8072a8eb-d828-4813-9052-b9b37b28d940/dns/0.log" Jul 16 22:16:45.955818 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.955789 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zxmnm_8072a8eb-d828-4813-9052-b9b37b28d940/kube-rbac-proxy/0.log" Jul 16 22:16:45.977242 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:45.977203 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4bxxg_64f5abd7-58f7-4b0a-94db-9a3a992d0f66/dns-node-resolver/0.log" Jul 16 22:16:46.559449 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:46.559414 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-smdqg_3a9e8556-7305-4e0a-8e45-4f77a30f88c6/node-ca/0.log" Jul 16 22:16:46.748377 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:46.748334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" event={"ID":"38568ac2-f5ca-438e-9897-bf9c668ef728","Type":"ContainerStarted","Data":"0ad43d3ba694615fa2f276615f3e04912fc815bd2c069bc04aba9393b13c5556"} Jul 16 22:16:46.748672 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:46.748649 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:46.766580 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:46.766519 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" podStartSLOduration=1.7664975809999999 podStartE2EDuration="1.766497581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:16:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:16:46.76517805 +0000 UTC m=+1612.067881683" watchObservedRunningTime="2026-07-16 22:16:46.766497581 +0000 UTC m=+1612.069201213" Jul 16 22:16:47.765081 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:47.765002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mnc95_22b3bbb9-18cb-4e41-b045-62d3f490e549/serve-healthcheck-canary/0.log" Jul 16 22:16:48.147177 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:48.147142 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmvdd_032680fc-eea8-4189-94e3-3afbdbcb3381/kube-rbac-proxy/0.log" Jul 16 22:16:48.169376 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:48.169340 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmvdd_032680fc-eea8-4189-94e3-3afbdbcb3381/exporter/0.log" Jul 16 22:16:48.191086 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:48.191056 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cmvdd_032680fc-eea8-4189-94e3-3afbdbcb3381/extractor/0.log" Jul 16 22:16:50.572884 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:50.572844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-84cf6d888d-5jrjb_2fbb5c6f-148d-4da0-8224-a4becf96b44c/manager/0.log" Jul 16 22:16:50.615928 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:50.615896 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-dtp64_8c1ea9c2-80a5-4f9a-8109-e77e08ca3548/server/0.log" Jul 16 22:16:50.872980 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:50.872943 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-psgxf_4784ec1a-0d8e-4fab-b7bb-d1be8bfef904/seaweedfs/0.log" Jul 16 22:16:50.922366 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:50.921796 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-l4zmr_8dc80337-5481-424e-bd2d-4d0f2b0e6f89/seaweedfs-tls-serving/0.log" Jul 16 22:16:52.763539 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:52.763512 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wsh68/perf-node-gather-daemonset-8ztrh" Jul 16 22:16:56.599352 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.599325 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwqts_2055e987-d811-4511-a7e8-75efd27281b2/kube-multus-additional-cni-plugins/0.log" Jul 16 22:16:56.621886 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.621851 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwqts_2055e987-d811-4511-a7e8-75efd27281b2/egress-router-binary-copy/0.log" Jul 16 22:16:56.643449 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.643409 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwqts_2055e987-d811-4511-a7e8-75efd27281b2/cni-plugins/0.log" Jul 16 22:16:56.666636 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.666610 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwqts_2055e987-d811-4511-a7e8-75efd27281b2/bond-cni-plugin/0.log" Jul 16 22:16:56.687470 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.687442 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwqts_2055e987-d811-4511-a7e8-75efd27281b2/routeoverride-cni/0.log" Jul 16 22:16:56.706851 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.706818 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwqts_2055e987-d811-4511-a7e8-75efd27281b2/whereabouts-cni-bincopy/0.log" Jul 16 22:16:56.727806 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.727773 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mwqts_2055e987-d811-4511-a7e8-75efd27281b2/whereabouts-cni/0.log" Jul 16 22:16:56.787721 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.787696 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-t66rp_d240f6f9-678c-4ad8-84af-4e24bb10440f/kube-multus/0.log" Jul 16 22:16:56.969330 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.969301 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9dnfx_09a03623-03c8-413a-819e-b5638989d278/network-metrics-daemon/0.log" Jul 16 22:16:56.991625 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:56.991599 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9dnfx_09a03623-03c8-413a-819e-b5638989d278/kube-rbac-proxy/0.log" Jul 16 22:16:57.700464 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.700431 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-controller/0.log" Jul 16 22:16:57.716371 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.716341 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/0.log" Jul 16 22:16:57.716371 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.716359 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovn-acl-logging/1.log" Jul 16 22:16:57.735525 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.735495 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/kube-rbac-proxy-node/0.log" Jul 16 22:16:57.757325 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.757293 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 22:16:57.774979 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.774951 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/northd/0.log" Jul 16 22:16:57.794691 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.794667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/nbdb/0.log" Jul 16 22:16:57.813644 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.813619 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/sbdb/0.log" Jul 16 22:16:57.867642 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:57.867609 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtgfw_d7b7efc6-1366-49fa-a329-2c60cead65dd/ovnkube-controller/0.log" Jul 16 22:16:59.371373 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:16:59.371344 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bz4qm_e25ef18d-2760-4765-bf2d-a44eff90c864/network-check-target-container/0.log" Jul 16 22:17:00.439135 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:17:00.439075 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hbqrl_da4c9599-cf3e-484f-b4d0-e05fd81063d8/iptables-alerter/0.log" Jul 16 22:17:01.149522 ip-10-0-139-28 kubenswrapper[2563]: I0716 22:17:01.149492 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-bgzgm_5ce636d5-2c44-47cf-a0b9-671192e67af1/tuned/0.log"