Jul 06 15:23:31.104137 ip-10-0-134-165 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 15:23:31.104152 ip-10-0-134-165 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 15:23:31.104161 ip-10-0-134-165 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 15:23:31.104497 ip-10-0-134-165 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 15:23:41.274495 ip-10-0-134-165 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 15:23:41.274513 ip-10-0-134-165 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2328d4170b8e45169bdb1b739fda5fd0 -- Jul 06 15:25:19.562974 ip-10-0-134-165 systemd[1]: Starting Kubernetes Kubelet... Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.982607 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990447 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990464 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990469 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990472 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990475 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990478 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990481 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:20.045988 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990487 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990490 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990495 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990498 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990502 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990506 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990511 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990514 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990517 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990520 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990523 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990526 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990532 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990535 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990539 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990543 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990546 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990551 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990554 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:20.048099 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990557 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990560 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990564 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990567 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990571 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990577 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990580 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990585 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990588 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990591 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990594 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990597 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990600 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990603 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990605 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990608 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990611 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990616 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990619 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:20.050466 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990621 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990624 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990627 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990630 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990632 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990635 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990637 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990640 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990643 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990646 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990649 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990654 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990657 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990660 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990662 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990665 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990668 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990671 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990674 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990677 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:20.052463 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990693 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990696 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990699 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990707 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990710 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990712 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990715 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990718 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990720 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990723 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990726 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990729 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990731 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990734 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990737 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990742 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990745 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990747 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990750 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990753 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:20.054720 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990756 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990759 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990761 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990764 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990767 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990770 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990772 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990775 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990780 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990783 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990786 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990788 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990791 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.990794 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992019 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992027 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992036 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992039 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992042 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:20.069805 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992049 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:20.060226 ip-10-0-134-165 systemd[1]: Started Kubernetes Kubelet. Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992053 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992056 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992059 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992063 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992067 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992070 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992072 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992075 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992078 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992081 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992083 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992089 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992092 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992094 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992097 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992100 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992103 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992106 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992108 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:20.072617 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992111 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992113 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992116 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992119 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992121 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992126 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992129 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992132 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992135 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992138 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992147 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992150 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992153 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992156 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992158 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992161 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992164 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992169 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992171 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:20.087007 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992174 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992176 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992179 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992182 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992184 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992187 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992190 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992193 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992198 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992201 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992204 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992209 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992211 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992214 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992216 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992219 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992222 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992224 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992234 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992237 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:20.102216 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992240 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992242 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992245 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992251 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992260 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992263 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992267 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992271 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992274 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992277 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992279 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992286 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992289 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992292 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992297 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992300 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992303 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992305 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992308 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:20.117877 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992311 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992315 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992318 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992320 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992324 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992326 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992329 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992332 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992337 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992339 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992342 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992344 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992347 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992350 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992352 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.992355 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993175 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993188 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993192 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993195 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:20.120883 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993198 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993201 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993204 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993207 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993210 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993213 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993215 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993218 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993220 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993223 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993226 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993228 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993231 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993234 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993236 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993239 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993242 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993244 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993247 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993250 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:20.147177 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993253 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993256 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993258 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993261 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993263 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993266 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993268 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993271 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993273 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993276 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993279 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993283 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993287 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993290 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993293 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993296 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993299 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993301 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993304 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:20.288402 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993306 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993310 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993312 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993315 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993317 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993320 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993324 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993326 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993329 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993332 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993334 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993337 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993340 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993343 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993346 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993348 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993353 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993356 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993359 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993361 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:20.289228 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993364 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993367 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993370 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993372 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993375 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993378 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993380 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993383 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993386 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993388 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993391 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993395 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993399 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993401 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993406 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993412 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993416 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993419 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993421 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:20.290038 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993425 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993427 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993430 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993432 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993435 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993437 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993439 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993442 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993444 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993467 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993471 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993474 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993477 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993480 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993483 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993486 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.993489 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993557 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993564 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993571 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993576 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 15:25:20.290672 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993580 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993583 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993587 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993592 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993595 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993598 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993602 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993608 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993611 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993614 2581 flags.go:64] FLAG: --cgroup-root="" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993617 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993620 2581 flags.go:64] FLAG: --client-ca-file="" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993623 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993626 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993631 2581 flags.go:64] FLAG: --cluster-domain="" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993634 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993637 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993640 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993643 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993647 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993652 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993655 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993659 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993662 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 06 15:25:20.291542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993665 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993668 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993671 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993674 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993696 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993699 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993702 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993705 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993708 2581 flags.go:64] FLAG: --enable-server="true" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993711 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993716 2581 flags.go:64] FLAG: --event-burst="100" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993719 2581 flags.go:64] FLAG: --event-qps="50" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993722 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993725 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993728 2581 flags.go:64] FLAG: --eviction-hard="" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993733 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993736 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993739 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993742 2581 flags.go:64] FLAG: --eviction-soft="" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993745 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993747 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993751 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993754 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993757 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993760 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 15:25:20.292404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993762 2581 flags.go:64] FLAG: --feature-gates="" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993766 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993770 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993774 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993777 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993780 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993783 2581 flags.go:64] FLAG: --help="false" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993786 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993789 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993792 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993795 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993798 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993801 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993805 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993807 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993810 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993813 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993816 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993819 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993822 2581 flags.go:64] FLAG: --kube-reserved="" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993825 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993827 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993832 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993834 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 15:25:20.293243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993837 2581 flags.go:64] FLAG: --lock-file="" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993840 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993843 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993846 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993851 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993855 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993858 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993861 2581 flags.go:64] FLAG: --logging-format="text" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993863 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993867 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993869 2581 flags.go:64] FLAG: --manifest-url="" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993873 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993879 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993881 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993885 2581 flags.go:64] FLAG: --max-pods="110" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993888 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993891 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993894 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993897 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993899 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993902 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993905 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993912 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993916 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993919 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 15:25:20.297113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993922 2581 flags.go:64] FLAG: --pod-cidr="" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993925 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993931 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993934 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993937 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993939 2581 flags.go:64] FLAG: --port="10250" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993944 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993947 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04ea6ceb28eff717f" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993950 2581 flags.go:64] FLAG: --qos-reserved="" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993953 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993956 2581 flags.go:64] FLAG: --register-node="true" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993959 2581 flags.go:64] FLAG: --register-with-taints="" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993962 2581 flags.go:64] FLAG: --registry-burst="10" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993965 2581 flags.go:64] FLAG: --registry-qps="5" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993969 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993971 2581 flags.go:64] FLAG: --reserved-memory="" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993975 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993978 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993984 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993987 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993989 2581 flags.go:64] FLAG: --runonce="false" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993993 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993996 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.993999 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994002 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 15:25:20.298026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994004 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994007 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994010 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994013 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994016 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994019 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994022 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994025 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994028 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994030 2581 flags.go:64] FLAG: --system-cgroups="" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994033 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994039 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994041 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994045 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994049 2581 flags.go:64] FLAG: --tls-min-version="" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994052 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994055 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994058 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994061 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994064 2581 flags.go:64] FLAG: --v="2" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994068 2581 flags.go:64] FLAG: --version="false" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994072 2581 flags.go:64] FLAG: --vmodule="" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994076 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.994080 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994211 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:20.378373 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994219 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994223 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994226 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994229 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994232 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994235 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994238 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994240 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994243 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994246 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994248 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994250 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994253 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994255 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994258 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994260 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994263 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994265 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994268 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994270 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:20.379394 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994274 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994277 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994279 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994282 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994284 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994287 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994290 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994292 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994295 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994298 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994301 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994303 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994308 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994312 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994315 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994318 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994320 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994323 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994325 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:20.380017 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994328 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994331 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994334 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994336 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994338 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994341 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994343 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994347 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994351 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994353 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994356 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994359 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994362 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994366 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994369 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994371 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994374 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994377 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994379 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994382 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:20.380644 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994385 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994387 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994390 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994393 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994395 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994399 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994402 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994404 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994407 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994409 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994412 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994414 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994417 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994419 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994422 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994424 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994427 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994430 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994432 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:20.381398 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994434 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994437 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994439 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994443 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994447 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994449 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994454 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994456 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994459 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994462 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994464 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994467 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994470 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994472 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994475 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994477 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994480 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994484 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994488 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:20.381993 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:19.994491 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:19.995105 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.001805 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.001827 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.002926 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.002935 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003009 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003014 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003019 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003023 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003026 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003030 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003034 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003037 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003040 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:20.382504 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003045 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003048 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003050 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003053 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003058 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003061 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003063 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003068 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003071 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003073 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003076 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003079 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003082 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003085 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003087 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003091 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003095 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003097 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003100 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003104 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:20.383000 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003110 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003114 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003117 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003120 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003122 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003125 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003127 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003130 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003133 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003137 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003141 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003143 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003146 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003150 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003152 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003155 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003158 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003162 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003165 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003168 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:20.383567 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003171 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003175 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003178 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003180 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003184 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003187 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003190 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003192 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003196 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003200 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003203 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003206 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003211 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003215 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003219 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003222 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003225 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003227 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003231 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:20.384148 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003234 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003237 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003239 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003243 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003246 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003248 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003253 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003257 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003260 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003263 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003268 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003272 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003276 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003280 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003283 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003285 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003289 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003293 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003296 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003298 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:20.384692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003302 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003307 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003310 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003314 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003317 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003322 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003325 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003329 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003333 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003337 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003341 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.003347 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003478 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003483 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:20.385297 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003486 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003490 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003493 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003495 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003498 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003501 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003503 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003506 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003508 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003511 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003514 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003517 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003519 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003522 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003524 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003526 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003529 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003531 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003534 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003538 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:20.385760 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003541 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003543 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003546 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003549 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003552 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003555 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003559 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003562 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003564 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003567 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003569 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003572 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003575 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003577 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003580 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003582 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003585 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003587 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003590 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003592 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:20.386362 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003595 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003597 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003600 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003602 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003605 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003607 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003610 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003612 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003616 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003619 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003622 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003626 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003629 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003632 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003635 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003637 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003642 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003644 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003647 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:20.386918 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003650 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003653 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003656 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003659 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003661 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003664 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003666 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003669 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003672 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003674 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003693 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003697 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003700 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003702 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003705 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003707 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003710 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003714 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003717 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:20.387453 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003720 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003723 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003728 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003731 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003734 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003739 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003742 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003745 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003747 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003750 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003754 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003757 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003760 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003762 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003766 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003769 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003771 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003774 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:20.387979 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:20.003776 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.003782 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.003922 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.006925 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.008211 2581 server.go:1019] "Starting client certificate rotation" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.008318 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.008350 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.010752 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.012252 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.023800 2581 log.go:25] "Validated CRI v1 runtime API" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.028490 2581 log.go:25] "Validated CRI v1 image API" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.030928 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 15:25:20.388644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.033414 2581 fs.go:135] Filesystem UUIDs: map[138dd7aa-ccc8-4087-b049-00bbd49ca8a9:/dev/nvme0n1p3 3b7e8da7-90df-4add-9e75-ac0d0f97f702:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 06 15:25:20.389068 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.033431 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 15:25:20.389287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.038534 2581 manager.go:216] Machine: {Timestamp:2026-07-06 15:25:20.037230912 +0000 UTC m=+0.353361367 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098050 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2da69cb71766a69354dca33c668987 SystemUUID:ec2da69c-b717-66a6-9354-dca33c668987 BootID:2328d417-0b8e-4516-9bdb-1b739fda5fd0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1d:0d:43:da:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1d:0d:43:da:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:d3:27:b9:8d:7b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 15:25:20.389287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.038640 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 15:25:20.389287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.038742 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 15:25:20.389287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.041526 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 15:25:20.389287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.041560 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-165.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 15:25:20.389287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.042654 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 15:25:20.389287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.042664 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 15:25:20.389287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.042672 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.044335 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.045486 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048275 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048400 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048430 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048444 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048458 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048466 2581 kubelet.go:398] "Adding apiserver pod source" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048475 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048897 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.048918 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.051215 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.051424 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.053488 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.053524 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054572 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054590 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054598 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054607 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054617 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054624 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054634 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054641 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054657 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054666 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054693 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.054700 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.055913 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.055921 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.059159 2581 server.go:1268] "Started kubelet" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.059221 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.059243 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.059323 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.060738 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.066969 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.067154 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-165.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.066854 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.067701 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 06 15:25:20.392023 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.068555 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.069728 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-165.ec2.internal.18bfbcc246c46be2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-165.ec2.internal,UID:ip-10-0-134-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-165.ec2.internal,},FirstTimestamp:2026-07-06 15:25:20.058960866 +0000 UTC m=+0.375091321,LastTimestamp:2026-07-06 15:25:20.058960866 +0000 UTC m=+0.375091321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-165.ec2.internal,}" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074140 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074163 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.074206 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074674 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074676 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074709 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074828 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074836 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074983 2581 factory.go:55] Registering systemd factory Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.074998 2581 factory.go:223] Registration of the systemd container factory successfully Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.075213 2581 factory.go:153] Registering CRI-O factory Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.075229 2581 factory.go:223] Registration of the crio container factory successfully Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.075284 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.075309 2581 factory.go:103] Registering Raw factory Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.075322 2581 manager.go:1196] Started watching for new ooms in manager Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.075816 2581 manager.go:349] Starting recovery of all containers Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.076793 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.076908 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-165.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.087037 2581 manager.go:354] Recovery completed Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.091532 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.093429 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.093470 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.093480 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.094038 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.094044 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.094048 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.094103 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.094757 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.094780 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.094799 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.095258 2581 policy_none.go:49] "None policy: Start" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.095274 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 15:25:20.393264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.095287 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.096626 2581 policy_none.go:47] "Start" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.105202 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-165.ec2.internal.18bfbcc248d2bd05 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-165.ec2.internal,UID:ip-10-0-134-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-165.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-165.ec2.internal,},FirstTimestamp:2026-07-06 15:25:20.093453573 +0000 UTC m=+0.409584027,LastTimestamp:2026-07-06 15:25:20.093453573 +0000 UTC m=+0.409584027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-165.ec2.internal,}" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.117531 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-165.ec2.internal.18bfbcc248d30ecd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-165.ec2.internal,UID:ip-10-0-134-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-165.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-165.ec2.internal,},FirstTimestamp:2026-07-06 15:25:20.093474509 +0000 UTC m=+0.409604965,LastTimestamp:2026-07-06 15:25:20.093474509 +0000 UTC m=+0.409604965,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-165.ec2.internal,}" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.118298 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ltbkp" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.130665 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-165.ec2.internal.18bfbcc248d3334e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-165.ec2.internal,UID:ip-10-0-134-165.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-165.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-165.ec2.internal,},FirstTimestamp:2026-07-06 15:25:20.093483854 +0000 UTC m=+0.409614308,LastTimestamp:2026-07-06 15:25:20.093483854 +0000 UTC m=+0.409614308,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-165.ec2.internal,}" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.131888 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ltbkp" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.157321 2581 manager.go:337] "Starting Device Plugin manager" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.157402 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.157416 2581 server.go:87] "Starting device plugin registration server" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.157734 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.157747 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.157851 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.157944 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.157954 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.158535 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.158577 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.212742 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.213918 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.213962 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 15:25:20.470665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.213988 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.214030 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.216775 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.258133 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.259241 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.259276 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.259289 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.259312 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.267216 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.267235 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-165.ec2.internal\": node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.286009 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.334388 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal"] Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.334627 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.336139 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.336171 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.336183 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.337413 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.337518 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.337543 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.338150 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.338167 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.338182 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.339267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.339288 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.339321 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.339351 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.339361 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.339896 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.339918 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.339928 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.386093 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.403574 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-165.ec2.internal\" not found" node="ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.471494 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.408148 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-165.ec2.internal\" not found" node="ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.475740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/283731ddec37e713b989291a87b04d51-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"283731ddec37e713b989291a87b04d51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.475767 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f2b1b985cd77d295beeb16e5b85c860-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"2f2b1b985cd77d295beeb16e5b85c860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.475787 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2b1b985cd77d295beeb16e5b85c860-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"2f2b1b985cd77d295beeb16e5b85c860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.487094 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.576914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f2b1b985cd77d295beeb16e5b85c860-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"2f2b1b985cd77d295beeb16e5b85c860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.576939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f2b1b985cd77d295beeb16e5b85c860-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"2f2b1b985cd77d295beeb16e5b85c860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.576985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2b1b985cd77d295beeb16e5b85c860-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"2f2b1b985cd77d295beeb16e5b85c860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.577005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/283731ddec37e713b989291a87b04d51-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"283731ddec37e713b989291a87b04d51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.577040 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/283731ddec37e713b989291a87b04d51-config\") pod \"kube-apiserver-proxy-ip-10-0-134-165.ec2.internal\" (UID: \"283731ddec37e713b989291a87b04d51\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.581545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.577065 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f2b1b985cd77d295beeb16e5b85c860-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal\" (UID: \"2f2b1b985cd77d295beeb16e5b85c860\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.684831 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.588453 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:20.783225 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.688866 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:20.783225 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.707020 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:20.783225 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:20.712093 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" Jul 06 15:25:22.117914 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:20.789232 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:22.117914 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:22.110107 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:22.266951 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:22.210719 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:22.266951 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.228673 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 15:25:22.266951 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.228793 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 15:25:22.266951 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:22.228822 2581 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.134.165:38696->18.235.22.47:6443: use of closed network connection" Jul 06 15:25:22.266951 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:22.228902 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.134.165:38696->18.235.22.47:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 15:25:22.337527 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:22.311349 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:22.354821 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.354512 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 15:20:21 +0000 UTC" deadline="2028-01-20 01:19:33.151737671 +0000 UTC" Jul 06 15:25:22.354821 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.354553 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13497h54m10.797187808s" Jul 06 15:25:22.441467 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:22.412200 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:22.522154 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:22.512777 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-165.ec2.internal\" not found" Jul 06 15:25:22.527012 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.524941 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:22.527012 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.526285 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:22.527012 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.526322 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:22.527012 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.526335 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:22.614223 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:22.552579 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2b1b985cd77d295beeb16e5b85c860.slice/crio-9c022cfe8365db37a8c9a875aec2b4dc82d63c6e5b49eb33379cec775d051295 WatchSource:0}: Error finding container 9c022cfe8365db37a8c9a875aec2b4dc82d63c6e5b49eb33379cec775d051295: Status 404 returned error can't find the container with id 9c022cfe8365db37a8c9a875aec2b4dc82d63c6e5b49eb33379cec775d051295 Jul 06 15:25:22.614223 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.561290 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:25:22.614223 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.575456 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:22.614223 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.595314 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" Jul 06 15:25:22.698536 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.622238 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:25:22.698536 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.624065 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" Jul 06 15:25:22.698536 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.635155 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:25:22.851555 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:22.851518 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:23.269955 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.269921 2581 apiserver.go:52] "Watching apiserver" Jul 06 15:25:23.280405 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.280377 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 15:25:23.281346 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.281322 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal","openshift-multus/multus-qrgcs","openshift-multus/network-metrics-daemon-9vcwr","openshift-network-diagnostics/network-check-target-8vxl9","openshift-network-operator/iptables-alerter-55w9b","openshift-ovn-kubernetes/ovnkube-node-whv5v","kube-system/global-pull-secret-syncer-stmpf","kube-system/konnectivity-agent-2wz9q","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc","openshift-cluster-node-tuning-operator/tuned-72b5v","openshift-dns/node-resolver-646k2","openshift-image-registry/node-ca-vww7h","openshift-multus/multus-additional-cni-plugins-bzdpx"] Jul 06 15:25:23.282907 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.282890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.284084 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.284063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.285203 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.285173 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.285995 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.285959 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 15:25:23.286084 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.285971 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 15:25:23.286084 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.286010 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 15:25:23.286243 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.286228 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 15:25:23.286472 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.286451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:23.286563 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.286525 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:23.287240 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.286935 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 15:25:23.287240 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.286973 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 15:25:23.287240 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.287026 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 15:25:23.287240 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.287121 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zrgtp\"" Jul 06 15:25:23.287240 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.286951 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 15:25:23.287570 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.287478 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 15:25:23.287911 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.287896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:23.288002 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.287972 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:23.288497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.288472 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h87qp\"" Jul 06 15:25:23.288648 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.288629 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 15:25:23.288743 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.288729 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-827bf\"" Jul 06 15:25:23.288813 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.288795 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 15:25:23.288899 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.288880 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 15:25:23.288942 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.288884 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 15:25:23.289240 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.289222 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.290747 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.290638 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:23.292573 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.292052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.292573 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.292146 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:25:23.292573 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.292446 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 15:25:23.292819 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.292750 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 15:25:23.293009 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.292973 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zw8rp\"" Jul 06 15:25:23.293617 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.293599 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 15:25:23.293721 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.293704 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wl6g6\"" Jul 06 15:25:23.293839 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.293822 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 15:25:23.294116 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.294017 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.294116 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.294076 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:23.296281 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.295321 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 15:25:23.296281 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.295445 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 15:25:23.296281 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.296079 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.298695 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.298674 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.299470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.299453 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.301520 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.301501 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 15:25:23.301655 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.301635 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 15:25:23.301894 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.301870 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dtvdl\"" Jul 06 15:25:23.301968 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.301904 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 15:25:23.302046 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.301873 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tgscc\"" Jul 06 15:25:23.302121 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.302104 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 15:25:23.302177 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.302106 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:25:23.302401 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.302385 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hkm9d\"" Jul 06 15:25:23.302779 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.302717 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 15:25:23.302843 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.302787 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s5kkv\"" Jul 06 15:25:23.302893 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.302858 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 15:25:23.302893 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.302790 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 15:25:23.304754 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-multus-certs\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.304861 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d957d89f-d702-435d-87d4-a1263ead17ee-konnectivity-ca\") pod \"konnectivity-agent-2wz9q\" (UID: \"d957d89f-d702-435d-87d4-a1263ead17ee\") " pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:23.304861 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.304861 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304811 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-kubelet\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.304861 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-etc-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.304861 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-cni-bin\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.305135 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-conf-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.305135 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-etc-kubernetes\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.305135 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.304953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.305135 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-registration-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.305135 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.305135 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-slash\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.305135 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-log-socket\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.305135 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-daemon-config\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305143 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-host-slash\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-k8s-cni-cncf-io\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305317 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d957d89f-d702-435d-87d4-a1263ead17ee-agent-certs\") pod \"konnectivity-agent-2wz9q\" (UID: \"d957d89f-d702-435d-87d4-a1263ead17ee\") " pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-node-log\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-run-ovn-kubernetes\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-iptables-alerter-script\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00deaac9-c8d8-42b6-a361-9e05e1d548e3-dbus\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305462 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/003a1667-1793-4f5f-839d-74360856bff9-ovn-node-metrics-cert\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305532 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-netns\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.305558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305557 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-os-release\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00deaac9-c8d8-42b6-a361-9e05e1d548e3-kubelet-config\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-serviceca\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305679 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-system-cni-dir\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-kubelet\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-sys-fs\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-run-netns\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305857 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-env-overrides\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.305951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-hostroot\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-host\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306075 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-cni-netd\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.306133 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmv45\" (UniqueName: \"kubernetes.io/projected/dfe512d8-f2f2-4fff-b166-5aa362a458ee-kube-api-access-nmv45\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306168 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-socket-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306197 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7v4b\" (UniqueName: \"kubernetes.io/projected/27fad7c5-b805-4415-bfdd-b8502e19c39f-kube-api-access-t7v4b\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306227 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm72n\" (UniqueName: \"kubernetes.io/projected/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-kube-api-access-lm72n\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-var-lib-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306293 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-device-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-cni-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306345 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-os-release\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-ovn\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306413 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-cnibin\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjs9b\" (UniqueName: \"kubernetes.io/projected/ab00f649-48ff-4f23-8d9f-8571b60f6362-kube-api-access-bjs9b\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306509 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.306698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-system-cni-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306570 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-socket-dir-parent\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306596 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cnibin\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306663 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bl5\" (UniqueName: \"kubernetes.io/projected/003a1667-1793-4f5f-839d-74360856bff9-kube-api-access-27bl5\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab00f649-48ff-4f23-8d9f-8571b60f6362-cni-binary-copy\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306716 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-ovnkube-script-lib\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306746 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-systemd\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-cni-bin\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.307334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.306860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-cni-multus\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.307875 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.307482 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sq97\" (UniqueName: \"kubernetes.io/projected/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-kube-api-access-6sq97\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.307875 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.307531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hfj5\" (UniqueName: \"kubernetes.io/projected/b60b2614-7799-4979-b5bc-8a7ba4b49339-kube-api-access-2hfj5\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:23.307875 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.307574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-systemd-units\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.307875 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.307608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-ovnkube-config\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.325814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.325789 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:25:23.368842 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.368820 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lw56z" Jul 06 15:25:23.379487 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.379463 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lw56z" Jul 06 15:25:23.396753 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.396725 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 15:25:23.408125 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-registration-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.408125 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-slash\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-log-socket\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408195 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-daemon-config\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408220 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-host-slash\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408236 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-registration-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-var-lib-kubelet\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408271 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-k8s-cni-cncf-io\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408293 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408297 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-log-socket\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.408334 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408342 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d957d89f-d702-435d-87d4-a1263ead17ee-agent-certs\") pod \"konnectivity-agent-2wz9q\" (UID: \"d957d89f-d702-435d-87d4-a1263ead17ee\") " pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-node-log\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408406 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-run-ovn-kubernetes\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-iptables-alerter-script\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-sys\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408481 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-host-slash\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00deaac9-c8d8-42b6-a361-9e05e1d548e3-dbus\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/003a1667-1793-4f5f-839d-74360856bff9-ovn-node-metrics-cert\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408542 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-run-ovn-kubernetes\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408445 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-slash\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408599 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-k8s-cni-cncf-io\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408574 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-run\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.408823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408637 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqs9g\" (UniqueName: \"kubernetes.io/projected/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-kube-api-access-bqs9g\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408637 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45zbx\" (UniqueName: \"kubernetes.io/projected/9b24ce86-5171-4fa1-b009-9a3e0756d787-kube-api-access-45zbx\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-tmp-dir\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-netns\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408772 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-os-release\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00deaac9-c8d8-42b6-a361-9e05e1d548e3-kubelet-config\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408747 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-node-log\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-serviceca\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408820 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408838 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00deaac9-c8d8-42b6-a361-9e05e1d548e3-dbus\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-system-cni-dir\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408894 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-kubelet\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408942 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-kubelet\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.408971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-kubernetes\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.409470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409016 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysctl-d\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409021 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-os-release\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-sys-fs\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409071 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-system-cni-dir\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-run-netns\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409123 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00deaac9-c8d8-42b6-a361-9e05e1d548e3-kubelet-config\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409134 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-netns\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409141 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-daemon-config\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-env-overrides\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409194 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-sys-fs\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409213 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-hostroot\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409216 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-run-netns\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:23.410244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409283 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-serviceca\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409325 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-iptables-alerter-script\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409367 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysctl-conf\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409403 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-hostroot\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409442 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-host\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-host\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-cni-netd\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409552 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-cni-netd\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409590 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmv45\" (UniqueName: \"kubernetes.io/projected/dfe512d8-f2f2-4fff-b166-5aa362a458ee-kube-api-access-nmv45\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409678 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-env-overrides\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409707 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409708 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-socket-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7v4b\" (UniqueName: \"kubernetes.io/projected/27fad7c5-b805-4415-bfdd-b8502e19c39f-kube-api-access-t7v4b\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.410903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm72n\" (UniqueName: \"kubernetes.io/projected/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-kube-api-access-lm72n\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-var-lib-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409789 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-socket-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409812 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409820 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-var-lib-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409837 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-host\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-device-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-cni-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409907 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-os-release\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409932 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-device-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-modprobe-d\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409963 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-os-release\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.409994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-lib-modules\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410009 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-cni-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.411571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-ovn\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-cnibin\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjs9b\" (UniqueName: \"kubernetes.io/projected/ab00f649-48ff-4f23-8d9f-8571b60f6362-kube-api-access-bjs9b\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410081 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-tuned\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410091 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-ovn\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410115 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-cnibin\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410132 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410157 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-system-cni-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410179 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-socket-dir-parent\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.410193 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410256 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-system-cni-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b24ce86-5171-4fa1-b009-9a3e0756d787-tmp\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.410266 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret podName:00deaac9-c8d8-42b6-a361-9e05e1d548e3 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:23.910234606 +0000 UTC m=+3.006065978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret") pod "global-pull-secret-syncer-stmpf" (UID: "00deaac9-c8d8-42b6-a361-9e05e1d548e3") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:23.412266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410264 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-socket-dir-parent\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410327 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cnibin\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410378 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bl5\" (UniqueName: \"kubernetes.io/projected/003a1667-1793-4f5f-839d-74360856bff9-kube-api-access-27bl5\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.410416 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410427 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cnibin\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.410464 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:23.910449022 +0000 UTC m=+3.006280384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab00f649-48ff-4f23-8d9f-8571b60f6362-cni-binary-copy\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-systemd\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-ovnkube-script-lib\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-systemd\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-cni-bin\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410606 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-cni-multus\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sq97\" (UniqueName: \"kubernetes.io/projected/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-kube-api-access-6sq97\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.412814 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410639 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410655 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-hosts-file\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hfj5\" (UniqueName: \"kubernetes.io/projected/b60b2614-7799-4979-b5bc-8a7ba4b49339-kube-api-access-2hfj5\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410697 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-cni-bin\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-systemd-units\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-ovnkube-config\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410744 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-run-systemd\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-multus-certs\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d957d89f-d702-435d-87d4-a1263ead17ee-konnectivity-ca\") pod \"konnectivity-agent-2wz9q\" (UID: \"d957d89f-d702-435d-87d4-a1263ead17ee\") " pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410797 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-cni-multus\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410805 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-kubelet\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410854 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-etc-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410866 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab00f649-48ff-4f23-8d9f-8571b60f6362-cni-binary-copy\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-cni-bin\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.413459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-conf-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-etc-kubernetes\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysconfig\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.410996 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411089 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27fad7c5-b805-4415-bfdd-b8502e19c39f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411099 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-ovnkube-script-lib\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411090 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-multus-conf-dir\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411156 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-host-kubelet\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411161 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-etc-kubernetes\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411171 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-run-multus-certs\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411206 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab00f649-48ff-4f23-8d9f-8571b60f6362-host-var-lib-cni-bin\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411214 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-etc-openvswitch\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411259 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/003a1667-1793-4f5f-839d-74360856bff9-systemd-units\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411453 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/003a1667-1793-4f5f-839d-74360856bff9-ovnkube-config\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411579 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d957d89f-d702-435d-87d4-a1263ead17ee-konnectivity-ca\") pod \"konnectivity-agent-2wz9q\" (UID: \"d957d89f-d702-435d-87d4-a1263ead17ee\") " pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:23.414161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.411630 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfe512d8-f2f2-4fff-b166-5aa362a458ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.414908 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.412854 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/003a1667-1793-4f5f-839d-74360856bff9-ovn-node-metrics-cert\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.414908 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.412917 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d957d89f-d702-435d-87d4-a1263ead17ee-agent-certs\") pod \"konnectivity-agent-2wz9q\" (UID: \"d957d89f-d702-435d-87d4-a1263ead17ee\") " pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:23.439533 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.439023 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:23.439533 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.439135 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:23.439533 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.439151 2581 projected.go:196] Error preparing data for projected volume kube-api-access-m6p2p for pod openshift-network-diagnostics/network-check-target-8vxl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:23.439533 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.439240 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p podName:78177b4f-8184-422a-a971-a57e582e97fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:23.939210791 +0000 UTC m=+3.035042167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m6p2p" (UniqueName: "kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p") pod "network-check-target-8vxl9" (UID: "78177b4f-8184-422a-a971-a57e582e97fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:23.442496 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.440250 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjs9b\" (UniqueName: \"kubernetes.io/projected/ab00f649-48ff-4f23-8d9f-8571b60f6362-kube-api-access-bjs9b\") pod \"multus-qrgcs\" (UID: \"ab00f649-48ff-4f23-8d9f-8571b60f6362\") " pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.444935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.444813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" event={"ID":"283731ddec37e713b989291a87b04d51","Type":"ContainerStarted","Data":"ebc6d30d31b37cad322ffbd22b986fd34b79d21ecaf487038a802897c24b1460"} Jul 06 15:25:23.445277 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.445220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmv45\" (UniqueName: \"kubernetes.io/projected/dfe512d8-f2f2-4fff-b166-5aa362a458ee-kube-api-access-nmv45\") pod \"multus-additional-cni-plugins-bzdpx\" (UID: \"dfe512d8-f2f2-4fff-b166-5aa362a458ee\") " pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.446550 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.446486 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm72n\" (UniqueName: \"kubernetes.io/projected/b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25-kube-api-access-lm72n\") pod \"node-ca-vww7h\" (UID: \"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25\") " pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.446550 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.446535 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7v4b\" (UniqueName: \"kubernetes.io/projected/27fad7c5-b805-4415-bfdd-b8502e19c39f-kube-api-access-t7v4b\") pod \"aws-ebs-csi-driver-node-hj5zc\" (UID: \"27fad7c5-b805-4415-bfdd-b8502e19c39f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.447470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.447441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"2f2b1b985cd77d295beeb16e5b85c860","Type":"ContainerStarted","Data":"9c022cfe8365db37a8c9a875aec2b4dc82d63c6e5b49eb33379cec775d051295"} Jul 06 15:25:23.447858 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.447840 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bl5\" (UniqueName: \"kubernetes.io/projected/003a1667-1793-4f5f-839d-74360856bff9-kube-api-access-27bl5\") pod \"ovnkube-node-whv5v\" (UID: \"003a1667-1793-4f5f-839d-74360856bff9\") " pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.448105 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.448084 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hfj5\" (UniqueName: \"kubernetes.io/projected/b60b2614-7799-4979-b5bc-8a7ba4b49339-kube-api-access-2hfj5\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:23.449278 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.449263 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sq97\" (UniqueName: \"kubernetes.io/projected/bb9aee7e-1d32-4a84-9ee3-a87c73008c39-kube-api-access-6sq97\") pod \"iptables-alerter-55w9b\" (UID: \"bb9aee7e-1d32-4a84-9ee3-a87c73008c39\") " pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.511757 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511717 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-kubernetes\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.511757 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysctl-d\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysctl-conf\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-host\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-modprobe-d\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-kubernetes\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-lib-modules\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-tuned\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b24ce86-5171-4fa1-b009-9a3e0756d787-tmp\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511959 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysctl-d\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512002 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512002 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-lib-modules\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.511970 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-systemd\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512022 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-systemd\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-hosts-file\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512081 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysconfig\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-var-lib-kubelet\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-sys\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512135 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-host\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512156 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-run\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512192 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-run\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqs9g\" (UniqueName: \"kubernetes.io/projected/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-kube-api-access-bqs9g\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512227 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45zbx\" (UniqueName: \"kubernetes.io/projected/9b24ce86-5171-4fa1-b009-9a3e0756d787-kube-api-access-45zbx\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512253 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-tmp-dir\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512272 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysconfig\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512292 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-sys\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.512420 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512247 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-sysctl-conf\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.513163 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512345 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-var-lib-kubelet\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.513163 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512368 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-modprobe-d\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.513163 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512391 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-hosts-file\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.513163 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.512679 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-tmp-dir\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.514763 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.514724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9b24ce86-5171-4fa1-b009-9a3e0756d787-etc-tuned\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.514861 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.514790 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9b24ce86-5171-4fa1-b009-9a3e0756d787-tmp\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.532183 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.532092 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqs9g\" (UniqueName: \"kubernetes.io/projected/4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88-kube-api-access-bqs9g\") pod \"node-resolver-646k2\" (UID: \"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88\") " pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.532346 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.532326 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45zbx\" (UniqueName: \"kubernetes.io/projected/9b24ce86-5171-4fa1-b009-9a3e0756d787-kube-api-access-45zbx\") pod \"tuned-72b5v\" (UID: \"9b24ce86-5171-4fa1-b009-9a3e0756d787\") " pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.596130 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.596086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:23.603017 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.602991 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vww7h" Jul 06 15:25:23.612090 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.612062 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qrgcs" Jul 06 15:25:23.619915 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.619879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-55w9b" Jul 06 15:25:23.627662 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.627641 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:23.636497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.636471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" Jul 06 15:25:23.643157 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.643131 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" Jul 06 15:25:23.653847 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.653821 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-72b5v" Jul 06 15:25:23.658634 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.658610 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-646k2" Jul 06 15:25:23.787321 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.787254 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:23.915646 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.915611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:23.915816 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:23.915654 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:23.915816 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.915746 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:23.915895 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.915758 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:23.915895 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.915840 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret podName:00deaac9-c8d8-42b6-a361-9e05e1d548e3 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:24.915810999 +0000 UTC m=+4.011642373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret") pod "global-pull-secret-syncer-stmpf" (UID: "00deaac9-c8d8-42b6-a361-9e05e1d548e3") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:23.915976 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:23.915904 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:24.915889322 +0000 UTC m=+4.011720680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:24.016929 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.016895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:24.017101 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.017066 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:24.017101 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.017086 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:24.017101 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.017096 2581 projected.go:196] Error preparing data for projected volume kube-api-access-m6p2p for pod openshift-network-diagnostics/network-check-target-8vxl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:24.017264 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.017152 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p podName:78177b4f-8184-422a-a971-a57e582e97fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:25.017137757 +0000 UTC m=+4.112969124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6p2p" (UniqueName: "kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p") pod "network-check-target-8vxl9" (UID: "78177b4f-8184-422a-a971-a57e582e97fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:24.382113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.382061 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:20:23 +0000 UTC" deadline="2028-04-03 12:09:23.509338404 +0000 UTC" Jul 06 15:25:24.382113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.382104 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15284h43m59.127238945s" Jul 06 15:25:24.435328 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.435305 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:24.435328 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.435321 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:24.435457 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.435419 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:24.435586 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.435564 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:24.444072 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:24.443967 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003a1667_1793_4f5f_839d_74360856bff9.slice/crio-da2f1570f5f0b5710cd39c9836c78457dbd21e9864832456e64df07cd636fd91 WatchSource:0}: Error finding container da2f1570f5f0b5710cd39c9836c78457dbd21e9864832456e64df07cd636fd91: Status 404 returned error can't find the container with id da2f1570f5f0b5710cd39c9836c78457dbd21e9864832456e64df07cd636fd91 Jul 06 15:25:24.446498 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:24.446467 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc38ba1_8cc5_4083_a2e5_a7ff17a6bd88.slice/crio-40a0f58c14b288bd9793027003570f43bffec74b95b21776c27d50d651486f2b WatchSource:0}: Error finding container 40a0f58c14b288bd9793027003570f43bffec74b95b21776c27d50d651486f2b: Status 404 returned error can't find the container with id 40a0f58c14b288bd9793027003570f43bffec74b95b21776c27d50d651486f2b Jul 06 15:25:24.449685 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:24.449610 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9aee7e_1d32_4a84_9ee3_a87c73008c39.slice/crio-93898ad5aa66166b78c33e2b4152c206b7c67833e37289dfbd9089614d07bcc3 WatchSource:0}: Error finding container 93898ad5aa66166b78c33e2b4152c206b7c67833e37289dfbd9089614d07bcc3: Status 404 returned error can't find the container with id 93898ad5aa66166b78c33e2b4152c206b7c67833e37289dfbd9089614d07bcc3 Jul 06 15:25:24.450222 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.450124 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"da2f1570f5f0b5710cd39c9836c78457dbd21e9864832456e64df07cd636fd91"} Jul 06 15:25:24.450911 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:24.450883 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b24ce86_5171_4fa1_b009_9a3e0756d787.slice/crio-2d93b1762afa0dfb8b40dd19eea6a6b99b79ea2eb8a34c17f2d89cab2cbfbc4d WatchSource:0}: Error finding container 2d93b1762afa0dfb8b40dd19eea6a6b99b79ea2eb8a34c17f2d89cab2cbfbc4d: Status 404 returned error can't find the container with id 2d93b1762afa0dfb8b40dd19eea6a6b99b79ea2eb8a34c17f2d89cab2cbfbc4d Jul 06 15:25:24.451315 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.451278 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-646k2" event={"ID":"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88","Type":"ContainerStarted","Data":"40a0f58c14b288bd9793027003570f43bffec74b95b21776c27d50d651486f2b"} Jul 06 15:25:24.923222 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.922892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:24.923222 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.923184 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:24.923418 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.923248 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:24.923418 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.923253 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret podName:00deaac9-c8d8-42b6-a361-9e05e1d548e3 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:26.923234474 +0000 UTC m=+6.019065847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret") pod "global-pull-secret-syncer-stmpf" (UID: "00deaac9-c8d8-42b6-a361-9e05e1d548e3") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:24.923418 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:24.923281 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:26.923271416 +0000 UTC m=+6.019102791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:24.923418 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.923187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:24.960141 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:24.960109 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:25.023919 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.023814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:25.024129 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:25.024070 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:25.024129 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:25.024096 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:25.024129 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:25.024109 2581 projected.go:196] Error preparing data for projected volume kube-api-access-m6p2p for pod openshift-network-diagnostics/network-check-target-8vxl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:25.024289 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:25.024185 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p podName:78177b4f-8184-422a-a971-a57e582e97fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:27.024166856 +0000 UTC m=+6.119998220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6p2p" (UniqueName: "kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p") pod "network-check-target-8vxl9" (UID: "78177b4f-8184-422a-a971-a57e582e97fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:25.383096 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.382974 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:20:23 +0000 UTC" deadline="2028-03-14 17:32:55.700798898 +0000 UTC" Jul 06 15:25:25.383096 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.383045 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14810h7m30.317757613s" Jul 06 15:25:25.436296 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.436267 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:25.436459 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:25.436401 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:25.470273 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.470234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qrgcs" event={"ID":"ab00f649-48ff-4f23-8d9f-8571b60f6362","Type":"ContainerStarted","Data":"ed05d8cd391fbd5eef196a211b588f272f252b126836c1981c624c16890fe206"} Jul 06 15:25:25.475915 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.475843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" event={"ID":"283731ddec37e713b989291a87b04d51","Type":"ContainerStarted","Data":"a471bc061fa4137cdc4dbdb6ef05328b508021cb7709ebedb77b554716a4047c"} Jul 06 15:25:25.488363 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.488200 2581 generic.go:356] "Generic (PLEG): container finished" podID="2f2b1b985cd77d295beeb16e5b85c860" containerID="add733475605de8ea75b6d86c8315b82212b2fb72d23d13bd7cbe5fb80feb551" exitCode=0 Jul 06 15:25:25.488363 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.488293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"2f2b1b985cd77d295beeb16e5b85c860","Type":"ContainerDied","Data":"add733475605de8ea75b6d86c8315b82212b2fb72d23d13bd7cbe5fb80feb551"} Jul 06 15:25:25.508793 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.508740 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-72b5v" event={"ID":"9b24ce86-5171-4fa1-b009-9a3e0756d787","Type":"ContainerStarted","Data":"2d93b1762afa0dfb8b40dd19eea6a6b99b79ea2eb8a34c17f2d89cab2cbfbc4d"} Jul 06 15:25:25.518755 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.518705 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-165.ec2.internal" podStartSLOduration=3.518683856 podStartE2EDuration="3.518683856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:25.495851012 +0000 UTC m=+4.591682392" watchObservedRunningTime="2026-07-06 15:25:25.518683856 +0000 UTC m=+4.614515237" Jul 06 15:25:25.526115 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.526067 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" event={"ID":"27fad7c5-b805-4415-bfdd-b8502e19c39f","Type":"ContainerStarted","Data":"a00b7e3a79ee46b9a21daab07679ae3c45bc7e0d00f7aa448383df7698b28595"} Jul 06 15:25:25.545599 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.545501 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2wz9q" event={"ID":"d957d89f-d702-435d-87d4-a1263ead17ee","Type":"ContainerStarted","Data":"2e9fa627eae9e0aa7686fa4ceb01ea45e7d995e8cf3219839da58e5daf5adf98"} Jul 06 15:25:25.558532 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.558445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-55w9b" event={"ID":"bb9aee7e-1d32-4a84-9ee3-a87c73008c39","Type":"ContainerStarted","Data":"93898ad5aa66166b78c33e2b4152c206b7c67833e37289dfbd9089614d07bcc3"} Jul 06 15:25:25.575779 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.575630 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vww7h" event={"ID":"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25","Type":"ContainerStarted","Data":"e519ec51b44725654f1102bc98562a8fbd50ad8ade21908e0fb4317dc194ff2a"} Jul 06 15:25:25.587277 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:25.587239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerStarted","Data":"e155d087540ef826032f370ad89594e87d6d2c40cc373ebf13543f3c32d8d457"} Jul 06 15:25:26.435465 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:26.434686 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:26.435465 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:26.434831 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:26.435465 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:26.434957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:26.435465 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:26.435070 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:26.606546 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:26.606474 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" event={"ID":"2f2b1b985cd77d295beeb16e5b85c860","Type":"ContainerStarted","Data":"4d64216c9a9b996fdf05c5e975354ca4cea649980c2b34efd462d0f7a4f60099"} Jul 06 15:25:26.941566 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:26.941522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:26.941566 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:26.941569 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:26.941809 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:26.941727 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:26.941809 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:26.941786 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:30.941768017 +0000 UTC m=+10.037599389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:26.942211 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:26.942190 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:26.942327 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:26.942243 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret podName:00deaac9-c8d8-42b6-a361-9e05e1d548e3 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:30.942230525 +0000 UTC m=+10.038061895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret") pod "global-pull-secret-syncer-stmpf" (UID: "00deaac9-c8d8-42b6-a361-9e05e1d548e3") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:27.042369 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:27.042329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:27.042557 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:27.042492 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:27.042557 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:27.042512 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:27.042557 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:27.042523 2581 projected.go:196] Error preparing data for projected volume kube-api-access-m6p2p for pod openshift-network-diagnostics/network-check-target-8vxl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:27.042723 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:27.042583 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p podName:78177b4f-8184-422a-a971-a57e582e97fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:31.042564423 +0000 UTC m=+10.138395794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6p2p" (UniqueName: "kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p") pod "network-check-target-8vxl9" (UID: "78177b4f-8184-422a-a971-a57e582e97fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:27.437431 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:27.436867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:27.437431 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:27.437022 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:28.435693 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:28.435185 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:28.435693 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:28.435322 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:28.435693 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:28.435373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:28.435693 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:28.435497 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:29.435848 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:29.435814 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:29.436403 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:29.435955 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:30.434876 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:30.434841 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:30.435075 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:30.435000 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:30.435419 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:30.435379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:30.435550 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:30.435484 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:30.975298 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:30.975122 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:30.975298 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:30.975172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:30.975298 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:30.975278 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:30.975850 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:30.975338 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret podName:00deaac9-c8d8-42b6-a361-9e05e1d548e3 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:38.975320031 +0000 UTC m=+18.071151392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret") pod "global-pull-secret-syncer-stmpf" (UID: "00deaac9-c8d8-42b6-a361-9e05e1d548e3") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:30.975850 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:30.975278 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:30.975850 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:30.975697 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:38.97568044 +0000 UTC m=+18.071511811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:31.076514 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:31.076479 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:31.076711 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:31.076685 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:31.076779 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:31.076717 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:31.076779 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:31.076732 2581 projected.go:196] Error preparing data for projected volume kube-api-access-m6p2p for pod openshift-network-diagnostics/network-check-target-8vxl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:31.076877 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:31.076801 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p podName:78177b4f-8184-422a-a971-a57e582e97fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:39.076780179 +0000 UTC m=+18.172611549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6p2p" (UniqueName: "kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p") pod "network-check-target-8vxl9" (UID: "78177b4f-8184-422a-a971-a57e582e97fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:31.435492 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:31.435411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:31.435632 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:31.435516 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:32.434849 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:32.434816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:32.435350 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:32.434954 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:32.435350 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:32.435006 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:32.435350 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:32.435118 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:33.435560 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:33.435526 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:33.435962 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:33.435640 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:34.434901 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:34.434872 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:34.434901 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:34.434897 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:34.435121 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:34.435031 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:34.435435 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:34.435409 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:35.435119 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.434894 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:35.435571 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:35.435228 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:35.624565 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.624514 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-72b5v" event={"ID":"9b24ce86-5171-4fa1-b009-9a3e0756d787","Type":"ContainerStarted","Data":"6d25d4abdc3e206419e8e7d1d6d00a3c29ff694ee3177d4412ba592a4a626370"} Jul 06 15:25:35.626480 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.626455 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" event={"ID":"27fad7c5-b805-4415-bfdd-b8502e19c39f","Type":"ContainerStarted","Data":"bf0aae7b73efa948ceb1a3b89d9a85c24a3da30356e1e444dda5781ddbaf24da"} Jul 06 15:25:35.628966 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.628940 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2wz9q" event={"ID":"d957d89f-d702-435d-87d4-a1263ead17ee","Type":"ContainerStarted","Data":"b53aab878fe9d274431e2a91c49aec745539f68360dfbb772b28016b34fe7bc2"} Jul 06 15:25:35.631014 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.630971 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-646k2" event={"ID":"4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88","Type":"ContainerStarted","Data":"ac16d797cc5cc23d8c6847f43c459870e389552d57ca4dac3965e8568099ab3c"} Jul 06 15:25:35.633031 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.633006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vww7h" event={"ID":"b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25","Type":"ContainerStarted","Data":"960d92a622a272ae2ab4bce98fa1b72e09ae0ea34ce9d2bfba6c7cef488557e6"} Jul 06 15:25:35.635756 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.635678 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfe512d8-f2f2-4fff-b166-5aa362a458ee" containerID="d7a50ae3d54467457a364bfafe6a678c7534c163ecd6f33d4c3b47f918f4fac9" exitCode=0 Jul 06 15:25:35.635756 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.635716 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerDied","Data":"d7a50ae3d54467457a364bfafe6a678c7534c163ecd6f33d4c3b47f918f4fac9"} Jul 06 15:25:35.647822 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.647233 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-165.ec2.internal" podStartSLOduration=13.647216179 podStartE2EDuration="13.647216179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:26.626449593 +0000 UTC m=+5.722280974" watchObservedRunningTime="2026-07-06 15:25:35.647216179 +0000 UTC m=+14.743047559" Jul 06 15:25:35.673636 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.673576 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-72b5v" podStartSLOduration=4.461590122 podStartE2EDuration="14.673556927s" totalImagesPullingTime="10.211966805s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:35.647061878 +0000 UTC m=+14.742893257" watchObservedRunningTime="2026-07-06 15:25:35.673556927 +0000 UTC m=+14.769388310" Jul 06 15:25:35.673813 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.673783 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vww7h" podStartSLOduration=4.484897266 podStartE2EDuration="14.673773682s" totalImagesPullingTime="10.188876416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:35.672506692 +0000 UTC m=+14.768338074" watchObservedRunningTime="2026-07-06 15:25:35.673773682 +0000 UTC m=+14.769605062" Jul 06 15:25:35.698282 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:35.698220 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2wz9q" podStartSLOduration=4.71448053 podStartE2EDuration="14.698203703s" totalImagesPullingTime="9.983723173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:35.697721879 +0000 UTC m=+14.793553256" watchObservedRunningTime="2026-07-06 15:25:35.698203703 +0000 UTC m=+14.794035085" Jul 06 15:25:36.434880 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:36.434794 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:36.435067 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:36.434810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:36.435067 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:36.434933 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:36.435067 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:36.434964 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:36.639519 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:36.639449 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-55w9b" event={"ID":"bb9aee7e-1d32-4a84-9ee3-a87c73008c39","Type":"ContainerStarted","Data":"cfb746d38fab411161544b48396f6c3c6f5269bdc840ca0af5e27882049f256e"} Jul 06 15:25:36.665010 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:36.664936 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-646k2" podStartSLOduration=5.469542388 podStartE2EDuration="15.664914035s" totalImagesPullingTime="10.195371647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:35.793778781 +0000 UTC m=+14.889610160" watchObservedRunningTime="2026-07-06 15:25:36.664914035 +0000 UTC m=+15.760745430" Jul 06 15:25:36.665517 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:36.665482 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-55w9b" podStartSLOduration=5.474766085 podStartE2EDuration="15.665468956s" totalImagesPullingTime="10.190702871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:36.664910154 +0000 UTC m=+15.760741536" watchObservedRunningTime="2026-07-06 15:25:36.665468956 +0000 UTC m=+15.761300338" Jul 06 15:25:37.435217 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:37.435182 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:37.435720 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:37.435318 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:38.434958 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:38.434925 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:38.434958 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:38.434954 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:38.435249 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:38.435072 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:38.435249 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:38.435174 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:38.730177 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:38.730103 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:38.730748 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:38.730726 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:39.046227 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:39.046133 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:39.046227 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:39.046185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:39.046443 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.046321 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:39.046443 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.046335 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:39.046443 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.046390 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret podName:00deaac9-c8d8-42b6-a361-9e05e1d548e3 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:55.046375026 +0000 UTC m=+34.142206383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret") pod "global-pull-secret-syncer-stmpf" (UID: "00deaac9-c8d8-42b6-a361-9e05e1d548e3") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:39.046443 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.046414 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:55.046400201 +0000 UTC m=+34.142231558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:39.146886 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:39.146851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:39.147079 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.147049 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:39.147079 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.147070 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:39.147079 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.147079 2581 projected.go:196] Error preparing data for projected volume kube-api-access-m6p2p for pod openshift-network-diagnostics/network-check-target-8vxl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:39.147185 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.147136 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p podName:78177b4f-8184-422a-a971-a57e582e97fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:55.147118211 +0000 UTC m=+34.242949574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6p2p" (UniqueName: "kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p") pod "network-check-target-8vxl9" (UID: "78177b4f-8184-422a-a971-a57e582e97fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:39.434750 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:39.434674 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:39.434904 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:39.434780 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:40.435174 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:40.435146 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:40.435973 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:40.435143 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:40.435973 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:40.435255 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:40.435973 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:40.435325 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:41.435594 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:41.435560 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:41.436080 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:41.435675 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:42.434611 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:42.434572 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:42.434783 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:42.434587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:42.434783 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:42.434702 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:42.434866 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:42.434819 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:43.434578 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:43.434546 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:43.435079 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:43.434672 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:43.692180 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:43.692109 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:43.692340 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:43.692227 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 15:25:43.693039 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:43.693012 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2wz9q" Jul 06 15:25:43.978536 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:43.978152 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 15:25:44.393839 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.393596 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T15:25:43.978381913Z","UUID":"ec5ceaef-86a8-4134-8d52-37528fda96ba","Handler":null,"Name":"","Endpoint":""} Jul 06 15:25:44.395394 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.395375 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 15:25:44.395506 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.395415 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 15:25:44.435030 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.435000 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:44.435030 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.435027 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:44.435540 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:44.435175 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:44.435540 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:44.435263 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:44.659419 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.659339 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" event={"ID":"27fad7c5-b805-4415-bfdd-b8502e19c39f","Type":"ContainerStarted","Data":"fa68740439f45fefa690893f615fb3f434f343bfeb9c20665950553cd56380be"} Jul 06 15:25:44.662667 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.662640 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"35bc0117490887d1364923c943be13d5fe1ebb712d316ddc03917f2577f891e6"} Jul 06 15:25:44.662803 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.662723 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"c612dfe94e9ff48723ce0737a451bcb37f2e95769d5cb410a2ad764f208539da"} Jul 06 15:25:44.662803 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.662779 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"c806b31c59a455df58d261bce4973d33ad279b9014aea6002c8dbd96db939069"} Jul 06 15:25:44.662911 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.662813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"6c0557734a369bae5925e7410df2a7dc87e48e2fc3e6654ded90bf0d9b04df05"} Jul 06 15:25:44.662911 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.662855 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"4ed6a97a856faa115773ac36af1716a256d795f90aebeea509c35f80baaa8448"} Jul 06 15:25:44.662911 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.662903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"2992bfec939115e7e6bb411ed407f2e5152459e838611f53904e5d3b3833c8b4"} Jul 06 15:25:44.664274 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.664242 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qrgcs" event={"ID":"ab00f649-48ff-4f23-8d9f-8571b60f6362","Type":"ContainerStarted","Data":"48e5674ca88d5949235c0ebe2486b4306195729984187607272fd479ab0812e2"} Jul 06 15:25:44.688799 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:44.688744 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qrgcs" podStartSLOduration=4.235970326 podStartE2EDuration="23.688728643s" totalImagesPullingTime="19.452758317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:44.688389221 +0000 UTC m=+23.784220600" watchObservedRunningTime="2026-07-06 15:25:44.688728643 +0000 UTC m=+23.784560022" Jul 06 15:25:45.434935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:45.434843 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:45.435158 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:45.435009 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:45.669513 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:45.669476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" event={"ID":"27fad7c5-b805-4415-bfdd-b8502e19c39f","Type":"ContainerStarted","Data":"367ecad0b319119f13b6382f36bfc28fbca21223a3b0c90bc1ec45bd28b3321d"} Jul 06 15:25:45.693878 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:45.693778 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hj5zc" podStartSLOduration=4.44001322 podStartE2EDuration="24.693763352s" totalImagesPullingTime="20.253750132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:45.69331435 +0000 UTC m=+24.789145730" watchObservedRunningTime="2026-07-06 15:25:45.693763352 +0000 UTC m=+24.789594731" Jul 06 15:25:46.434437 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:46.434414 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:46.434539 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:46.434509 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:46.434579 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:46.434541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:46.434612 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:46.434584 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:46.679322 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:46.679243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"44f2c7a55d3b287ed122ef68a6d87e5c430174aafddb838d0c7546fd85ba884d"} Jul 06 15:25:47.438416 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:47.438388 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:47.438590 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:47.438494 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:48.434941 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:48.434906 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:48.435354 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:48.435043 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:48.435354 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:48.435097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:48.435354 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:48.435207 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:49.435489 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:49.435242 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:49.436008 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:49.435514 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:49.689802 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:49.689690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" event={"ID":"003a1667-1793-4f5f-839d-74360856bff9","Type":"ContainerStarted","Data":"17cc47f99ac8b7aa1aa085366d3a02d6c9e42ef8b04ca884e82883a4795e1985"} Jul 06 15:25:49.689973 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:49.689952 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:49.691676 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:49.691641 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerStarted","Data":"dca747eddf88306c000d959fa673c0753fdf3c346c6d5536c962e92ca61b612f"} Jul 06 15:25:49.705773 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:49.705747 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:49.726859 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:49.726815 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" podStartSLOduration=9.250303553 podStartE2EDuration="28.726799641s" totalImagesPullingTime="19.476496088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:49.726306509 +0000 UTC m=+28.822137888" watchObservedRunningTime="2026-07-06 15:25:49.726799641 +0000 UTC m=+28.822631066" Jul 06 15:25:50.435491 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:50.435454 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:50.435491 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:50.435489 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:50.436012 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:50.435568 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:50.436012 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:50.435656 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:50.696284 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:50.696200 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfe512d8-f2f2-4fff-b166-5aa362a458ee" containerID="dca747eddf88306c000d959fa673c0753fdf3c346c6d5536c962e92ca61b612f" exitCode=0 Jul 06 15:25:50.696449 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:50.696285 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerDied","Data":"dca747eddf88306c000d959fa673c0753fdf3c346c6d5536c962e92ca61b612f"} Jul 06 15:25:50.696887 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:50.696841 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:50.697024 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:50.696911 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:50.712557 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:50.712533 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:25:51.441039 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:51.441010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:51.441504 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:51.441140 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:51.718697 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:51.718614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-stmpf"] Jul 06 15:25:51.718855 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:51.718717 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:51.718855 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:51.718817 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:51.723565 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:51.723537 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9vcwr"] Jul 06 15:25:51.723698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:51.723645 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:51.723739 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:51.723722 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:51.735343 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:51.735314 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vxl9"] Jul 06 15:25:51.735482 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:51.735425 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:51.735549 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:51.735515 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:52.702784 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:52.702748 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfe512d8-f2f2-4fff-b166-5aa362a458ee" containerID="9a46438ee0808316abcbc2a412bbb03e39c2c2d577fe8b6dbe7b2078536cce4c" exitCode=0 Jul 06 15:25:52.703148 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:52.702798 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerDied","Data":"9a46438ee0808316abcbc2a412bbb03e39c2c2d577fe8b6dbe7b2078536cce4c"} Jul 06 15:25:53.434742 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:53.434587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:53.434873 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:53.434587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:53.434873 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:53.434825 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:53.434949 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:53.434925 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:53.435004 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:53.434587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:53.435059 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:53.435040 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:53.707565 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:53.707477 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfe512d8-f2f2-4fff-b166-5aa362a458ee" containerID="cf25b6ad7f4df60fb398b4ae005e5fd84899b47f694886bff7327314b4574f61" exitCode=0 Jul 06 15:25:53.707565 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:53.707526 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerDied","Data":"cf25b6ad7f4df60fb398b4ae005e5fd84899b47f694886bff7327314b4574f61"} Jul 06 15:25:55.062473 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:55.062433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:55.062473 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:55.062478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:55.062914 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.062594 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:55.062914 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.062600 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:55.062914 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.062661 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:27.062641938 +0000 UTC m=+66.158473299 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:55.062914 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.062681 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret podName:00deaac9-c8d8-42b6-a361-9e05e1d548e3 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:27.062671327 +0000 UTC m=+66.158502688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret") pod "global-pull-secret-syncer-stmpf" (UID: "00deaac9-c8d8-42b6-a361-9e05e1d548e3") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:55.163426 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:55.163389 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:55.163614 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.163594 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:55.163678 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.163624 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:55.163678 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.163636 2581 projected.go:196] Error preparing data for projected volume kube-api-access-m6p2p for pod openshift-network-diagnostics/network-check-target-8vxl9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:55.163756 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.163697 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p podName:78177b4f-8184-422a-a971-a57e582e97fe nodeName:}" failed. No retries permitted until 2026-07-06 15:26:27.163680135 +0000 UTC m=+66.259511492 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m6p2p" (UniqueName: "kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p") pod "network-check-target-8vxl9" (UID: "78177b4f-8184-422a-a971-a57e582e97fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:55.437386 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:55.437359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:55.437563 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:55.437446 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:55.437563 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.437452 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-stmpf" podUID="00deaac9-c8d8-42b6-a361-9e05e1d548e3" Jul 06 15:25:55.437563 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:55.437471 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:55.437563 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.437546 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:25:55.437714 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:55.437597 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vxl9" podUID="78177b4f-8184-422a-a971-a57e582e97fe" Jul 06 15:25:56.699504 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.699470 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-165.ec2.internal" event="NodeReady" Jul 06 15:25:56.699881 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.699631 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 15:25:56.746375 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.746343 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bfb7bf96-j7csf"] Jul 06 15:25:56.748331 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.748309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.752288 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.752197 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 15:25:56.752587 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.752554 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 15:25:56.752823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.752806 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-thfjf\"" Jul 06 15:25:56.753209 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.753190 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 15:25:56.760909 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.760880 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 15:25:56.764410 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.764390 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bfb7bf96-j7csf"] Jul 06 15:25:56.766652 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.766629 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kvqkg"] Jul 06 15:25:56.768752 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.768735 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xbqcf"] Jul 06 15:25:56.768890 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.768870 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.770463 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.770443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xbqcf" Jul 06 15:25:56.771741 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.771715 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 15:25:56.771847 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.771805 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 15:25:56.771847 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.771816 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqdbx\"" Jul 06 15:25:56.774674 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.774650 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 15:25:56.774785 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.774768 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zx7x2\"" Jul 06 15:25:56.774889 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.774873 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 15:25:56.775114 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.775094 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 15:25:56.782212 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.782192 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kvqkg"] Jul 06 15:25:56.782896 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.782878 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xbqcf"] Jul 06 15:25:56.875371 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/460cdb11-647b-45d1-b721-a041f17ec6e7-tmp-dir\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.875371 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875375 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89a714bd-78be-4e15-b041-4898e9b8ae5c-cert\") pod \"ingress-canary-xbqcf\" (UID: \"89a714bd-78be-4e15-b041-4898e9b8ae5c\") " pod="openshift-ingress-canary/ingress-canary-xbqcf" Jul 06 15:25:56.875608 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875408 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdm2w\" (UniqueName: \"kubernetes.io/projected/89a714bd-78be-4e15-b041-4898e9b8ae5c-kube-api-access-kdm2w\") pod \"ingress-canary-xbqcf\" (UID: \"89a714bd-78be-4e15-b041-4898e9b8ae5c\") " pod="openshift-ingress-canary/ingress-canary-xbqcf" Jul 06 15:25:56.875608 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875456 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.875608 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6fb2051-9202-41d8-b4fa-ffd24b691cab-ca-trust-extracted\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.875608 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnjck\" (UniqueName: \"kubernetes.io/projected/460cdb11-647b-45d1-b721-a041f17ec6e7-kube-api-access-cnjck\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.875780 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-image-registry-private-configuration\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.875780 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-trusted-ca\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.875780 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-installation-pull-secrets\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.875780 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875720 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/460cdb11-647b-45d1-b721-a041f17ec6e7-config-volume\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.875780 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-certificates\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.875949 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-bound-sa-token\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.875949 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.875949 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.875882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4glv\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-kube-api-access-r4glv\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.927230 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.927188 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:25:56.977175 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977099 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/460cdb11-647b-45d1-b721-a041f17ec6e7-config-volume\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.977175 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977139 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-certificates\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.977175 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977165 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-bound-sa-token\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.977404 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977190 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.977404 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:56.977293 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:25:56.977404 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:56.977353 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls podName:460cdb11-647b-45d1-b721-a041f17ec6e7 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:57.477333453 +0000 UTC m=+36.573164811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls") pod "dns-default-kvqkg" (UID: "460cdb11-647b-45d1-b721-a041f17ec6e7") : secret "dns-default-metrics-tls" not found Jul 06 15:25:56.977557 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4glv\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-kube-api-access-r4glv\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.977557 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/460cdb11-647b-45d1-b721-a041f17ec6e7-tmp-dir\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.977557 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977516 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89a714bd-78be-4e15-b041-4898e9b8ae5c-cert\") pod \"ingress-canary-xbqcf\" (UID: \"89a714bd-78be-4e15-b041-4898e9b8ae5c\") " pod="openshift-ingress-canary/ingress-canary-xbqcf" Jul 06 15:25:56.977694 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdm2w\" (UniqueName: \"kubernetes.io/projected/89a714bd-78be-4e15-b041-4898e9b8ae5c-kube-api-access-kdm2w\") pod \"ingress-canary-xbqcf\" (UID: \"89a714bd-78be-4e15-b041-4898e9b8ae5c\") " pod="openshift-ingress-canary/ingress-canary-xbqcf" Jul 06 15:25:56.977750 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.977750 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977720 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6fb2051-9202-41d8-b4fa-ffd24b691cab-ca-trust-extracted\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.977750 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977745 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnjck\" (UniqueName: \"kubernetes.io/projected/460cdb11-647b-45d1-b721-a041f17ec6e7-kube-api-access-cnjck\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.977894 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-image-registry-private-configuration\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.977894 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977795 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/460cdb11-647b-45d1-b721-a041f17ec6e7-config-volume\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.977894 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977817 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-certificates\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.977894 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-trusted-ca\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.977894 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977839 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/460cdb11-647b-45d1-b721-a041f17ec6e7-tmp-dir\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:56.977894 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.977853 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-installation-pull-secrets\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.978286 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:56.977905 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:25:56.978286 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:56.977917 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfb7bf96-j7csf: secret "image-registry-tls" not found Jul 06 15:25:56.978286 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:56.977973 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls podName:e6fb2051-9202-41d8-b4fa-ffd24b691cab nodeName:}" failed. No retries permitted until 2026-07-06 15:25:57.477955277 +0000 UTC m=+36.573786648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls") pod "image-registry-7bfb7bf96-j7csf" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab") : secret "image-registry-tls" not found Jul 06 15:25:56.978286 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.978111 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6fb2051-9202-41d8-b4fa-ffd24b691cab-ca-trust-extracted\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.978741 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.978719 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-trusted-ca\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.981816 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.981791 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-image-registry-private-configuration\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.981921 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.981818 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-installation-pull-secrets\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.981997 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.981945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89a714bd-78be-4e15-b041-4898e9b8ae5c-cert\") pod \"ingress-canary-xbqcf\" (UID: \"89a714bd-78be-4e15-b041-4898e9b8ae5c\") " pod="openshift-ingress-canary/ingress-canary-xbqcf" Jul 06 15:25:56.994412 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.994388 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4glv\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-kube-api-access-r4glv\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.994537 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.994385 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdm2w\" (UniqueName: \"kubernetes.io/projected/89a714bd-78be-4e15-b041-4898e9b8ae5c-kube-api-access-kdm2w\") pod \"ingress-canary-xbqcf\" (UID: \"89a714bd-78be-4e15-b041-4898e9b8ae5c\") " pod="openshift-ingress-canary/ingress-canary-xbqcf" Jul 06 15:25:56.994537 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.994496 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-bound-sa-token\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:56.994642 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:56.994571 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnjck\" (UniqueName: \"kubernetes.io/projected/460cdb11-647b-45d1-b721-a041f17ec6e7-kube-api-access-cnjck\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:57.020421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.020386 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:25:57.087429 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.087390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xbqcf" Jul 06 15:25:57.435285 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.435249 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:25:57.435470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.435290 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:25:57.435470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.435246 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:25:57.439718 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.439693 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:25:57.439718 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.439714 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:25:57.439718 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.439726 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:25:57.439967 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.439738 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86nh7\"" Jul 06 15:25:57.439967 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.439693 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pn58n\"" Jul 06 15:25:57.439967 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.439718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:25:57.480795 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.480762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:57.480959 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:57.480829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:57.480959 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:57.480929 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:25:57.481100 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:57.480934 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:25:57.481100 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:57.481031 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfb7bf96-j7csf: secret "image-registry-tls" not found Jul 06 15:25:57.481100 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:57.481020 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls podName:460cdb11-647b-45d1-b721-a041f17ec6e7 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:58.480999244 +0000 UTC m=+37.576830602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls") pod "dns-default-kvqkg" (UID: "460cdb11-647b-45d1-b721-a041f17ec6e7") : secret "dns-default-metrics-tls" not found Jul 06 15:25:57.481100 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:57.481079 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls podName:e6fb2051-9202-41d8-b4fa-ffd24b691cab nodeName:}" failed. No retries permitted until 2026-07-06 15:25:58.481064508 +0000 UTC m=+37.576895865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls") pod "image-registry-7bfb7bf96-j7csf" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab") : secret "image-registry-tls" not found Jul 06 15:25:58.417082 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:58.416855 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xbqcf"] Jul 06 15:25:58.419706 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:25:58.419677 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a714bd_78be_4e15_b041_4898e9b8ae5c.slice/crio-3ba5c9ebe6eb8ad6d7f029f4010874f236e7e966380ab07de8ccfab87446e242 WatchSource:0}: Error finding container 3ba5c9ebe6eb8ad6d7f029f4010874f236e7e966380ab07de8ccfab87446e242: Status 404 returned error can't find the container with id 3ba5c9ebe6eb8ad6d7f029f4010874f236e7e966380ab07de8ccfab87446e242 Jul 06 15:25:58.490025 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:58.489974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:25:58.490162 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:58.490054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:25:58.490233 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:58.490153 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:25:58.490233 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:58.490180 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfb7bf96-j7csf: secret "image-registry-tls" not found Jul 06 15:25:58.490328 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:58.490246 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls podName:e6fb2051-9202-41d8-b4fa-ffd24b691cab nodeName:}" failed. No retries permitted until 2026-07-06 15:26:00.490221968 +0000 UTC m=+39.586053338 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls") pod "image-registry-7bfb7bf96-j7csf" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab") : secret "image-registry-tls" not found Jul 06 15:25:58.490328 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:58.490160 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:25:58.490328 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:25:58.490286 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls podName:460cdb11-647b-45d1-b721-a041f17ec6e7 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:00.490276376 +0000 UTC m=+39.586107748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls") pod "dns-default-kvqkg" (UID: "460cdb11-647b-45d1-b721-a041f17ec6e7") : secret "dns-default-metrics-tls" not found Jul 06 15:25:58.720367 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:58.720328 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xbqcf" event={"ID":"89a714bd-78be-4e15-b041-4898e9b8ae5c","Type":"ContainerStarted","Data":"3ba5c9ebe6eb8ad6d7f029f4010874f236e7e966380ab07de8ccfab87446e242"} Jul 06 15:25:58.722912 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:58.722886 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfe512d8-f2f2-4fff-b166-5aa362a458ee" containerID="da49d9b82db171e3265fc561d0235a7df19555691815c1e8265e690354f47ae3" exitCode=0 Jul 06 15:25:58.723040 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:58.722920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerDied","Data":"da49d9b82db171e3265fc561d0235a7df19555691815c1e8265e690354f47ae3"} Jul 06 15:25:59.730072 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:59.729975 2581 generic.go:356] "Generic (PLEG): container finished" podID="dfe512d8-f2f2-4fff-b166-5aa362a458ee" containerID="46656a8abfd633c1c2677ed969ba62e889393cdebbbd7f4bc6ad9591ecdeba3e" exitCode=0 Jul 06 15:25:59.730072 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:25:59.730030 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerDied","Data":"46656a8abfd633c1c2677ed969ba62e889393cdebbbd7f4bc6ad9591ecdeba3e"} Jul 06 15:26:00.508453 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:00.508420 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:26:00.508617 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:00.508521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:26:00.508688 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:00.508613 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:00.508688 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:00.508657 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:26:00.508688 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:00.508668 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfb7bf96-j7csf: secret "image-registry-tls" not found Jul 06 15:26:00.508832 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:00.508697 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls podName:460cdb11-647b-45d1-b721-a041f17ec6e7 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:04.508676506 +0000 UTC m=+43.604507869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls") pod "dns-default-kvqkg" (UID: "460cdb11-647b-45d1-b721-a041f17ec6e7") : secret "dns-default-metrics-tls" not found Jul 06 15:26:00.508832 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:00.508717 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls podName:e6fb2051-9202-41d8-b4fa-ffd24b691cab nodeName:}" failed. No retries permitted until 2026-07-06 15:26:04.508706956 +0000 UTC m=+43.604538316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls") pod "image-registry-7bfb7bf96-j7csf" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab") : secret "image-registry-tls" not found Jul 06 15:26:00.737531 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:00.737491 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" event={"ID":"dfe512d8-f2f2-4fff-b166-5aa362a458ee","Type":"ContainerStarted","Data":"158afd03545d09041f3f155317773d0ce59ae2450fac38609189e92ca95d67f1"} Jul 06 15:26:00.769118 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:00.769021 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bzdpx" podStartSLOduration=9.132826883 podStartE2EDuration="39.768999474s" totalImagesPullingTime="30.636172591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:00.768017089 +0000 UTC m=+39.863848469" watchObservedRunningTime="2026-07-06 15:26:00.768999474 +0000 UTC m=+39.864830854" Jul 06 15:26:00.920443 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:00.920408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:01.022935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:01.022031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:01.590953 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:01.590783 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:01.684642 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:01.684586 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:01.741329 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:01.741238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xbqcf" event={"ID":"89a714bd-78be-4e15-b041-4898e9b8ae5c","Type":"ContainerStarted","Data":"7ce31a650200a59f155c122259a1a7028b567a263647b5db088048ac7ec5f27c"} Jul 06 15:26:01.760231 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:01.760195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:01.768542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:01.768488 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xbqcf" podStartSLOduration=2.736394982 podStartE2EDuration="5.768469508s" totalImagesPullingTime="3.032074526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:01.767858806 +0000 UTC m=+40.863690182" watchObservedRunningTime="2026-07-06 15:26:01.768469508 +0000 UTC m=+40.864300887" Jul 06 15:26:01.828868 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:01.828833 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:01.926622 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:01.926591 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:02.258194 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:02.258161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:02.321805 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:02.321774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:02.610999 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:02.610945 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:02.691538 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:02.691496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:03.083152 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:03.083074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:03.466308 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:03.466278 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:03.552881 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:03.552851 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:04.316281 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:04.316239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:04.383800 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:04.383763 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:04.538495 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:04.538460 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:26:04.538672 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:04.538509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:26:04.538672 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:04.538602 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:04.538672 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:04.538609 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:26:04.538672 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:04.538625 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfb7bf96-j7csf: secret "image-registry-tls" not found Jul 06 15:26:04.538672 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:04.538663 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls podName:460cdb11-647b-45d1-b721-a041f17ec6e7 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:12.538650083 +0000 UTC m=+51.634481439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls") pod "dns-default-kvqkg" (UID: "460cdb11-647b-45d1-b721-a041f17ec6e7") : secret "dns-default-metrics-tls" not found Jul 06 15:26:04.538900 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:04.538677 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls podName:e6fb2051-9202-41d8-b4fa-ffd24b691cab nodeName:}" failed. No retries permitted until 2026-07-06 15:26:12.5386702 +0000 UTC m=+51.634501557 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls") pod "image-registry-7bfb7bf96-j7csf" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab") : secret "image-registry-tls" not found Jul 06 15:26:04.672496 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:04.672468 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:04.768858 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:04.768823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:05.709832 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:05.709797 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:08.631800 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:08.631767 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:08.701719 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:08.701687 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:09.996049 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:09.996010 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:12.595592 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:12.595547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:26:12.596016 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:12.595615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:26:12.596016 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:12.595695 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:26:12.596016 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:12.595713 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfb7bf96-j7csf: secret "image-registry-tls" not found Jul 06 15:26:12.596016 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:12.595717 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:12.596016 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:12.595777 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls podName:e6fb2051-9202-41d8-b4fa-ffd24b691cab nodeName:}" failed. No retries permitted until 2026-07-06 15:26:28.595760298 +0000 UTC m=+67.691591655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls") pod "image-registry-7bfb7bf96-j7csf" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab") : secret "image-registry-tls" not found Jul 06 15:26:12.596016 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:12.595791 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls podName:460cdb11-647b-45d1-b721-a041f17ec6e7 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:28.59578443 +0000 UTC m=+67.691615786 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls") pod "dns-default-kvqkg" (UID: "460cdb11-647b-45d1-b721-a041f17ec6e7") : secret "dns-default-metrics-tls" not found Jul 06 15:26:14.231658 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:14.231620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:14.327864 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:14.327826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:15.076839 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:15.076809 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:18.312294 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:18.312239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:18.373236 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:18.373202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:18.650614 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:18.650577 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:18.726886 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:18.726855 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:18.831797 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:18.831763 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:18.892314 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:18.892279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:18.956453 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:18.956382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:22.713138 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:22.713098 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-whv5v" Jul 06 15:26:22.882828 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:22.882794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:22.988661 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:22.988566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:27.101058 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.100969 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:26:27.101536 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.101072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:26:27.104006 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.103970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:26:27.104051 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.103970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:26:27.111567 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:27.111547 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:26:27.111627 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:27.111617 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:31.1116013 +0000 UTC m=+130.207432658 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : secret "metrics-daemon-secret" not found Jul 06 15:26:27.115107 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.115087 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00deaac9-c8d8-42b6-a361-9e05e1d548e3-original-pull-secret\") pod \"global-pull-secret-syncer-stmpf\" (UID: \"00deaac9-c8d8-42b6-a361-9e05e1d548e3\") " pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:26:27.156229 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.156190 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-stmpf" Jul 06 15:26:27.202337 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.202303 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:26:27.205430 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.205410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:26:27.215783 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.215763 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:26:27.226212 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.226158 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6p2p\" (UniqueName: \"kubernetes.io/projected/78177b4f-8184-422a-a971-a57e582e97fe-kube-api-access-m6p2p\") pod \"network-check-target-8vxl9\" (UID: \"78177b4f-8184-422a-a971-a57e582e97fe\") " pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:26:27.280180 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.280149 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-stmpf"] Jul 06 15:26:27.283421 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:26:27.283395 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00deaac9_c8d8_42b6_a361_9e05e1d548e3.slice/crio-ee2fb8bc9d4c6f8178f740854d253d9de09c1136f88711a63e6f2b31fc324c93 WatchSource:0}: Error finding container ee2fb8bc9d4c6f8178f740854d253d9de09c1136f88711a63e6f2b31fc324c93: Status 404 returned error can't find the container with id ee2fb8bc9d4c6f8178f740854d253d9de09c1136f88711a63e6f2b31fc324c93 Jul 06 15:26:27.464542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.464460 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86nh7\"" Jul 06 15:26:27.472069 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.472042 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:26:27.612599 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.612569 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vxl9"] Jul 06 15:26:27.615584 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:26:27.615556 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78177b4f_8184_422a_a971_a57e582e97fe.slice/crio-ad28b1c70d8dd6816819d860c52e990396814c8384b28c45dc5a60a1e8288273 WatchSource:0}: Error finding container ad28b1c70d8dd6816819d860c52e990396814c8384b28c45dc5a60a1e8288273: Status 404 returned error can't find the container with id ad28b1c70d8dd6816819d860c52e990396814c8384b28c45dc5a60a1e8288273 Jul 06 15:26:27.799681 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.799588 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vxl9" event={"ID":"78177b4f-8184-422a-a971-a57e582e97fe","Type":"ContainerStarted","Data":"ad28b1c70d8dd6816819d860c52e990396814c8384b28c45dc5a60a1e8288273"} Jul 06 15:26:27.800579 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:27.800559 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-stmpf" event={"ID":"00deaac9-c8d8-42b6-a361-9e05e1d548e3","Type":"ContainerStarted","Data":"ee2fb8bc9d4c6f8178f740854d253d9de09c1136f88711a63e6f2b31fc324c93"} Jul 06 15:26:28.612284 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:28.612252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:26:28.612775 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:28.612313 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:26:28.612775 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:28.612401 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:26:28.612775 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:28.612426 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfb7bf96-j7csf: secret "image-registry-tls" not found Jul 06 15:26:28.612775 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:28.612440 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:28.612775 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:28.612495 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls podName:e6fb2051-9202-41d8-b4fa-ffd24b691cab nodeName:}" failed. No retries permitted until 2026-07-06 15:27:00.612473977 +0000 UTC m=+99.708305354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls") pod "image-registry-7bfb7bf96-j7csf" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab") : secret "image-registry-tls" not found Jul 06 15:26:28.612775 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:26:28.612513 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls podName:460cdb11-647b-45d1-b721-a041f17ec6e7 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:00.612504254 +0000 UTC m=+99.708335611 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls") pod "dns-default-kvqkg" (UID: "460cdb11-647b-45d1-b721-a041f17ec6e7") : secret "dns-default-metrics-tls" not found Jul 06 15:26:31.811850 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:31.811818 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vxl9" event={"ID":"78177b4f-8184-422a-a971-a57e582e97fe","Type":"ContainerStarted","Data":"9a047f39696b4a6bea3160cc21241ac71f8c42d6e67f199f2c06fc91060c58ea"} Jul 06 15:26:31.812316 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:31.811894 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:26:31.832793 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:31.832746 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8vxl9" podStartSLOduration=67.635216186 podStartE2EDuration="1m10.83272778s" totalImagesPullingTime="3.197511594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:31.832131258 +0000 UTC m=+70.927962639" watchObservedRunningTime="2026-07-06 15:26:31.83272778 +0000 UTC m=+70.928559156" Jul 06 15:26:33.818030 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:33.817976 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-stmpf" event={"ID":"00deaac9-c8d8-42b6-a361-9e05e1d548e3","Type":"ContainerStarted","Data":"47a0dd691e491604c8c932c7f3ce04479feec8a6a1cb78c668e94f9df56c77c0"} Jul 06 15:26:33.838802 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:33.838760 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-stmpf" podStartSLOduration=66.921565383 podStartE2EDuration="1m12.838746457s" totalImagesPullingTime="5.917181074s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:33.8385862 +0000 UTC m=+72.934417590" watchObservedRunningTime="2026-07-06 15:26:33.838746457 +0000 UTC m=+72.934577829" Jul 06 15:26:39.637998 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:39.637942 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:39.702717 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:39.702672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:40.812232 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:40.812194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:26:40.912952 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:26:40.912914 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:00.643071 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:00.643029 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:27:00.643614 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:00.643092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:27:00.643614 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:00.643214 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:27:00.643614 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:00.643235 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:27:00.643614 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:00.643254 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7bfb7bf96-j7csf: secret "image-registry-tls" not found Jul 06 15:27:00.643614 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:00.643296 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls podName:460cdb11-647b-45d1-b721-a041f17ec6e7 nodeName:}" failed. No retries permitted until 2026-07-06 15:28:04.643277582 +0000 UTC m=+163.739108938 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls") pod "dns-default-kvqkg" (UID: "460cdb11-647b-45d1-b721-a041f17ec6e7") : secret "dns-default-metrics-tls" not found Jul 06 15:27:00.643614 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:00.643321 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls podName:e6fb2051-9202-41d8-b4fa-ffd24b691cab nodeName:}" failed. No retries permitted until 2026-07-06 15:28:04.643302721 +0000 UTC m=+163.739134095 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls") pod "image-registry-7bfb7bf96-j7csf" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab") : secret "image-registry-tls" not found Jul 06 15:27:02.816641 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:02.816610 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8vxl9" Jul 06 15:27:18.477182 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:18.477136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:19.620092 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:19.620055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:23.380031 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.379994 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-84f8895bbf-wbkcb"] Jul 06 15:27:23.381995 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.381967 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.406460 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.406431 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 15:27:23.406688 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.406668 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 15:27:23.406764 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.406749 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 15:27:23.406994 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.406965 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 15:27:23.407177 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.407163 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9t9rd\"" Jul 06 15:27:23.408156 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.408142 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 15:27:23.408212 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.408145 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 15:27:23.485174 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.485142 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84f8895bbf-wbkcb"] Jul 06 15:27:23.501254 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.501222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-default-certificate\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.501254 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.501257 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.501485 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.501291 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.501485 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.501393 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-stats-auth\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.501485 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.501448 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2prnp\" (UniqueName: \"kubernetes.io/projected/7dac0aaf-891f-4f62-97bc-02614614ff82-kube-api-access-2prnp\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.601831 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.601777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.601831 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.601832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.602126 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:23.601918 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:23.602126 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.601965 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-stats-auth\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.602126 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:23.601996 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:24.101958459 +0000 UTC m=+123.197789845 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : secret "router-metrics-certs-default" not found Jul 06 15:27:23.602126 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:23.602029 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:24.10201082 +0000 UTC m=+123.197842178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:23.602126 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.602067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2prnp\" (UniqueName: \"kubernetes.io/projected/7dac0aaf-891f-4f62-97bc-02614614ff82-kube-api-access-2prnp\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.602354 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.602144 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-default-certificate\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.604434 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.604407 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-default-certificate\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.604560 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.604468 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-stats-auth\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.643194 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.643125 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2prnp\" (UniqueName: \"kubernetes.io/projected/7dac0aaf-891f-4f62-97bc-02614614ff82-kube-api-access-2prnp\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:23.899644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:23.899555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:24.013969 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:24.013934 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:24.106101 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:24.106072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:24.106277 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:24.106117 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:24.106277 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:24.106232 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:24.106347 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:24.106277 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:25.106258418 +0000 UTC m=+124.202089780 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:24.106347 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:24.106301 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:25.106293507 +0000 UTC m=+124.202124864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : secret "router-metrics-certs-default" not found Jul 06 15:27:25.113929 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:25.113885 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:25.113929 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:25.113942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:25.114436 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:25.114061 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:25.114436 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:25.114122 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:27.114096813 +0000 UTC m=+126.209928188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:25.114436 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:25.114151 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:27.114141426 +0000 UTC m=+126.209972784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : secret "router-metrics-certs-default" not found Jul 06 15:27:25.831004 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:25.830950 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:25.906580 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:25.906546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:27.128351 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:27.128312 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:27.128788 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:27.128367 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:27.128788 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:27.128474 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:27.128788 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:27.128510 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:31.128492159 +0000 UTC m=+130.224323527 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:27.128788 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:27.128536 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:31.128527429 +0000 UTC m=+130.224358786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : secret "router-metrics-certs-default" not found Jul 06 15:27:28.691158 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.691114 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s4fdk"] Jul 06 15:27:28.693416 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.693400 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.697326 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.697306 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 15:27:28.698934 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.698917 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 15:27:28.702179 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.702160 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d554w\"" Jul 06 15:27:28.702179 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.702162 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 15:27:28.702327 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.702184 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 15:27:28.715219 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.715193 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s4fdk"] Jul 06 15:27:28.754990 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.754935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:28.825461 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.825425 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:28.841072 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.841047 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54792a15-1fa0-4425-b3a9-0cda693505c4-data-volume\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.841171 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.841088 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.841171 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.841118 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.841244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.841180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5x6g\" (UniqueName: \"kubernetes.io/projected/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-api-access-d5x6g\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.841244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.841210 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54792a15-1fa0-4425-b3a9-0cda693505c4-crio-socket\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.917034 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.916976 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:28.942439 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.942369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5x6g\" (UniqueName: \"kubernetes.io/projected/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-api-access-d5x6g\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.942439 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.942410 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54792a15-1fa0-4425-b3a9-0cda693505c4-crio-socket\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.942605 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.942506 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54792a15-1fa0-4425-b3a9-0cda693505c4-crio-socket\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.942605 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.942553 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54792a15-1fa0-4425-b3a9-0cda693505c4-data-volume\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.942605 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.942587 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.942720 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.942610 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.942720 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:28.942683 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:28.942788 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:28.942716 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:28.942788 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:28.942742 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:29.442723444 +0000 UTC m=+128.538554810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : configmap "kube-rbac-proxy" not found Jul 06 15:27:28.942788 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:28.942768 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:29.442755347 +0000 UTC m=+128.538586719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:28.942898 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.942868 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54792a15-1fa0-4425-b3a9-0cda693505c4-data-volume\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:28.955685 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:28.955657 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5x6g\" (UniqueName: \"kubernetes.io/projected/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-api-access-d5x6g\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:29.001066 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:29.001032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:29.101129 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:29.101100 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:29.200887 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:29.200810 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:29.428247 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:29.428214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:29.445511 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:29.445480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:29.445511 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:29.445513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:29.445774 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:29.445583 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:29.445774 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:29.445629 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:30.445617116 +0000 UTC m=+129.541448474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : configmap "kube-rbac-proxy" not found Jul 06 15:27:29.445774 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:29.445639 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:29.445774 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:29.445699 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:30.445681217 +0000 UTC m=+129.541512574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:29.517893 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:29.517818 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:30.452398 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:30.452356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:30.452398 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:30.452404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:30.452949 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:30.452484 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:30.452949 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:30.452493 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:30.452949 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:30.452545 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:32.452531147 +0000 UTC m=+131.548362504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:30.452949 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:30.452559 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:32.452552953 +0000 UTC m=+131.548384309 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : configmap "kube-rbac-proxy" not found Jul 06 15:27:30.495704 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:30.495679 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-646k2_4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88/dns-node-resolver/0.log" Jul 06 15:27:31.072993 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:31.072943 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:31.133720 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:31.133686 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:31.158929 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:31.158899 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:31.158929 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:31.158932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:27:31.159126 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:31.159006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:31.159126 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:31.159082 2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:31.159126 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:31.159112 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:27:31.159272 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:31.159169 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:39.159148654 +0000 UTC m=+138.254980026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : secret "router-metrics-certs-default" not found Jul 06 15:27:31.159272 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:31.159189 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle podName:7dac0aaf-891f-4f62-97bc-02614614ff82 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:39.159179879 +0000 UTC m=+138.255011238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle") pod "router-default-84f8895bbf-wbkcb" (UID: "7dac0aaf-891f-4f62-97bc-02614614ff82") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:31.159272 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:31.159205 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs podName:b60b2614-7799-4979-b5bc-8a7ba4b49339 nodeName:}" failed. No retries permitted until 2026-07-06 15:29:33.159196065 +0000 UTC m=+252.255027428 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs") pod "network-metrics-daemon-9vcwr" (UID: "b60b2614-7799-4979-b5bc-8a7ba4b49339") : secret "metrics-daemon-secret" not found Jul 06 15:27:31.896287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:31.896264 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vww7h_b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25/node-ca/0.log" Jul 06 15:27:32.033713 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:32.033684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:32.431183 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:32.431148 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:32.467529 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:32.467498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:32.467529 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:32.467533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:32.467762 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:32.467665 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:32.467762 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:32.467683 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:32.467762 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:32.467744 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:36.467723309 +0000 UTC m=+135.563554689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:32.467762 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:32.467764 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:36.467755593 +0000 UTC m=+135.563586979 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : configmap "kube-rbac-proxy" not found Jul 06 15:27:32.691945 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:32.691855 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:32.697270 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:32.697247 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xbqcf_89a714bd-78be-4e15-b041-4898e9b8ae5c/serve-healthcheck-canary/0.log" Jul 06 15:27:32.783492 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:32.783455 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:32.884505 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:32.884470 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:33.003888 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:33.003800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:33.102554 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:33.102519 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:33.205713 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:33.205682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:34.142989 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:34.142941 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:34.540711 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:34.540622 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:34.756558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:34.756520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:34.938966 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:34.938927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:35.142660 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:35.142625 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:35.741375 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:35.741337 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:36.152077 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:36.152043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:36.250151 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:36.250114 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:36.497888 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:36.497807 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:36.498067 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:36.497930 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:36.498067 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:36.497968 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:36.501285 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:36.498392 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:44.497994914 +0000 UTC m=+143.593826283 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : configmap "kube-rbac-proxy" not found Jul 06 15:27:36.501285 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:36.498408 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:36.501285 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:36.498482 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls podName:54792a15-1fa0-4425-b3a9-0cda693505c4 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:44.498464545 +0000 UTC m=+143.594295903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s4fdk" (UID: "54792a15-1fa0-4425-b3a9-0cda693505c4") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:36.568994 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:36.568959 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:36.744730 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:36.744694 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:36.937810 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:36.937774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:37.038395 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:37.038361 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:37.276045 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:37.275933 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:37.377750 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:37.377713 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:37.738600 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:37.738569 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:38.201975 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:38.201938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:38.586151 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:38.586057 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:38.941734 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:38.941707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:39.139147 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.139118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:39.219366 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.219276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:39.219366 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.219318 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:39.219935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.219902 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dac0aaf-891f-4f62-97bc-02614614ff82-service-ca-bundle\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:39.221687 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.221664 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7dac0aaf-891f-4f62-97bc-02614614ff82-metrics-certs\") pod \"router-default-84f8895bbf-wbkcb\" (UID: \"7dac0aaf-891f-4f62-97bc-02614614ff82\") " pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:39.289936 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.289887 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:39.340927 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.340869 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:39.422191 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.422095 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-84f8895bbf-wbkcb"] Jul 06 15:27:39.424767 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:27:39.424740 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dac0aaf_891f_4f62_97bc_02614614ff82.slice/crio-8d952aa4a1378ad8682862d9403f8b033e07e0f625ce4479cc9be63640e6d557 WatchSource:0}: Error finding container 8d952aa4a1378ad8682862d9403f8b033e07e0f625ce4479cc9be63640e6d557: Status 404 returned error can't find the container with id 8d952aa4a1378ad8682862d9403f8b033e07e0f625ce4479cc9be63640e6d557 Jul 06 15:27:39.751810 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.751778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:39.947147 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.947120 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:39.968316 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.968288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" event={"ID":"7dac0aaf-891f-4f62-97bc-02614614ff82","Type":"ContainerStarted","Data":"691e2dec80de02f50210e52471fde4c3f7b2a1dbeb860dec27ec5185fda2af6b"} Jul 06 15:27:39.968463 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.968335 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" event={"ID":"7dac0aaf-891f-4f62-97bc-02614614ff82","Type":"ContainerStarted","Data":"8d952aa4a1378ad8682862d9403f8b033e07e0f625ce4479cc9be63640e6d557"} Jul 06 15:27:39.993819 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:39.993773 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" podStartSLOduration=16.993760604 podStartE2EDuration="16.993760604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:39.993138115 +0000 UTC m=+139.088969495" watchObservedRunningTime="2026-07-06 15:27:39.993760604 +0000 UTC m=+139.089591983" Jul 06 15:27:40.290963 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:40.290934 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:40.293422 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:40.293401 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:40.928090 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:40.928048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:40.970832 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:40.970802 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:40.972097 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:40.972076 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-84f8895bbf-wbkcb" Jul 06 15:27:41.133559 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:41.133521 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:41.334849 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:41.334757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:41.561583 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:41.561534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:41.933887 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:41.933845 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:42.359370 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:42.359334 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:42.544230 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:42.544202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:42.939250 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:42.939214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:43.131146 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:43.131107 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:44.012678 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:44.012648 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:44.563179 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:44.563143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:44.563391 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:44.563189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:44.563749 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:44.563724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54792a15-1fa0-4425-b3a9-0cda693505c4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:44.565392 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:44.565375 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54792a15-1fa0-4425-b3a9-0cda693505c4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s4fdk\" (UID: \"54792a15-1fa0-4425-b3a9-0cda693505c4\") " pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:44.602440 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:44.602399 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s4fdk" Jul 06 15:27:44.725134 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:44.725105 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s4fdk"] Jul 06 15:27:44.729211 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:27:44.729182 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54792a15_1fa0_4425_b3a9_0cda693505c4.slice/crio-457656dd50fdce3ed9172ec820830cc5b3ac969222e680b314e60c338b018865 WatchSource:0}: Error finding container 457656dd50fdce3ed9172ec820830cc5b3ac969222e680b314e60c338b018865: Status 404 returned error can't find the container with id 457656dd50fdce3ed9172ec820830cc5b3ac969222e680b314e60c338b018865 Jul 06 15:27:44.981419 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:44.981389 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4fdk" event={"ID":"54792a15-1fa0-4425-b3a9-0cda693505c4","Type":"ContainerStarted","Data":"457656dd50fdce3ed9172ec820830cc5b3ac969222e680b314e60c338b018865"} Jul 06 15:27:48.995276 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:48.995243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4fdk" event={"ID":"54792a15-1fa0-4425-b3a9-0cda693505c4","Type":"ContainerStarted","Data":"e5771f1ca099614d9441280a1c05e71c9417ebd597e9e60092e717509fb34317"} Jul 06 15:27:48.995616 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:48.995323 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4fdk" event={"ID":"54792a15-1fa0-4425-b3a9-0cda693505c4","Type":"ContainerStarted","Data":"fdb06c665f641663ebe454955844596bb9ab6601056daa483d558b69eea36ad6"} Jul 06 15:27:49.423702 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:49.423655 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:49.524936 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:49.524897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:49.728278 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:49.728169 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:49.904509 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:49.904472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.511849 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:50.511796 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.674841 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:50.674807 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.773279 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:50.773190 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:50.834900 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:50.834844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:51.125681 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:51.125638 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:51.193219 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:51.193185 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:51.312335 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:51.312288 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:52.007393 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:52.007361 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s4fdk" event={"ID":"54792a15-1fa0-4425-b3a9-0cda693505c4","Type":"ContainerStarted","Data":"ee978674b892a3d94b99d7b147661c99820a747e5cc0b3200d783b1065cc941e"} Jul 06 15:27:52.028870 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:52.028812 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s4fdk" podStartSLOduration=17.513519613 podStartE2EDuration="24.028797358s" totalImagesPullingTime="6.515277745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:27:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:52.028026715 +0000 UTC m=+151.123858094" watchObservedRunningTime="2026-07-06 15:27:52.028797358 +0000 UTC m=+151.124628737" Jul 06 15:27:52.043280 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:52.043242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.129150 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.129105 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx"] Jul 06 15:27:54.131607 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.131584 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" Jul 06 15:27:54.136623 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.136591 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 15:27:54.136623 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.136592 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6tzgl\"" Jul 06 15:27:54.136779 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.136592 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 15:27:54.149368 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.149344 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx"] Jul 06 15:27:54.243264 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.243230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/453912a4-c635-4bc7-935e-c2b4135f6611-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vs9qx\" (UID: \"453912a4-c635-4bc7-935e-c2b4135f6611\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" Jul 06 15:27:54.243423 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.243315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/453912a4-c635-4bc7-935e-c2b4135f6611-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vs9qx\" (UID: \"453912a4-c635-4bc7-935e-c2b4135f6611\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" Jul 06 15:27:54.252302 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.252271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.336679 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.336642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.344211 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.344186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/453912a4-c635-4bc7-935e-c2b4135f6611-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vs9qx\" (UID: \"453912a4-c635-4bc7-935e-c2b4135f6611\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" Jul 06 15:27:54.344325 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.344222 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/453912a4-c635-4bc7-935e-c2b4135f6611-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vs9qx\" (UID: \"453912a4-c635-4bc7-935e-c2b4135f6611\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" Jul 06 15:27:54.344852 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.344821 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/453912a4-c635-4bc7-935e-c2b4135f6611-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-vs9qx\" (UID: \"453912a4-c635-4bc7-935e-c2b4135f6611\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" Jul 06 15:27:54.346515 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.346492 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/453912a4-c635-4bc7-935e-c2b4135f6611-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-vs9qx\" (UID: \"453912a4-c635-4bc7-935e-c2b4135f6611\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" Jul 06 15:27:54.416346 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.416276 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:54.440231 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.440203 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" Jul 06 15:27:54.582740 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:54.582706 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx"] Jul 06 15:27:54.604189 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:27:54.604157 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod453912a4_c635_4bc7_935e_c2b4135f6611.slice/crio-5c130445e5eb1b7b65cc8ff3e7974160e0a4bd5358fba17f0f97415a1eb23a21 WatchSource:0}: Error finding container 5c130445e5eb1b7b65cc8ff3e7974160e0a4bd5358fba17f0f97415a1eb23a21: Status 404 returned error can't find the container with id 5c130445e5eb1b7b65cc8ff3e7974160e0a4bd5358fba17f0f97415a1eb23a21 Jul 06 15:27:55.017387 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:55.017357 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" event={"ID":"453912a4-c635-4bc7-935e-c2b4135f6611","Type":"ContainerStarted","Data":"5c130445e5eb1b7b65cc8ff3e7974160e0a4bd5358fba17f0f97415a1eb23a21"} Jul 06 15:27:56.021248 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:56.021213 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" event={"ID":"453912a4-c635-4bc7-935e-c2b4135f6611","Type":"ContainerStarted","Data":"375de7bab0752d742af3e790df090890b2c87859a6f2076967329118cd1ccf3a"} Jul 06 15:27:56.234247 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:56.234163 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:56.323544 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:56.323508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:57.784330 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.784286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:57.881364 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.881323 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:57.984991 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.984923 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-vs9qx" podStartSLOduration=2.750835726 podStartE2EDuration="3.984905984s" totalImagesPullingTime="1.234070258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:56.052503218 +0000 UTC m=+155.148334596" watchObservedRunningTime="2026-07-06 15:27:57.984905984 +0000 UTC m=+157.080737364" Jul 06 15:27:57.985361 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.985344 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v"] Jul 06 15:27:57.988482 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.988465 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" Jul 06 15:27:57.989736 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.989709 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:57.991773 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.991756 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 15:27:57.991884 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.991868 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9257q\"" Jul 06 15:27:57.997344 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:57.997324 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v"] Jul 06 15:27:58.070484 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:58.070386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09b50154-a32e-4928-9341-b330703607d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-47d9v\" (UID: \"09b50154-a32e-4928-9341-b330703607d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" Jul 06 15:27:58.171689 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:58.171657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09b50154-a32e-4928-9341-b330703607d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-47d9v\" (UID: \"09b50154-a32e-4928-9341-b330703607d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" Jul 06 15:27:58.171850 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:58.171792 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 15:27:58.171890 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:58.171852 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09b50154-a32e-4928-9341-b330703607d8-tls-certificates podName:09b50154-a32e-4928-9341-b330703607d8 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:58.671834881 +0000 UTC m=+157.767666238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/09b50154-a32e-4928-9341-b330703607d8-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-47d9v" (UID: "09b50154-a32e-4928-9341-b330703607d8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 15:27:58.461788 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:58.461732 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:27:58.675375 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:58.675338 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09b50154-a32e-4928-9341-b330703607d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-47d9v\" (UID: \"09b50154-a32e-4928-9341-b330703607d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" Jul 06 15:27:58.677698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:58.677667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/09b50154-a32e-4928-9341-b330703607d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-47d9v\" (UID: \"09b50154-a32e-4928-9341-b330703607d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" Jul 06 15:27:58.897756 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:58.897723 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" Jul 06 15:27:59.020546 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:59.020408 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v"] Jul 06 15:27:59.022807 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:27:59.022776 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b50154_a32e_4928_9341_b330703607d8.slice/crio-cdead694562659ad0162302c2f41775fc47388243f5e3f3e4e3020c8f7ba321f WatchSource:0}: Error finding container cdead694562659ad0162302c2f41775fc47388243f5e3f3e4e3020c8f7ba321f: Status 404 returned error can't find the container with id cdead694562659ad0162302c2f41775fc47388243f5e3f3e4e3020c8f7ba321f Jul 06 15:27:59.034810 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:27:59.034785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" event={"ID":"09b50154-a32e-4928-9341-b330703607d8","Type":"ContainerStarted","Data":"cdead694562659ad0162302c2f41775fc47388243f5e3f3e4e3020c8f7ba321f"} Jul 06 15:27:59.762244 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:59.762203 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" podUID="e6fb2051-9202-41d8-b4fa-ffd24b691cab" Jul 06 15:27:59.781225 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:27:59.781179 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kvqkg" podUID="460cdb11-647b-45d1-b721-a041f17ec6e7" Jul 06 15:28:00.038127 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:00.038060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:28:00.038127 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:00.038097 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kvqkg" Jul 06 15:28:00.447464 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:28:00.447409 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9vcwr" podUID="b60b2614-7799-4979-b5bc-8a7ba4b49339" Jul 06 15:28:01.042354 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:01.042314 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" event={"ID":"09b50154-a32e-4928-9341-b330703607d8","Type":"ContainerStarted","Data":"8014cbc4341f107a7aa090f576fda40320d48d69e9b2a6be49159e0694445b32"} Jul 06 15:28:01.042821 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:01.042460 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" Jul 06 15:28:01.047028 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:01.047010 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" Jul 06 15:28:01.063967 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:01.063926 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-47d9v" podStartSLOduration=3.010050944 podStartE2EDuration="4.063914011s" totalImagesPullingTime="1.053863067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:01.063353574 +0000 UTC m=+160.159184955" watchObservedRunningTime="2026-07-06 15:28:01.063914011 +0000 UTC m=+160.159745389" Jul 06 15:28:02.020238 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.020206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:02.090574 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.090533 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7"] Jul 06 15:28:02.093867 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.093845 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.098087 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.098056 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 15:28:02.098087 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.098082 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kfff6\"" Jul 06 15:28:02.098267 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.098088 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 15:28:02.098449 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.098434 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 15:28:02.098515 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.098497 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 15:28:02.107297 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.107271 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:02.108697 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.108682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 15:28:02.152047 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.152018 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7"] Jul 06 15:28:02.201552 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.201516 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3cdbef7-63ad-43b8-b956-af047c752f10-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.201753 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.201563 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p7nq\" (UniqueName: \"kubernetes.io/projected/b3cdbef7-63ad-43b8-b956-af047c752f10-kube-api-access-5p7nq\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.201753 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.201639 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3cdbef7-63ad-43b8-b956-af047c752f10-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.201753 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.201710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3cdbef7-63ad-43b8-b956-af047c752f10-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.215733 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.215702 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:02.302544 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.302452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p7nq\" (UniqueName: \"kubernetes.io/projected/b3cdbef7-63ad-43b8-b956-af047c752f10-kube-api-access-5p7nq\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.302544 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.302528 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3cdbef7-63ad-43b8-b956-af047c752f10-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.302762 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.302585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3cdbef7-63ad-43b8-b956-af047c752f10-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.302762 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.302644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3cdbef7-63ad-43b8-b956-af047c752f10-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.303278 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.303254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3cdbef7-63ad-43b8-b956-af047c752f10-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.305049 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.305026 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3cdbef7-63ad-43b8-b956-af047c752f10-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.305211 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.305191 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3cdbef7-63ad-43b8-b956-af047c752f10-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.314100 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.314075 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p7nq\" (UniqueName: \"kubernetes.io/projected/b3cdbef7-63ad-43b8-b956-af047c752f10-kube-api-access-5p7nq\") pod \"prometheus-operator-567f7b8b7c-6n7c7\" (UID: \"b3cdbef7-63ad-43b8-b956-af047c752f10\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.402933 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.402899 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" Jul 06 15:28:02.533190 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:02.533168 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7"] Jul 06 15:28:02.535310 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:28:02.535279 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cdbef7_63ad_43b8_b956_af047c752f10.slice/crio-c3be17dd7f62f438c6bf15ae6ef104c0ebb77a0d3f57740362539e5eea83f9a9 WatchSource:0}: Error finding container c3be17dd7f62f438c6bf15ae6ef104c0ebb77a0d3f57740362539e5eea83f9a9: Status 404 returned error can't find the container with id c3be17dd7f62f438c6bf15ae6ef104c0ebb77a0d3f57740362539e5eea83f9a9 Jul 06 15:28:03.049505 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:03.049467 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" event={"ID":"b3cdbef7-63ad-43b8-b956-af047c752f10","Type":"ContainerStarted","Data":"c3be17dd7f62f438c6bf15ae6ef104c0ebb77a0d3f57740362539e5eea83f9a9"} Jul 06 15:28:04.053720 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.053691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" event={"ID":"b3cdbef7-63ad-43b8-b956-af047c752f10","Type":"ContainerStarted","Data":"679ca8eecbb2d48e3194de258731c74e6acac3b05621bfc12f3f99f1554ba74c"} Jul 06 15:28:04.133796 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.133758 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:04.237429 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.237339 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:04.336777 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.336735 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:04.726629 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.726592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:28:04.726803 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.726641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:28:04.729028 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.729001 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/460cdb11-647b-45d1-b721-a041f17ec6e7-metrics-tls\") pod \"dns-default-kvqkg\" (UID: \"460cdb11-647b-45d1-b721-a041f17ec6e7\") " pod="openshift-dns/dns-default-kvqkg" Jul 06 15:28:04.729028 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.729020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"image-registry-7bfb7bf96-j7csf\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:28:04.842546 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.842512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sqdbx\"" Jul 06 15:28:04.842546 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.842514 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-thfjf\"" Jul 06 15:28:04.849060 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.849031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:28:04.849190 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.849135 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kvqkg" Jul 06 15:28:04.996955 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:04.996931 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kvqkg"] Jul 06 15:28:04.998829 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:28:04.998803 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460cdb11_647b_45d1_b721_a041f17ec6e7.slice/crio-b1014f4a417b1f292e4861bfda366f55beb78ac04cc6a0cd02936906bbf21f83 WatchSource:0}: Error finding container b1014f4a417b1f292e4861bfda366f55beb78ac04cc6a0cd02936906bbf21f83: Status 404 returned error can't find the container with id b1014f4a417b1f292e4861bfda366f55beb78ac04cc6a0cd02936906bbf21f83 Jul 06 15:28:05.019205 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:05.019072 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bfb7bf96-j7csf"] Jul 06 15:28:05.021509 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:28:05.021490 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6fb2051_9202_41d8_b4fa_ffd24b691cab.slice/crio-e26996164ba9270c026f806cd85881c7460fc12681dad5e1bf9f259187a72886 WatchSource:0}: Error finding container e26996164ba9270c026f806cd85881c7460fc12681dad5e1bf9f259187a72886: Status 404 returned error can't find the container with id e26996164ba9270c026f806cd85881c7460fc12681dad5e1bf9f259187a72886 Jul 06 15:28:05.060823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:05.060791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kvqkg" event={"ID":"460cdb11-647b-45d1-b721-a041f17ec6e7","Type":"ContainerStarted","Data":"b1014f4a417b1f292e4861bfda366f55beb78ac04cc6a0cd02936906bbf21f83"} Jul 06 15:28:05.062048 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:05.062021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" event={"ID":"e6fb2051-9202-41d8-b4fa-ffd24b691cab","Type":"ContainerStarted","Data":"e26996164ba9270c026f806cd85881c7460fc12681dad5e1bf9f259187a72886"} Jul 06 15:28:05.064113 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:05.063938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" event={"ID":"b3cdbef7-63ad-43b8-b956-af047c752f10","Type":"ContainerStarted","Data":"fdae3afd41af8d41af0a6b55b876a5c1f056fac6fc411a1d18090803a03510ef"} Jul 06 15:28:05.088804 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:05.088750 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-6n7c7" podStartSLOduration=1.67731012 podStartE2EDuration="3.088731089s" totalImagesPullingTime="1.411420969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:05.087967683 +0000 UTC m=+164.183799062" watchObservedRunningTime="2026-07-06 15:28:05.088731089 +0000 UTC m=+164.184562469" Jul 06 15:28:06.069333 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:06.069287 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" event={"ID":"e6fb2051-9202-41d8-b4fa-ffd24b691cab","Type":"ContainerStarted","Data":"a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06"} Jul 06 15:28:06.100469 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:06.100406 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" podStartSLOduration=164.100388261 podStartE2EDuration="2m44.100388261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:06.099150762 +0000 UTC m=+165.194982154" watchObservedRunningTime="2026-07-06 15:28:06.100388261 +0000 UTC m=+165.196219641" Jul 06 15:28:07.074873 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.074839 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kvqkg" event={"ID":"460cdb11-647b-45d1-b721-a041f17ec6e7","Type":"ContainerStarted","Data":"7c8a4af74cfb92e30a0125d9b29d35aab10a333265953c72002fc00cc9a35d44"} Jul 06 15:28:07.075310 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.074894 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kvqkg" event={"ID":"460cdb11-647b-45d1-b721-a041f17ec6e7","Type":"ContainerStarted","Data":"e125ee9c6a902d15f08cca88e9b60dc40392b21ae0754f8acbfcbc265b96abae"} Jul 06 15:28:07.075310 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.075110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:28:07.098889 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.098838 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kvqkg" podStartSLOduration=129.717979221 podStartE2EDuration="2m11.09882062s" totalImagesPullingTime="1.380841399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:07.097779685 +0000 UTC m=+166.193611065" watchObservedRunningTime="2026-07-06 15:28:07.09882062 +0000 UTC m=+166.194651998" Jul 06 15:28:07.173672 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.173639 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.271858 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.271820 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.419778 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.419708 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.508973 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.508927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.512206 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.512179 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qj5hf"] Jul 06 15:28:07.519617 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.519594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.522098 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.522073 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 15:28:07.522449 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.522431 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hhstt\"" Jul 06 15:28:07.522543 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.522452 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 15:28:07.522543 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.522469 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 15:28:07.649549 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.649549 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649551 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-sys\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.649777 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649575 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-metrics-client-ca\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.649777 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-textfile\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.649777 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649698 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-tls\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.649777 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-wtmp\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.649962 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-root\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.649962 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhk6c\" (UniqueName: \"kubernetes.io/projected/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-kube-api-access-dhk6c\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.649962 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.649848 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.657669 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.657642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.750421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750337 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-sys\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750391 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-metrics-client-ca\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750685 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750465 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-sys\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750685 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750552 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-textfile\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750685 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-tls\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750685 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-wtmp\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750876 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-root\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750876 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750744 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhk6c\" (UniqueName: \"kubernetes.io/projected/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-kube-api-access-dhk6c\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750876 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:28:07.750768 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 15:28:07.750876 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:28:07.750830 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-tls podName:9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9 nodeName:}" failed. No retries permitted until 2026-07-06 15:28:08.25081267 +0000 UTC m=+167.346644029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-tls") pod "node-exporter-qj5hf" (UID: "9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9") : secret "node-exporter-tls" not found Jul 06 15:28:07.750876 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750836 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-wtmp\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750876 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750840 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-root\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.750876 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.751245 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.750885 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-textfile\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.751245 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.751038 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.751349 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.751244 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-metrics-client-ca\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.752631 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.752609 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b5f795ffb-9q8gm"] Jul 06 15:28:07.753273 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.753254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.755414 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.755390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.756477 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.756463 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.766259 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.766241 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 15:28:07.766430 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.766273 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 15:28:07.766430 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.766275 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 15:28:07.766614 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.766547 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 15:28:07.766614 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.766576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 15:28:07.766797 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.766782 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 15:28:07.766894 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.766871 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g26cq\"" Jul 06 15:28:07.767740 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.767724 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 15:28:07.769038 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.769017 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhk6c\" (UniqueName: \"kubernetes.io/projected/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-kube-api-access-dhk6c\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:07.771952 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.771930 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5f795ffb-9q8gm"] Jul 06 15:28:07.773090 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.773071 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 15:28:07.851641 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.851601 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s9jc\" (UniqueName: \"kubernetes.io/projected/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-kube-api-access-9s9jc\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.851641 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.851645 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-service-ca\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.851918 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.851711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-config\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.851918 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.851758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-trusted-ca-bundle\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.851918 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.851797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-oauth-config\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.851918 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.851817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-oauth-serving-cert\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.851918 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.851842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-serving-cert\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.910047 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.910010 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:07.953006 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.952951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s9jc\" (UniqueName: \"kubernetes.io/projected/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-kube-api-access-9s9jc\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953015 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-service-ca\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-config\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953097 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-trusted-ca-bundle\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-oauth-config\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953172 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-oauth-serving-cert\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-serving-cert\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953786 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953761 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-service-ca\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953901 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953830 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-config\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.953901 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953859 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-oauth-serving-cert\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.954025 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.953953 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-trusted-ca-bundle\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.955598 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.955579 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-oauth-config\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.955684 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.955665 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-serving-cert\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:07.964841 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:07.964815 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s9jc\" (UniqueName: \"kubernetes.io/projected/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-kube-api-access-9s9jc\") pod \"console-b5f795ffb-9q8gm\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:08.006853 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.006769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:08.066497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.066467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:08.081698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.080782 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kvqkg" Jul 06 15:28:08.208089 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.208060 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b5f795ffb-9q8gm"] Jul 06 15:28:08.208296 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:28:08.208276 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc944ad78_9cd2_4c54_93f0_2cfd3cc1b0ab.slice/crio-c2beab36be4501994b7edbf6c9dbbd97d3d8a2e660a5c368ac02ce2dafb6a2e4 WatchSource:0}: Error finding container c2beab36be4501994b7edbf6c9dbbd97d3d8a2e660a5c368ac02ce2dafb6a2e4: Status 404 returned error can't find the container with id c2beab36be4501994b7edbf6c9dbbd97d3d8a2e660a5c368ac02ce2dafb6a2e4 Jul 06 15:28:08.256726 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.256688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-tls\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:08.259014 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.258940 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9-node-exporter-tls\") pod \"node-exporter-qj5hf\" (UID: \"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9\") " pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:08.428497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.428465 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qj5hf" Jul 06 15:28:08.439731 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:28:08.439704 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bfe1ea6_e7d4_4815_af17_b8e7a1a7a3c9.slice/crio-055d2e0f46835144d1ed3aa7a3a7cbcca8f4bb3d68ff999ce853222bd01d0e7c WatchSource:0}: Error finding container 055d2e0f46835144d1ed3aa7a3a7cbcca8f4bb3d68ff999ce853222bd01d0e7c: Status 404 returned error can't find the container with id 055d2e0f46835144d1ed3aa7a3a7cbcca8f4bb3d68ff999ce853222bd01d0e7c Jul 06 15:28:08.481702 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.481669 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:08.590231 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.590197 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:08.927375 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:08.927205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:09.085512 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:09.085472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qj5hf" event={"ID":"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9","Type":"ContainerStarted","Data":"055d2e0f46835144d1ed3aa7a3a7cbcca8f4bb3d68ff999ce853222bd01d0e7c"} Jul 06 15:28:09.086799 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:09.086765 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5f795ffb-9q8gm" event={"ID":"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab","Type":"ContainerStarted","Data":"c2beab36be4501994b7edbf6c9dbbd97d3d8a2e660a5c368ac02ce2dafb6a2e4"} Jul 06 15:28:10.092389 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:10.092356 2581 generic.go:356] "Generic (PLEG): container finished" podID="9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9" containerID="401e8d97d95384e516f718bd392dcafb841e300fffd2ebcde0e30a79a4f1bdb2" exitCode=0 Jul 06 15:28:10.092779 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:10.092436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qj5hf" event={"ID":"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9","Type":"ContainerDied","Data":"401e8d97d95384e516f718bd392dcafb841e300fffd2ebcde0e30a79a4f1bdb2"} Jul 06 15:28:10.195903 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:10.195874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:10.297908 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:10.297868 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:10.428684 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:10.428599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:10.526050 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:10.526012 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:10.801452 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:10.801363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:10.894725 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:10.894682 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:11.100401 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.100364 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qj5hf" event={"ID":"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9","Type":"ContainerStarted","Data":"995b92e9d61917a1770170400ebaa421b3c4563040f9717e36830f5cb17af1fd"} Jul 06 15:28:11.100884 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.100425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qj5hf" event={"ID":"9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9","Type":"ContainerStarted","Data":"7cf7576f63f16914f530b335f449497fd129e87a7f15b262ae50d82997671236"} Jul 06 15:28:11.135187 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.135126 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qj5hf" podStartSLOduration=3.202381729 podStartE2EDuration="4.135108093s" totalImagesPullingTime="859.20779ms" totalInitContainerRuntime="73.518574ms" isStatefulPod=true podCreationTimestamp="2026-07-06 15:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:11.134053169 +0000 UTC m=+170.229884549" watchObservedRunningTime="2026-07-06 15:28:11.135108093 +0000 UTC m=+170.230939472" Jul 06 15:28:11.712659 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.712625 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c67b8c5bc-229hz"] Jul 06 15:28:11.715622 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.715599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.718394 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.718372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 15:28:11.718531 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.718478 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 15:28:11.718847 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.718831 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 15:28:11.719506 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.719487 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 15:28:11.719692 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.719677 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fcwsm\"" Jul 06 15:28:11.719773 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.719754 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-234d8l7pg6ee4\"" Jul 06 15:28:11.729787 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.729761 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c67b8c5bc-229hz"] Jul 06 15:28:11.792951 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.792865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f85732b4-8569-444c-bc58-3b63566a2b5d-audit-log\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.792951 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.792915 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-secret-metrics-server-client-certs\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.792951 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.792946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f85732b4-8569-444c-bc58-3b63566a2b5d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.793187 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.792964 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f85732b4-8569-444c-bc58-3b63566a2b5d-metrics-server-audit-profiles\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.793187 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.793001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-898vj\" (UniqueName: \"kubernetes.io/projected/f85732b4-8569-444c-bc58-3b63566a2b5d-kube-api-access-898vj\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.793187 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.793025 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-client-ca-bundle\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.793187 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.793043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-secret-metrics-server-tls\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.893858 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.893821 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f85732b4-8569-444c-bc58-3b63566a2b5d-audit-log\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.893938 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.893877 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-secret-metrics-server-client-certs\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.893938 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.893919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f85732b4-8569-444c-bc58-3b63566a2b5d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.894040 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.893946 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f85732b4-8569-444c-bc58-3b63566a2b5d-metrics-server-audit-profiles\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.894040 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.893971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-898vj\" (UniqueName: \"kubernetes.io/projected/f85732b4-8569-444c-bc58-3b63566a2b5d-kube-api-access-898vj\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.894040 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.894030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-client-ca-bundle\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.894177 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.894064 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-secret-metrics-server-tls\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.894318 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.894298 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f85732b4-8569-444c-bc58-3b63566a2b5d-audit-log\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.894774 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.894750 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f85732b4-8569-444c-bc58-3b63566a2b5d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.895204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.895178 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f85732b4-8569-444c-bc58-3b63566a2b5d-metrics-server-audit-profiles\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.896429 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.896407 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-client-ca-bundle\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.896660 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.896640 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-secret-metrics-server-client-certs\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.896700 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.896640 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f85732b4-8569-444c-bc58-3b63566a2b5d-secret-metrics-server-tls\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:11.903719 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:11.903698 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-898vj\" (UniqueName: \"kubernetes.io/projected/f85732b4-8569-444c-bc58-3b63566a2b5d-kube-api-access-898vj\") pod \"metrics-server-c67b8c5bc-229hz\" (UID: \"f85732b4-8569-444c-bc58-3b63566a2b5d\") " pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:12.032157 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:12.032116 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:12.106677 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:12.106643 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5f795ffb-9q8gm" event={"ID":"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab","Type":"ContainerStarted","Data":"abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73"} Jul 06 15:28:12.126819 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:12.126759 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b5f795ffb-9q8gm" podStartSLOduration=1.836184539 podStartE2EDuration="5.126737892s" totalImagesPullingTime="3.290553353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:12.125753525 +0000 UTC m=+171.221584904" watchObservedRunningTime="2026-07-06 15:28:12.126737892 +0000 UTC m=+171.222569272" Jul 06 15:28:12.177394 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:12.177364 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c67b8c5bc-229hz"] Jul 06 15:28:12.180114 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:28:12.180080 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85732b4_8569_444c_bc58_3b63566a2b5d.slice/crio-9d7df08c634e57b4f16c3242ef2cd4683f18abbf63d9ad9ce438fd7623a694cc WatchSource:0}: Error finding container 9d7df08c634e57b4f16c3242ef2cd4683f18abbf63d9ad9ce438fd7623a694cc: Status 404 returned error can't find the container with id 9d7df08c634e57b4f16c3242ef2cd4683f18abbf63d9ad9ce438fd7623a694cc Jul 06 15:28:12.219678 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:12.219644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:12.298891 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:12.298801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:12.552667 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:12.552547 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:13.111388 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:13.111349 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" event={"ID":"f85732b4-8569-444c-bc58-3b63566a2b5d","Type":"ContainerStarted","Data":"9d7df08c634e57b4f16c3242ef2cd4683f18abbf63d9ad9ce438fd7623a694cc"} Jul 06 15:28:13.801482 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:13.801401 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:14.116942 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:14.116908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" event={"ID":"f85732b4-8569-444c-bc58-3b63566a2b5d","Type":"ContainerStarted","Data":"0c8020a3b1535c34c827f296b2a65f67e7d3691c4bee18f1f8cbf18fc0abccb8"} Jul 06 15:28:14.149445 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:14.149393 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" podStartSLOduration=1.8754881060000002 podStartE2EDuration="3.149378419s" totalImagesPullingTime="1.273890313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:14.148069268 +0000 UTC m=+173.243900646" watchObservedRunningTime="2026-07-06 15:28:14.149378419 +0000 UTC m=+173.245209798" Jul 06 15:28:14.435529 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:14.435436 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:28:15.549854 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:15.549820 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:16.201664 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:16.201627 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:16.323728 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:16.323698 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:18.067084 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:18.067038 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:18.067557 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:18.067106 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:18.068500 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:18.068474 2581 patch_prober.go:28] interesting pod/console-b5f795ffb-9q8gm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body= Jul 06 15:28:18.068605 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:18.068529 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-b5f795ffb-9q8gm" podUID="c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" containerName="console" probeResult="failure" output="Get \"https://10.132.0.14:8443/health\": dial tcp 10.132.0.14:8443: connect: connection refused" Jul 06 15:28:18.088682 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:18.088660 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kvqkg" Jul 06 15:28:20.743303 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:20.743263 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:20.846997 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:20.846954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:21.800068 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:21.800027 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:24.853417 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:24.853377 2581 patch_prober.go:28] interesting pod/image-registry-7bfb7bf96-j7csf container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:24.853790 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:24.853427 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" podUID="e6fb2051-9202-41d8-b4fa-ffd24b691cab" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:25.309835 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:25.309750 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5f795ffb-9q8gm"] Jul 06 15:28:25.406590 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:25.406542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:25.498150 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:25.498113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:25.602888 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:25.602855 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:25.703072 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:25.703042 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:25.815136 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:25.815103 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:26.843108 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:26.843075 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bfb7bf96-j7csf"] Jul 06 15:28:26.847475 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:26.847452 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:28:27.002426 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:27.002393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:27.089030 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:27.089000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:27.312359 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:27.312266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:27.379884 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:27.379853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:30.347708 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:30.347675 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:32.033001 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:32.032954 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:32.033395 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:32.033026 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:35.005244 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:35.005202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:35.068735 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:35.068685 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:43.681572 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:43.681532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:43.811324 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:43.811287 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:44.050006 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:44.049901 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:44.146059 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:44.146023 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:44.254167 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:44.254128 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:50.329376 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.329327 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b5f795ffb-9q8gm" podUID="c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" containerName="console" containerID="cri-o://abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73" gracePeriod=15 Jul 06 15:28:50.573436 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.573410 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:50.651758 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.651725 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:50.701235 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701211 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s9jc\" (UniqueName: \"kubernetes.io/projected/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-kube-api-access-9s9jc\") pod \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " Jul 06 15:28:50.701418 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701257 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-serving-cert\") pod \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " Jul 06 15:28:50.701418 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701388 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-service-ca\") pod \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " Jul 06 15:28:50.701541 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701437 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-trusted-ca-bundle\") pod \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " Jul 06 15:28:50.701541 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701474 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-config\") pod \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " Jul 06 15:28:50.701541 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701504 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-oauth-serving-cert\") pod \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " Jul 06 15:28:50.701541 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701536 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-oauth-config\") pod \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\" (UID: \"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab\") " Jul 06 15:28:50.701749 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701714 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-service-ca" (OuterVolumeSpecName: "service-ca") pod "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" (UID: "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:28:50.701889 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701838 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:50.701968 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.701923 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-config" (OuterVolumeSpecName: "console-config") pod "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" (UID: "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:28:50.702091 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.702058 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" (UID: "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:28:50.702153 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.702110 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" (UID: "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:28:50.703549 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.703521 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" (UID: "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:28:50.703700 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.703675 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-kube-api-access-9s9jc" (OuterVolumeSpecName: "kube-api-access-9s9jc") pod "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" (UID: "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab"). InnerVolumeSpecName "kube-api-access-9s9jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:28:50.703888 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.703859 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" (UID: "c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:28:50.751408 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.751369 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:50.802421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.802383 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:50.802421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.802412 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-trusted-ca-bundle\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:50.802421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.802422 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:50.802421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.802430 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-oauth-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:50.802678 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.802440 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-console-oauth-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:50.802678 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:50.802449 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s9jc\" (UniqueName: \"kubernetes.io/projected/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab-kube-api-access-9s9jc\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:51.243321 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.243291 2581 generic.go:356] "Generic (PLEG): container finished" podID="c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" containerID="abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73" exitCode=0 Jul 06 15:28:51.243497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.243336 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b5f795ffb-9q8gm" Jul 06 15:28:51.243497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.243376 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5f795ffb-9q8gm" event={"ID":"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab","Type":"ContainerDied","Data":"abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73"} Jul 06 15:28:51.243497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.243425 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b5f795ffb-9q8gm" event={"ID":"c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab","Type":"ContainerDied","Data":"c2beab36be4501994b7edbf6c9dbbd97d3d8a2e660a5c368ac02ce2dafb6a2e4"} Jul 06 15:28:51.243497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.243450 2581 scope.go:117] "RemoveContainer" containerID="abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73" Jul 06 15:28:51.256153 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.256131 2581 scope.go:117] "RemoveContainer" containerID="abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73" Jul 06 15:28:51.256456 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:28:51.256433 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73\": container with ID starting with abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73 not found: ID does not exist" containerID="abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73" Jul 06 15:28:51.256523 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.256463 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73"} err="failed to get container status \"abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73\": rpc error: code = NotFound desc = could not find container \"abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73\": container with ID starting with abe70c321b22b703ec7cf0ebae772de076148fd195f6db5d0425e437acc71e73 not found: ID does not exist" Jul 06 15:28:51.268298 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.268277 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b5f795ffb-9q8gm"] Jul 06 15:28:51.272728 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.272709 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b5f795ffb-9q8gm"] Jul 06 15:28:51.439226 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.439189 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" path="/var/lib/kubelet/pods/c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab/volumes" Jul 06 15:28:51.862646 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:51.862612 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" podUID="e6fb2051-9202-41d8-b4fa-ffd24b691cab" containerName="registry" containerID="cri-o://a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06" gracePeriod=30 Jul 06 15:28:52.037253 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:52.037223 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:52.040993 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:52.040956 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c67b8c5bc-229hz" Jul 06 15:28:53.110222 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.110196 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:28:53.127451 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.127421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:28:53.223148 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223063 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-trusted-ca\") pod \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " Jul 06 15:28:53.223148 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223097 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-installation-pull-secrets\") pod \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " Jul 06 15:28:53.223148 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223122 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-certificates\") pod \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " Jul 06 15:28:53.223148 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223141 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4glv\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-kube-api-access-r4glv\") pod \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " Jul 06 15:28:53.223452 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223353 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-bound-sa-token\") pod \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " Jul 06 15:28:53.223452 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223434 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6fb2051-9202-41d8-b4fa-ffd24b691cab-ca-trust-extracted\") pod \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " Jul 06 15:28:53.223554 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223479 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") pod \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " Jul 06 15:28:53.223554 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223515 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-image-registry-private-configuration\") pod \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\" (UID: \"e6fb2051-9202-41d8-b4fa-ffd24b691cab\") " Jul 06 15:28:53.223650 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223589 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e6fb2051-9202-41d8-b4fa-ffd24b691cab" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:28:53.223774 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223745 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e6fb2051-9202-41d8-b4fa-ffd24b691cab" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:28:53.223908 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223868 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-trusted-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:53.223908 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.223891 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-certificates\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:53.225995 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.225951 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e6fb2051-9202-41d8-b4fa-ffd24b691cab" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:28:53.226124 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.226093 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e6fb2051-9202-41d8-b4fa-ffd24b691cab" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:28:53.226201 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.226157 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e6fb2051-9202-41d8-b4fa-ffd24b691cab" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:28:53.226201 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.226162 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-kube-api-access-r4glv" (OuterVolumeSpecName: "kube-api-access-r4glv") pod "e6fb2051-9202-41d8-b4fa-ffd24b691cab" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab"). InnerVolumeSpecName "kube-api-access-r4glv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:28:53.226317 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.226298 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e6fb2051-9202-41d8-b4fa-ffd24b691cab" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:28:53.232297 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.232277 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6fb2051-9202-41d8-b4fa-ffd24b691cab-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e6fb2051-9202-41d8-b4fa-ffd24b691cab" (UID: "e6fb2051-9202-41d8-b4fa-ffd24b691cab"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:28:53.251176 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.251150 2581 generic.go:356] "Generic (PLEG): container finished" podID="e6fb2051-9202-41d8-b4fa-ffd24b691cab" containerID="a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06" exitCode=0 Jul 06 15:28:53.251263 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.251193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" event={"ID":"e6fb2051-9202-41d8-b4fa-ffd24b691cab","Type":"ContainerDied","Data":"a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06"} Jul 06 15:28:53.251263 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.251197 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" Jul 06 15:28:53.251263 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.251232 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bfb7bf96-j7csf" event={"ID":"e6fb2051-9202-41d8-b4fa-ffd24b691cab","Type":"ContainerDied","Data":"e26996164ba9270c026f806cd85881c7460fc12681dad5e1bf9f259187a72886"} Jul 06 15:28:53.251263 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.251251 2581 scope.go:117] "RemoveContainer" containerID="a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06" Jul 06 15:28:53.259412 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.259392 2581 scope.go:117] "RemoveContainer" containerID="a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06" Jul 06 15:28:53.259665 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:28:53.259649 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06\": container with ID starting with a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06 not found: ID does not exist" containerID="a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06" Jul 06 15:28:53.259738 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.259674 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06"} err="failed to get container status \"a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06\": rpc error: code = NotFound desc = could not find container \"a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06\": container with ID starting with a56e56943ed021727d6680c632a354f63e7b7ff9222dcdf21ee2f5189db21f06 not found: ID does not exist" Jul 06 15:28:53.275652 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.275630 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7bfb7bf96-j7csf"] Jul 06 15:28:53.281601 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.281579 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7bfb7bf96-j7csf"] Jul 06 15:28:53.325171 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.325147 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-bound-sa-token\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:53.325171 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.325170 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e6fb2051-9202-41d8-b4fa-ffd24b691cab-ca-trust-extracted\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:53.325296 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.325180 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-registry-tls\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:53.325296 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.325189 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-image-registry-private-configuration\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:53.325296 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.325200 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e6fb2051-9202-41d8-b4fa-ffd24b691cab-installation-pull-secrets\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:53.325296 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.325208 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4glv\" (UniqueName: \"kubernetes.io/projected/e6fb2051-9202-41d8-b4fa-ffd24b691cab-kube-api-access-r4glv\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:28:53.439463 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:28:53.439434 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6fb2051-9202-41d8-b4fa-ffd24b691cab" path="/var/lib/kubelet/pods/e6fb2051-9202-41d8-b4fa-ffd24b691cab/volumes" Jul 06 15:29:22.475270 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:22.475234 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:26.836920 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:26.836871 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:27.201477 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:27.201385 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:33.223997 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:33.223954 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:29:33.226382 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:33.226354 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b60b2614-7799-4979-b5bc-8a7ba4b49339-metrics-certs\") pod \"network-metrics-daemon-9vcwr\" (UID: \"b60b2614-7799-4979-b5bc-8a7ba4b49339\") " pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:29:33.339094 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:33.339061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pn58n\"" Jul 06 15:29:33.346517 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:33.346486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9vcwr" Jul 06 15:29:33.474868 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:33.474796 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9vcwr"] Jul 06 15:29:33.478301 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:29:33.478263 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60b2614_7799_4979_b5bc_8a7ba4b49339.slice/crio-7e5a878816a64d892f590d276e97f8dcf110c677c27ac144a41cbe7f6af273f5 WatchSource:0}: Error finding container 7e5a878816a64d892f590d276e97f8dcf110c677c27ac144a41cbe7f6af273f5: Status 404 returned error can't find the container with id 7e5a878816a64d892f590d276e97f8dcf110c677c27ac144a41cbe7f6af273f5 Jul 06 15:29:34.384576 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:34.384530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vcwr" event={"ID":"b60b2614-7799-4979-b5bc-8a7ba4b49339","Type":"ContainerStarted","Data":"7e5a878816a64d892f590d276e97f8dcf110c677c27ac144a41cbe7f6af273f5"} Jul 06 15:29:35.389965 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:35.389928 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vcwr" event={"ID":"b60b2614-7799-4979-b5bc-8a7ba4b49339","Type":"ContainerStarted","Data":"5ef2ca566670a6c01a42abd942361eb37384cf5e0cebfb01436a670038a2a29b"} Jul 06 15:29:35.390479 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:35.390005 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9vcwr" event={"ID":"b60b2614-7799-4979-b5bc-8a7ba4b49339","Type":"ContainerStarted","Data":"c98bc5b24f14abe787a8d50cb3fa84025c729b27f52d7888a8e83c46299212cb"} Jul 06 15:29:35.409592 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:35.409542 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9vcwr" podStartSLOduration=253.366037665 podStartE2EDuration="4m14.409526965s" totalImagesPullingTime="1.0434893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:29:35.409056012 +0000 UTC m=+254.504887392" watchObservedRunningTime="2026-07-06 15:29:35.409526965 +0000 UTC m=+254.505358343" Jul 06 15:29:35.522317 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:35.522275 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:35.618826 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:35.618793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:36.289360 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.289318 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78cc9b99c4-fb8wn"] Jul 06 15:29:36.289676 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.289658 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" containerName="console" Jul 06 15:29:36.289726 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.289680 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" containerName="console" Jul 06 15:29:36.289726 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.289695 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6fb2051-9202-41d8-b4fa-ffd24b691cab" containerName="registry" Jul 06 15:29:36.289726 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.289703 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6fb2051-9202-41d8-b4fa-ffd24b691cab" containerName="registry" Jul 06 15:29:36.289825 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.289790 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6fb2051-9202-41d8-b4fa-ffd24b691cab" containerName="registry" Jul 06 15:29:36.289825 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.289805 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c944ad78-9cd2-4c54-93f0-2cfd3cc1b0ab" containerName="console" Jul 06 15:29:36.292773 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.292756 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.296088 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.296068 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 15:29:36.296193 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.296177 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 15:29:36.297189 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.297172 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 15:29:36.297266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.297234 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 15:29:36.297266 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.297231 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 15:29:36.297548 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.297531 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g26cq\"" Jul 06 15:29:36.297634 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.297579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 15:29:36.297634 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.297536 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 15:29:36.303589 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.303572 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 15:29:36.313738 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.313715 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78cc9b99c4-fb8wn"] Jul 06 15:29:36.403890 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.403849 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:36.446747 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.446715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-service-ca\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.446935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.446752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-trusted-ca-bundle\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.446935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.446781 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-config\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.446935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.446808 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-oauth-config\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.446935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.446844 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-serving-cert\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.446935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.446893 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-oauth-serving-cert\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.447192 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.446971 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6mwx\" (UniqueName: \"kubernetes.io/projected/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-kube-api-access-c6mwx\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.509844 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.509805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:36.547778 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.547692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-serving-cert\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.548052 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.548034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-oauth-serving-cert\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.548150 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.548131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6mwx\" (UniqueName: \"kubernetes.io/projected/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-kube-api-access-c6mwx\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.548250 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.548236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-service-ca\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.548855 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.548825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-trusted-ca-bundle\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.548968 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.548879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-config\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.548968 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.548913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-oauth-config\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.548968 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.548724 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-oauth-serving-cert\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.548968 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.548922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-service-ca\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.549500 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.549470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-config\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.549637 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.549618 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-trusted-ca-bundle\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.550867 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.550847 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-serving-cert\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.551392 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.551371 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-oauth-config\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.560759 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.560738 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6mwx\" (UniqueName: \"kubernetes.io/projected/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-kube-api-access-c6mwx\") pod \"console-78cc9b99c4-fb8wn\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.604587 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.604556 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:36.741380 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:36.741358 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78cc9b99c4-fb8wn"] Jul 06 15:29:36.743599 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:29:36.743575 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9e5043_7e51_4c9d_9bc1_856f3d3e0cd4.slice/crio-588358dfe031c125e96aacef14bdd9ee1085d329658ef8c9e81e105db9eed469 WatchSource:0}: Error finding container 588358dfe031c125e96aacef14bdd9ee1085d329658ef8c9e81e105db9eed469: Status 404 returned error can't find the container with id 588358dfe031c125e96aacef14bdd9ee1085d329658ef8c9e81e105db9eed469 Jul 06 15:29:37.397759 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:37.397718 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cc9b99c4-fb8wn" event={"ID":"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4","Type":"ContainerStarted","Data":"18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af"} Jul 06 15:29:37.397939 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:37.397777 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cc9b99c4-fb8wn" event={"ID":"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4","Type":"ContainerStarted","Data":"588358dfe031c125e96aacef14bdd9ee1085d329658ef8c9e81e105db9eed469"} Jul 06 15:29:37.427918 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:37.427865 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78cc9b99c4-fb8wn" podStartSLOduration=1.4278473489999999 podStartE2EDuration="1.427847349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:29:37.426414554 +0000 UTC m=+256.522245933" watchObservedRunningTime="2026-07-06 15:29:37.427847349 +0000 UTC m=+256.523678728" Jul 06 15:29:46.605280 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:46.605194 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:46.605280 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:46.605251 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:46.610049 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:46.610024 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:47.438557 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:47.438523 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:29:47.631418 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:47.631384 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:47.732761 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:47.732664 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:29:47.833926 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:29:47.833886 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:15.139637 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:15.139603 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:21.308515 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:21.308487 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 15:30:42.221538 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:42.221501 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:42.347290 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:42.347246 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:46.079935 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.079901 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dd5445c6c-gb7zl"] Jul 06 15:30:46.082910 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.082894 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.101724 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.101696 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd5445c6c-gb7zl"] Jul 06 15:30:46.148762 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.148727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-trusted-ca-bundle\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.148922 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.148780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ktq\" (UniqueName: \"kubernetes.io/projected/d2b89435-ff18-4172-8234-9237d9dede3d-kube-api-access-t7ktq\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.148922 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.148807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-serving-cert\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.148922 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.148850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-console-config\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.148922 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.148882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-oauth-config\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.148922 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.148898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-service-ca\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.149122 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.148975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-oauth-serving-cert\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.249940 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.249893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-trusted-ca-bundle\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250142 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.249963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ktq\" (UniqueName: \"kubernetes.io/projected/d2b89435-ff18-4172-8234-9237d9dede3d-kube-api-access-t7ktq\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250142 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.250008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-serving-cert\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250142 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.250033 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-console-config\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250142 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.250085 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-oauth-config\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250142 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.250123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-service-ca\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250407 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.250168 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-oauth-serving-cert\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250850 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.250817 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-console-config\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250969 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.250936 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-trusted-ca-bundle\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.250969 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.250945 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-service-ca\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.251098 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.251022 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-oauth-serving-cert\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.253058 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.253032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-oauth-config\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.253222 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.253203 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-serving-cert\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.265132 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.265109 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ktq\" (UniqueName: \"kubernetes.io/projected/d2b89435-ff18-4172-8234-9237d9dede3d-kube-api-access-t7ktq\") pod \"console-dd5445c6c-gb7zl\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.285964 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.285938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:46.373993 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.373949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:46.391823 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.391798 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:46.528846 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.528797 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dd5445c6c-gb7zl"] Jul 06 15:30:46.532067 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:30:46.532031 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b89435_ff18_4172_8234_9237d9dede3d.slice/crio-c4150118d6c3d82324a426be333e48a43d04db09baa8188101353c10a0a5c468 WatchSource:0}: Error finding container c4150118d6c3d82324a426be333e48a43d04db09baa8188101353c10a0a5c468: Status 404 returned error can't find the container with id c4150118d6c3d82324a426be333e48a43d04db09baa8188101353c10a0a5c468 Jul 06 15:30:46.624142 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.624045 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd5445c6c-gb7zl" event={"ID":"d2b89435-ff18-4172-8234-9237d9dede3d","Type":"ContainerStarted","Data":"f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328"} Jul 06 15:30:46.624142 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.624103 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd5445c6c-gb7zl" event={"ID":"d2b89435-ff18-4172-8234-9237d9dede3d","Type":"ContainerStarted","Data":"c4150118d6c3d82324a426be333e48a43d04db09baa8188101353c10a0a5c468"} Jul 06 15:30:46.661253 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:46.661204 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dd5445c6c-gb7zl" podStartSLOduration=0.661185627 podStartE2EDuration="661.185627ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:30:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:30:46.660068668 +0000 UTC m=+325.755900048" watchObservedRunningTime="2026-07-06 15:30:46.661185627 +0000 UTC m=+325.757017006" Jul 06 15:30:54.153066 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:54.153032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:54.254127 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:54.254095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:56.392822 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:56.392784 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:56.393248 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:56.392890 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:56.397794 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:56.397772 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:56.662497 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:56.662416 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:30:56.728529 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:56.728490 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78cc9b99c4-fb8wn"] Jul 06 15:30:56.879882 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:56.879847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:56.986123 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:56.986033 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:30:57.082914 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:30:57.082881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:05.659022 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:05.658970 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:05.763875 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:05.763842 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:05.865364 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:05.865330 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:06.187773 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:06.187733 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:06.284311 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:06.284280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:12.579478 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:12.579440 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:12.721287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:12.721258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:21.749421 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:21.749337 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78cc9b99c4-fb8wn" podUID="2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" containerName="console" containerID="cri-o://18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af" gracePeriod=15 Jul 06 15:31:21.984519 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:21.984497 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:31:22.010590 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.010522 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-service-ca\") pod \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " Jul 06 15:31:22.010590 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.010574 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6mwx\" (UniqueName: \"kubernetes.io/projected/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-kube-api-access-c6mwx\") pod \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " Jul 06 15:31:22.010795 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.010680 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-trusted-ca-bundle\") pod \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " Jul 06 15:31:22.010795 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.010727 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-serving-cert\") pod \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " Jul 06 15:31:22.010795 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.010763 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-oauth-config\") pod \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " Jul 06 15:31:22.010942 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.010817 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-config\") pod \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " Jul 06 15:31:22.010942 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.010861 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-oauth-serving-cert\") pod \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\" (UID: \"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4\") " Jul 06 15:31:22.010942 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.010903 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" (UID: "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:31:22.011151 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.011095 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:31:22.011306 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.011269 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-config" (OuterVolumeSpecName: "console-config") pod "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" (UID: "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:31:22.011426 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.011303 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" (UID: "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:31:22.011426 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.011328 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" (UID: "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:31:22.013132 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.013105 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-kube-api-access-c6mwx" (OuterVolumeSpecName: "kube-api-access-c6mwx") pod "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" (UID: "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4"). InnerVolumeSpecName "kube-api-access-c6mwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:31:22.013380 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.013361 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" (UID: "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:31:22.013439 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.013388 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" (UID: "2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:31:22.111643 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.111615 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6mwx\" (UniqueName: \"kubernetes.io/projected/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-kube-api-access-c6mwx\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:31:22.111643 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.111635 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-trusted-ca-bundle\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:31:22.111643 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.111645 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:31:22.111850 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.111653 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-oauth-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:31:22.111850 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.111662 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-console-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:31:22.111850 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.111670 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4-oauth-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:31:22.749663 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.749629 2581 generic.go:356] "Generic (PLEG): container finished" podID="2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" containerID="18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af" exitCode=0 Jul 06 15:31:22.750166 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.749676 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78cc9b99c4-fb8wn" Jul 06 15:31:22.750166 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.749709 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cc9b99c4-fb8wn" event={"ID":"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4","Type":"ContainerDied","Data":"18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af"} Jul 06 15:31:22.750166 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.749758 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78cc9b99c4-fb8wn" event={"ID":"2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4","Type":"ContainerDied","Data":"588358dfe031c125e96aacef14bdd9ee1085d329658ef8c9e81e105db9eed469"} Jul 06 15:31:22.750166 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.749778 2581 scope.go:117] "RemoveContainer" containerID="18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af" Jul 06 15:31:22.758167 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.758148 2581 scope.go:117] "RemoveContainer" containerID="18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af" Jul 06 15:31:22.758485 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:31:22.758463 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af\": container with ID starting with 18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af not found: ID does not exist" containerID="18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af" Jul 06 15:31:22.758555 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.758493 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af"} err="failed to get container status \"18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af\": rpc error: code = NotFound desc = could not find container \"18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af\": container with ID starting with 18efc775b7105d5898c0669d0dc223f8c3318657af5d258677536f04feb4a5af not found: ID does not exist" Jul 06 15:31:22.772859 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.772830 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78cc9b99c4-fb8wn"] Jul 06 15:31:22.777217 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:22.777196 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78cc9b99c4-fb8wn"] Jul 06 15:31:23.442208 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:23.442178 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" path="/var/lib/kubelet/pods/2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4/volumes" Jul 06 15:31:23.852285 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:23.852256 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:28.742703 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:28.742672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:29.534469 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.534429 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:29.565093 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.565061 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5"] Jul 06 15:31:29.565327 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.565314 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" containerName="console" Jul 06 15:31:29.565368 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.565329 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" containerName="console" Jul 06 15:31:29.565400 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.565372 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f9e5043-7e51-4c9d-9bc1-856f3d3e0cd4" containerName="console" Jul 06 15:31:29.570477 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.570445 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" Jul 06 15:31:29.574599 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.574578 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 15:31:29.574599 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.574588 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 15:31:29.574810 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.574588 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 15:31:29.574810 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.574640 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 15:31:29.574810 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.574654 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-rc5kh\"" Jul 06 15:31:29.581936 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.581913 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5"] Jul 06 15:31:29.608559 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.608537 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm"] Jul 06 15:31:29.611625 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.611610 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.614085 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.614061 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 15:31:29.614085 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.614081 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 15:31:29.614338 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.614325 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 15:31:29.614419 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.614384 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 15:31:29.629287 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.629262 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm"] Jul 06 15:31:29.631092 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.631068 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:31:29.663658 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.663632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tztc8\" (UniqueName: \"kubernetes.io/projected/cd071759-4292-471f-b512-420daa15cd83-kube-api-access-tztc8\") pod \"managed-serviceaccount-addon-agent-54848d999b-bhsk5\" (UID: \"cd071759-4292-471f-b512-420daa15cd83\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" Jul 06 15:31:29.663769 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.663666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.663769 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.663693 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd071759-4292-471f-b512-420daa15cd83-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54848d999b-bhsk5\" (UID: \"cd071759-4292-471f-b512-420daa15cd83\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" Jul 06 15:31:29.663769 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.663727 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-ca\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.663931 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.663807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zn8w\" (UniqueName: \"kubernetes.io/projected/df2e4988-6406-47e3-8e4f-5df50508e287-kube-api-access-9zn8w\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.663931 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.663902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-hub\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.664047 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.663937 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.664249 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.664220 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2e4988-6406-47e3-8e4f-5df50508e287-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.765452 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.765423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zn8w\" (UniqueName: \"kubernetes.io/projected/df2e4988-6406-47e3-8e4f-5df50508e287-kube-api-access-9zn8w\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.765896 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.765461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-hub\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.765896 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.765478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.765896 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.765513 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2e4988-6406-47e3-8e4f-5df50508e287-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.765896 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.765539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tztc8\" (UniqueName: \"kubernetes.io/projected/cd071759-4292-471f-b512-420daa15cd83-kube-api-access-tztc8\") pod \"managed-serviceaccount-addon-agent-54848d999b-bhsk5\" (UID: \"cd071759-4292-471f-b512-420daa15cd83\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" Jul 06 15:31:29.765896 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.765557 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.765896 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.765578 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd071759-4292-471f-b512-420daa15cd83-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54848d999b-bhsk5\" (UID: \"cd071759-4292-471f-b512-420daa15cd83\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" Jul 06 15:31:29.765896 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.765609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-ca\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.766495 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.766467 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/df2e4988-6406-47e3-8e4f-5df50508e287-additional-service-ca\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.768306 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.768283 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-hub\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.768411 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.768359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.768470 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.768447 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-ca\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.768568 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.768550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/df2e4988-6406-47e3-8e4f-5df50508e287-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.768958 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.768935 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cd071759-4292-471f-b512-420daa15cd83-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54848d999b-bhsk5\" (UID: \"cd071759-4292-471f-b512-420daa15cd83\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" Jul 06 15:31:29.774895 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.774869 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zn8w\" (UniqueName: \"kubernetes.io/projected/df2e4988-6406-47e3-8e4f-5df50508e287-kube-api-access-9zn8w\") pod \"cluster-proxy-proxy-agent-646cc4b64-kgpdm\" (UID: \"df2e4988-6406-47e3-8e4f-5df50508e287\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:29.775236 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.775218 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tztc8\" (UniqueName: \"kubernetes.io/projected/cd071759-4292-471f-b512-420daa15cd83-kube-api-access-tztc8\") pod \"managed-serviceaccount-addon-agent-54848d999b-bhsk5\" (UID: \"cd071759-4292-471f-b512-420daa15cd83\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" Jul 06 15:31:29.895383 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.895350 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" Jul 06 15:31:29.920272 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:29.920248 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" Jul 06 15:31:30.034824 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:30.034755 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5"] Jul 06 15:31:30.036897 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:31:30.036871 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd071759_4292_471f_b512_420daa15cd83.slice/crio-bd53375000caa57584a9969d56b2f88e796dbc196431dcbb4b4df1a93ecbf8e4 WatchSource:0}: Error finding container bd53375000caa57584a9969d56b2f88e796dbc196431dcbb4b4df1a93ecbf8e4: Status 404 returned error can't find the container with id bd53375000caa57584a9969d56b2f88e796dbc196431dcbb4b4df1a93ecbf8e4 Jul 06 15:31:30.038759 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:30.038738 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:31:30.059864 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:30.059844 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm"] Jul 06 15:31:30.060952 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:31:30.060930 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf2e4988_6406_47e3_8e4f_5df50508e287.slice/crio-dc17972ad195a0038623e887acfc18834be50fe6b0fc09bda1ba05d4e8c48e41 WatchSource:0}: Error finding container dc17972ad195a0038623e887acfc18834be50fe6b0fc09bda1ba05d4e8c48e41: Status 404 returned error can't find the container with id dc17972ad195a0038623e887acfc18834be50fe6b0fc09bda1ba05d4e8c48e41 Jul 06 15:31:30.777489 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:30.777445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" event={"ID":"df2e4988-6406-47e3-8e4f-5df50508e287","Type":"ContainerStarted","Data":"dc17972ad195a0038623e887acfc18834be50fe6b0fc09bda1ba05d4e8c48e41"} Jul 06 15:31:30.778464 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:30.778442 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" event={"ID":"cd071759-4292-471f-b512-420daa15cd83","Type":"ContainerStarted","Data":"bd53375000caa57584a9969d56b2f88e796dbc196431dcbb4b4df1a93ecbf8e4"} Jul 06 15:31:34.798431 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:34.798386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" event={"ID":"df2e4988-6406-47e3-8e4f-5df50508e287","Type":"ContainerStarted","Data":"7373f2f41ac44c97903dfe69a4fb288b52be29278cd998eb6acf08c8ba3a20ac"} Jul 06 15:31:34.798431 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:34.798435 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" event={"ID":"df2e4988-6406-47e3-8e4f-5df50508e287","Type":"ContainerStarted","Data":"f96f0fee2cae4e5a5f12bab697b7b2c8906603cf6ab9ef8dd15b9cd2f54734ed"} Jul 06 15:31:34.798966 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:34.798448 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" event={"ID":"df2e4988-6406-47e3-8e4f-5df50508e287","Type":"ContainerStarted","Data":"cab96ccfae2282fc217b43739fc68ee0619d7f02275ddd1f820a2a14dc4d4d15"} Jul 06 15:31:34.799884 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:34.799857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" event={"ID":"cd071759-4292-471f-b512-420daa15cd83","Type":"ContainerStarted","Data":"0cdb9eebc5d466acd0cb617d9a2e2066480ce4f2b3e4ad7ac82f4e4e4f61ef03"} Jul 06 15:31:34.823231 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:34.823188 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-646cc4b64-kgpdm" podStartSLOduration=1.721259936 podStartE2EDuration="5.823174579s" totalImagesPullingTime="4.101914643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:31:34.821198852 +0000 UTC m=+373.917030233" watchObservedRunningTime="2026-07-06 15:31:34.823174579 +0000 UTC m=+373.919005958" Jul 06 15:31:34.838826 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:31:34.838783 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54848d999b-bhsk5" podStartSLOduration=1.7237749359999999 podStartE2EDuration="5.83876955s" totalImagesPullingTime="4.114994614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:31:34.838196116 +0000 UTC m=+373.934027495" watchObservedRunningTime="2026-07-06 15:31:34.83876955 +0000 UTC m=+373.934600930" Jul 06 15:32:44.634695 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:32:44.634606 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:32:46.663462 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:32:46.663420 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:12.366824 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:12.366784 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:12.482504 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:12.482471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:17.091110 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:17.091069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:17.205645 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:17.205612 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:17.899514 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:17.899471 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:18.022118 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:18.022063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:23.869262 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:23.869222 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:24.228328 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:24.228211 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:24.707812 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:24.707779 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:25.087701 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:25.087671 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:25.215029 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:25.214995 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:25.375897 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:25.375804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:25.487852 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:25.487813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:25.713646 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:25.713557 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:25.910213 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:25.910160 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:26.104451 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:26.104412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:26.390925 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:26.390837 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:33:26.506200 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:33:26.506171 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:45.236069 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.235960 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:45.342586 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.342549 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:45.438167 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.438129 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:45.531798 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.531708 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-fthr7"] Jul 06 15:34:45.534809 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.534787 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:45.542164 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.542137 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:45.543136 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.543117 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 15:34:45.543136 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.543134 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 15:34:45.543704 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.543691 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-l7k5x\"" Jul 06 15:34:45.543743 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.543710 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 15:34:45.563930 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.563897 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-fthr7"] Jul 06 15:34:45.638728 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.638690 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d60abe1e-8e3d-47f7-a1b1-637dbcd64aac-data\") pod \"seaweedfs-64568bcd49-fthr7\" (UID: \"d60abe1e-8e3d-47f7-a1b1-637dbcd64aac\") " pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:45.638898 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.638741 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6d8\" (UniqueName: \"kubernetes.io/projected/d60abe1e-8e3d-47f7-a1b1-637dbcd64aac-kube-api-access-bp6d8\") pod \"seaweedfs-64568bcd49-fthr7\" (UID: \"d60abe1e-8e3d-47f7-a1b1-637dbcd64aac\") " pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:45.653449 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.653412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:45.739928 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.739893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6d8\" (UniqueName: \"kubernetes.io/projected/d60abe1e-8e3d-47f7-a1b1-637dbcd64aac-kube-api-access-bp6d8\") pod \"seaweedfs-64568bcd49-fthr7\" (UID: \"d60abe1e-8e3d-47f7-a1b1-637dbcd64aac\") " pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:45.740109 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.739959 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d60abe1e-8e3d-47f7-a1b1-637dbcd64aac-data\") pod \"seaweedfs-64568bcd49-fthr7\" (UID: \"d60abe1e-8e3d-47f7-a1b1-637dbcd64aac\") " pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:45.740298 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.740277 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d60abe1e-8e3d-47f7-a1b1-637dbcd64aac-data\") pod \"seaweedfs-64568bcd49-fthr7\" (UID: \"d60abe1e-8e3d-47f7-a1b1-637dbcd64aac\") " pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:45.770060 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.770032 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6d8\" (UniqueName: \"kubernetes.io/projected/d60abe1e-8e3d-47f7-a1b1-637dbcd64aac-kube-api-access-bp6d8\") pod \"seaweedfs-64568bcd49-fthr7\" (UID: \"d60abe1e-8e3d-47f7-a1b1-637dbcd64aac\") " pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:45.843799 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.843771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:45.986519 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:45.986484 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-fthr7"] Jul 06 15:34:45.990013 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:34:45.989949 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60abe1e_8e3d_47f7_a1b1_637dbcd64aac.slice/crio-2cea6d765397d343f9c7d71d83f941a7c5da369338224179f84093711fe73d9e WatchSource:0}: Error finding container 2cea6d765397d343f9c7d71d83f941a7c5da369338224179f84093711fe73d9e: Status 404 returned error can't find the container with id 2cea6d765397d343f9c7d71d83f941a7c5da369338224179f84093711fe73d9e Jul 06 15:34:46.447934 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:46.447885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-fthr7" event={"ID":"d60abe1e-8e3d-47f7-a1b1-637dbcd64aac","Type":"ContainerStarted","Data":"2cea6d765397d343f9c7d71d83f941a7c5da369338224179f84093711fe73d9e"} Jul 06 15:34:46.466251 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:46.466214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:46.558066 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:46.558032 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:46.669583 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:46.669537 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:50.225890 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:50.225853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:34:50.463679 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:50.463638 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-fthr7" event={"ID":"d60abe1e-8e3d-47f7-a1b1-637dbcd64aac","Type":"ContainerStarted","Data":"668bb60476e1d6cec4e4247f03abff2ba4820a8671e967c7d001a4ed44b3995c"} Jul 06 15:34:50.463845 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:50.463763 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:34:50.489147 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:50.489064 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-fthr7" podStartSLOduration=2.013933836 podStartE2EDuration="5.48905274s" totalImagesPullingTime="3.475118904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:34:50.488389037 +0000 UTC m=+569.584220419" watchObservedRunningTime="2026-07-06 15:34:50.48905274 +0000 UTC m=+569.584884120" Jul 06 15:34:56.468639 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:34:56.468604 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-fthr7" Jul 06 15:35:00.998668 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:00.998629 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd5445c6c-gb7zl"] Jul 06 15:35:01.265542 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:01.265447 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:01.411380 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:01.411344 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:07.090734 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:07.090696 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:26.018488 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.018425 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-dd5445c6c-gb7zl" podUID="d2b89435-ff18-4172-8234-9237d9dede3d" containerName="console" containerID="cri-o://f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328" gracePeriod=15 Jul 06 15:35:26.263010 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.262973 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:35:26.363161 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363127 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7ktq\" (UniqueName: \"kubernetes.io/projected/d2b89435-ff18-4172-8234-9237d9dede3d-kube-api-access-t7ktq\") pod \"d2b89435-ff18-4172-8234-9237d9dede3d\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " Jul 06 15:35:26.363338 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363174 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-console-config\") pod \"d2b89435-ff18-4172-8234-9237d9dede3d\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " Jul 06 15:35:26.363338 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363190 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-service-ca\") pod \"d2b89435-ff18-4172-8234-9237d9dede3d\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " Jul 06 15:35:26.363338 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363206 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-oauth-serving-cert\") pod \"d2b89435-ff18-4172-8234-9237d9dede3d\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " Jul 06 15:35:26.363338 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363231 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-serving-cert\") pod \"d2b89435-ff18-4172-8234-9237d9dede3d\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " Jul 06 15:35:26.363338 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363282 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-oauth-config\") pod \"d2b89435-ff18-4172-8234-9237d9dede3d\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " Jul 06 15:35:26.363338 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363333 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-trusted-ca-bundle\") pod \"d2b89435-ff18-4172-8234-9237d9dede3d\" (UID: \"d2b89435-ff18-4172-8234-9237d9dede3d\") " Jul 06 15:35:26.363652 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363575 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-service-ca" (OuterVolumeSpecName: "service-ca") pod "d2b89435-ff18-4172-8234-9237d9dede3d" (UID: "d2b89435-ff18-4172-8234-9237d9dede3d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:35:26.363725 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363712 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-service-ca\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:35:26.363775 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363748 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d2b89435-ff18-4172-8234-9237d9dede3d" (UID: "d2b89435-ff18-4172-8234-9237d9dede3d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:35:26.363775 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363758 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-console-config" (OuterVolumeSpecName: "console-config") pod "d2b89435-ff18-4172-8234-9237d9dede3d" (UID: "d2b89435-ff18-4172-8234-9237d9dede3d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:35:26.363870 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.363782 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d2b89435-ff18-4172-8234-9237d9dede3d" (UID: "d2b89435-ff18-4172-8234-9237d9dede3d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:35:26.365498 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.365469 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d2b89435-ff18-4172-8234-9237d9dede3d" (UID: "d2b89435-ff18-4172-8234-9237d9dede3d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:35:26.365608 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.365521 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b89435-ff18-4172-8234-9237d9dede3d-kube-api-access-t7ktq" (OuterVolumeSpecName: "kube-api-access-t7ktq") pod "d2b89435-ff18-4172-8234-9237d9dede3d" (UID: "d2b89435-ff18-4172-8234-9237d9dede3d"). InnerVolumeSpecName "kube-api-access-t7ktq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:35:26.365608 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.365549 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d2b89435-ff18-4172-8234-9237d9dede3d" (UID: "d2b89435-ff18-4172-8234-9237d9dede3d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:35:26.464806 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.464762 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-oauth-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:35:26.464806 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.464795 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-trusted-ca-bundle\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:35:26.464806 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.464805 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7ktq\" (UniqueName: \"kubernetes.io/projected/d2b89435-ff18-4172-8234-9237d9dede3d-kube-api-access-t7ktq\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:35:26.464806 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.464814 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-console-config\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:35:26.465112 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.464823 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d2b89435-ff18-4172-8234-9237d9dede3d-oauth-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:35:26.465112 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.464831 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2b89435-ff18-4172-8234-9237d9dede3d-console-serving-cert\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:35:26.585587 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.585553 2581 generic.go:356] "Generic (PLEG): container finished" podID="d2b89435-ff18-4172-8234-9237d9dede3d" containerID="f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328" exitCode=0 Jul 06 15:35:26.585756 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.585598 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dd5445c6c-gb7zl" Jul 06 15:35:26.585756 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.585604 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd5445c6c-gb7zl" event={"ID":"d2b89435-ff18-4172-8234-9237d9dede3d","Type":"ContainerDied","Data":"f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328"} Jul 06 15:35:26.585756 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.585644 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dd5445c6c-gb7zl" event={"ID":"d2b89435-ff18-4172-8234-9237d9dede3d","Type":"ContainerDied","Data":"c4150118d6c3d82324a426be333e48a43d04db09baa8188101353c10a0a5c468"} Jul 06 15:35:26.585756 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.585662 2581 scope.go:117] "RemoveContainer" containerID="f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328" Jul 06 15:35:26.593966 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.593941 2581 scope.go:117] "RemoveContainer" containerID="f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328" Jul 06 15:35:26.594277 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:35:26.594259 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328\": container with ID starting with f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328 not found: ID does not exist" containerID="f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328" Jul 06 15:35:26.594330 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.594286 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328"} err="failed to get container status \"f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328\": rpc error: code = NotFound desc = could not find container \"f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328\": container with ID starting with f39bbee66056f2435fc955e74b35fd0a8c1b793624485af364c4888f6f087328 not found: ID does not exist" Jul 06 15:35:26.611285 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.611261 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-dd5445c6c-gb7zl"] Jul 06 15:35:26.617393 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:26.617342 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-dd5445c6c-gb7zl"] Jul 06 15:35:27.439725 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:27.439682 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b89435-ff18-4172-8234-9237d9dede3d" path="/var/lib/kubelet/pods/d2b89435-ff18-4172-8234-9237d9dede3d/volumes" Jul 06 15:35:44.996066 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:44.995965 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:54.501120 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.501078 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:54.583107 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.583077 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-kxjv6"] Jul 06 15:35:54.583324 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.583313 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b89435-ff18-4172-8234-9237d9dede3d" containerName="console" Jul 06 15:35:54.583367 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.583326 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b89435-ff18-4172-8234-9237d9dede3d" containerName="console" Jul 06 15:35:54.583403 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.583378 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b89435-ff18-4172-8234-9237d9dede3d" containerName="console" Jul 06 15:35:54.586068 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.586052 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:54.589026 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.589000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:54.589779 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.589763 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-xx95d\"" Jul 06 15:35:54.590016 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.590001 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 06 15:35:54.600037 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.600014 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-kxjv6"] Jul 06 15:35:54.677288 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.677252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert\") pod \"odh-model-controller-84b54b7f97-kxjv6\" (UID: \"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8\") " pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:54.677463 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.677296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2klkk\" (UniqueName: \"kubernetes.io/projected/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-kube-api-access-2klkk\") pod \"odh-model-controller-84b54b7f97-kxjv6\" (UID: \"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8\") " pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:54.778749 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.778659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2klkk\" (UniqueName: \"kubernetes.io/projected/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-kube-api-access-2klkk\") pod \"odh-model-controller-84b54b7f97-kxjv6\" (UID: \"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8\") " pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:54.778926 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.778757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert\") pod \"odh-model-controller-84b54b7f97-kxjv6\" (UID: \"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8\") " pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:54.778926 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:35:54.778867 2581 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 15:35:54.778926 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:35:54.778922 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert podName:9ca2d024-b430-49cb-aa5a-c9aff8a74ad8 nodeName:}" failed. No retries permitted until 2026-07-06 15:35:55.278903241 +0000 UTC m=+634.374734603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert") pod "odh-model-controller-84b54b7f97-kxjv6" (UID: "9ca2d024-b430-49cb-aa5a-c9aff8a74ad8") : secret "odh-model-controller-webhook-cert" not found Jul 06 15:35:54.792768 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.792743 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2klkk\" (UniqueName: \"kubernetes.io/projected/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-kube-api-access-2klkk\") pod \"odh-model-controller-84b54b7f97-kxjv6\" (UID: \"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8\") " pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:54.800565 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:54.800538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:55.284354 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:55.284308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert\") pod \"odh-model-controller-84b54b7f97-kxjv6\" (UID: \"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8\") " pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:55.284539 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:35:55.284462 2581 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 15:35:55.284539 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:35:55.284522 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert podName:9ca2d024-b430-49cb-aa5a-c9aff8a74ad8 nodeName:}" failed. No retries permitted until 2026-07-06 15:35:56.28450587 +0000 UTC m=+635.380337240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert") pod "odh-model-controller-84b54b7f97-kxjv6" (UID: "9ca2d024-b430-49cb-aa5a-c9aff8a74ad8") : secret "odh-model-controller-webhook-cert" not found Jul 06 15:35:55.648923 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:55.648888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:55.729545 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:55.729511 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:35:56.291200 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:56.291155 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert\") pod \"odh-model-controller-84b54b7f97-kxjv6\" (UID: \"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8\") " pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:56.293565 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:56.293536 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9ca2d024-b430-49cb-aa5a-c9aff8a74ad8-cert\") pod \"odh-model-controller-84b54b7f97-kxjv6\" (UID: \"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8\") " pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:56.396438 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:56.396403 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:56.534387 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:56.534355 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-kxjv6"] Jul 06 15:35:56.538206 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:35:56.538171 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca2d024_b430_49cb_aa5a_c9aff8a74ad8.slice/crio-6395352a8281fb72b4791aa28d1337e48f2419e8ea207f906d88e463c0c8c887 WatchSource:0}: Error finding container 6395352a8281fb72b4791aa28d1337e48f2419e8ea207f906d88e463c0c8c887: Status 404 returned error can't find the container with id 6395352a8281fb72b4791aa28d1337e48f2419e8ea207f906d88e463c0c8c887 Jul 06 15:35:56.688087 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:56.688049 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-kxjv6" event={"ID":"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8","Type":"ContainerStarted","Data":"6395352a8281fb72b4791aa28d1337e48f2419e8ea207f906d88e463c0c8c887"} Jul 06 15:35:59.704319 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:59.704288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-kxjv6" event={"ID":"9ca2d024-b430-49cb-aa5a-c9aff8a74ad8","Type":"ContainerStarted","Data":"56b3b2f4f7b8dfada68f9148c741da06883d70b059ed31ab6788be2a8828e495"} Jul 06 15:35:59.704675 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:59.704365 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:35:59.739451 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:35:59.739334 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-kxjv6" podStartSLOduration=2.81312942 podStartE2EDuration="5.739317021s" totalImagesPullingTime="2.926187601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:35:59.738894645 +0000 UTC m=+638.834726025" watchObservedRunningTime="2026-07-06 15:35:59.739317021 +0000 UTC m=+638.835148400" Jul 06 15:36:10.709790 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:10.709755 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-kxjv6" Jul 06 15:36:11.741859 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:11.741820 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-sgsmx"] Jul 06 15:36:11.745256 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:11.745234 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sgsmx" Jul 06 15:36:11.760884 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:11.760857 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-sgsmx"] Jul 06 15:36:11.920471 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:11.920428 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzdhl\" (UniqueName: \"kubernetes.io/projected/9df00f7f-3e59-4e6c-ac87-d1977653d41a-kube-api-access-qzdhl\") pod \"s3-init-sgsmx\" (UID: \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\") " pod="kserve/s3-init-sgsmx" Jul 06 15:36:11.920646 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:11.920503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df00f7f-3e59-4e6c-ac87-d1977653d41a-model-cache\") pod \"s3-init-sgsmx\" (UID: \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\") " pod="kserve/s3-init-sgsmx" Jul 06 15:36:12.021109 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:12.021030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df00f7f-3e59-4e6c-ac87-d1977653d41a-model-cache\") pod \"s3-init-sgsmx\" (UID: \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\") " pod="kserve/s3-init-sgsmx" Jul 06 15:36:12.021109 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:12.021092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzdhl\" (UniqueName: \"kubernetes.io/projected/9df00f7f-3e59-4e6c-ac87-d1977653d41a-kube-api-access-qzdhl\") pod \"s3-init-sgsmx\" (UID: \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\") " pod="kserve/s3-init-sgsmx" Jul 06 15:36:12.021438 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:12.021418 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df00f7f-3e59-4e6c-ac87-d1977653d41a-model-cache\") pod \"s3-init-sgsmx\" (UID: \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\") " pod="kserve/s3-init-sgsmx" Jul 06 15:36:12.031059 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:12.031029 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzdhl\" (UniqueName: \"kubernetes.io/projected/9df00f7f-3e59-4e6c-ac87-d1977653d41a-kube-api-access-qzdhl\") pod \"s3-init-sgsmx\" (UID: \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\") " pod="kserve/s3-init-sgsmx" Jul 06 15:36:12.053277 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:12.053246 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sgsmx" Jul 06 15:36:12.197734 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:12.197709 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-sgsmx"] Jul 06 15:36:12.199598 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:36:12.199573 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9df00f7f_3e59_4e6c_ac87_d1977653d41a.slice/crio-0513b9aee7aacc9c366d2b38e9e5b1d2ee09dc482a1c2c30fbf4e525e8810101 WatchSource:0}: Error finding container 0513b9aee7aacc9c366d2b38e9e5b1d2ee09dc482a1c2c30fbf4e525e8810101: Status 404 returned error can't find the container with id 0513b9aee7aacc9c366d2b38e9e5b1d2ee09dc482a1c2c30fbf4e525e8810101 Jul 06 15:36:12.750989 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:12.750943 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sgsmx" event={"ID":"9df00f7f-3e59-4e6c-ac87-d1977653d41a","Type":"ContainerStarted","Data":"0513b9aee7aacc9c366d2b38e9e5b1d2ee09dc482a1c2c30fbf4e525e8810101"} Jul 06 15:36:16.768810 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:16.768525 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sgsmx" event={"ID":"9df00f7f-3e59-4e6c-ac87-d1977653d41a","Type":"ContainerStarted","Data":"056c23bd70af735480ae4b95d2e840e34fa84d284fa90444f3437312550d15ad"} Jul 06 15:36:17.773664 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:17.773631 2581 generic.go:356] "Generic (PLEG): container finished" podID="9df00f7f-3e59-4e6c-ac87-d1977653d41a" containerID="056c23bd70af735480ae4b95d2e840e34fa84d284fa90444f3437312550d15ad" exitCode=0 Jul 06 15:36:17.774076 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:17.773713 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sgsmx" event={"ID":"9df00f7f-3e59-4e6c-ac87-d1977653d41a","Type":"ContainerDied","Data":"056c23bd70af735480ae4b95d2e840e34fa84d284fa90444f3437312550d15ad"} Jul 06 15:36:23.798584 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:23.798546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sgsmx" event={"ID":"9df00f7f-3e59-4e6c-ac87-d1977653d41a","Type":"ContainerStarted","Data":"ac4b7f2d28f4ba44b7784ee7acef962b7db51769ae1d35d442de7b1484c7836c"} Jul 06 15:36:23.827091 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:36:23.827035 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-sgsmx" podStartSLOduration=2.180689828 podStartE2EDuration="12.827020296s" totalImagesPullingTime="9.161882391s" totalInitContainerRuntime="1.484448077s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:36:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:36:23.826925316 +0000 UTC m=+662.922756697" watchObservedRunningTime="2026-07-06 15:36:23.827020296 +0000 UTC m=+662.922851674" Jul 06 15:37:08.223832 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:08.223796 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:29.023320 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:29.023283 2581 generic.go:356] "Generic (PLEG): container finished" podID="9df00f7f-3e59-4e6c-ac87-d1977653d41a" containerID="ac4b7f2d28f4ba44b7784ee7acef962b7db51769ae1d35d442de7b1484c7836c" exitCode=0 Jul 06 15:37:29.023684 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:29.023360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sgsmx" event={"ID":"9df00f7f-3e59-4e6c-ac87-d1977653d41a","Type":"ContainerDied","Data":"ac4b7f2d28f4ba44b7784ee7acef962b7db51769ae1d35d442de7b1484c7836c"} Jul 06 15:37:30.150813 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:30.150791 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sgsmx" Jul 06 15:37:30.223732 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:30.223697 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzdhl\" (UniqueName: \"kubernetes.io/projected/9df00f7f-3e59-4e6c-ac87-d1977653d41a-kube-api-access-qzdhl\") pod \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\" (UID: \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\") " Jul 06 15:37:30.223914 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:30.223783 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df00f7f-3e59-4e6c-ac87-d1977653d41a-model-cache\") pod \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\" (UID: \"9df00f7f-3e59-4e6c-ac87-d1977653d41a\") " Jul 06 15:37:30.225951 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:30.225926 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df00f7f-3e59-4e6c-ac87-d1977653d41a-kube-api-access-qzdhl" (OuterVolumeSpecName: "kube-api-access-qzdhl") pod "9df00f7f-3e59-4e6c-ac87-d1977653d41a" (UID: "9df00f7f-3e59-4e6c-ac87-d1977653d41a"). InnerVolumeSpecName "kube-api-access-qzdhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:37:30.245673 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:30.245635 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df00f7f-3e59-4e6c-ac87-d1977653d41a-model-cache" (OuterVolumeSpecName: "model-cache") pod "9df00f7f-3e59-4e6c-ac87-d1977653d41a" (UID: "9df00f7f-3e59-4e6c-ac87-d1977653d41a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:37:30.324758 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:30.324662 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9df00f7f-3e59-4e6c-ac87-d1977653d41a-model-cache\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:37:30.324758 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:30.324733 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzdhl\" (UniqueName: \"kubernetes.io/projected/9df00f7f-3e59-4e6c-ac87-d1977653d41a-kube-api-access-qzdhl\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:37:31.031864 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.031826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sgsmx" event={"ID":"9df00f7f-3e59-4e6c-ac87-d1977653d41a","Type":"ContainerDied","Data":"0513b9aee7aacc9c366d2b38e9e5b1d2ee09dc482a1c2c30fbf4e525e8810101"} Jul 06 15:37:31.031864 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.031865 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0513b9aee7aacc9c366d2b38e9e5b1d2ee09dc482a1c2c30fbf4e525e8810101" Jul 06 15:37:31.031864 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.031867 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sgsmx" Jul 06 15:37:31.809887 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.809852 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms"] Jul 06 15:37:31.810292 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.810125 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df00f7f-3e59-4e6c-ac87-d1977653d41a" containerName="s3-init" Jul 06 15:37:31.810292 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.810137 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df00f7f-3e59-4e6c-ac87-d1977653d41a" containerName="s3-init" Jul 06 15:37:31.810292 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.810145 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df00f7f-3e59-4e6c-ac87-d1977653d41a" containerName="download-hf-model" Jul 06 15:37:31.810292 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.810150 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df00f7f-3e59-4e6c-ac87-d1977653d41a" containerName="download-hf-model" Jul 06 15:37:31.810292 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.810192 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df00f7f-3e59-4e6c-ac87-d1977653d41a" containerName="s3-init" Jul 06 15:37:31.812075 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.812060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:31.815055 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.815025 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 06 15:37:31.815865 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.815839 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:31.822301 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.822269 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms"] Jul 06 15:37:31.833300 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.833275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-sdvms\" (UID: \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:31.833443 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.833320 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58hx6\" (UniqueName: \"kubernetes.io/projected/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-kube-api-access-58hx6\") pod \"seaweedfs-tls-custom-6644bf5d6c-sdvms\" (UID: \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:31.934164 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.934129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-sdvms\" (UID: \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:31.934333 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.934189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58hx6\" (UniqueName: \"kubernetes.io/projected/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-kube-api-access-58hx6\") pod \"seaweedfs-tls-custom-6644bf5d6c-sdvms\" (UID: \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:31.934536 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.934517 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-data\") pod \"seaweedfs-tls-custom-6644bf5d6c-sdvms\" (UID: \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:31.945347 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:31.945319 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58hx6\" (UniqueName: \"kubernetes.io/projected/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-kube-api-access-58hx6\") pod \"seaweedfs-tls-custom-6644bf5d6c-sdvms\" (UID: \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\") " pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:32.120846 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:32.120816 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:32.245471 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:32.245427 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms"] Jul 06 15:37:32.247694 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:37:32.247669 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77ef3e2_6a38_40c0_80e8_fc51d98e8f3f.slice/crio-0cefdf9307aee3266cd44f54666bbe0ff7d770adc5b28db2b8d467894e936076 WatchSource:0}: Error finding container 0cefdf9307aee3266cd44f54666bbe0ff7d770adc5b28db2b8d467894e936076: Status 404 returned error can't find the container with id 0cefdf9307aee3266cd44f54666bbe0ff7d770adc5b28db2b8d467894e936076 Jul 06 15:37:32.249017 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:32.248997 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:37:33.040090 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:33.040050 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" event={"ID":"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f","Type":"ContainerStarted","Data":"502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b"} Jul 06 15:37:33.040560 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:33.040105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" event={"ID":"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f","Type":"ContainerStarted","Data":"0cefdf9307aee3266cd44f54666bbe0ff7d770adc5b28db2b8d467894e936076"} Jul 06 15:37:33.061537 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:33.061484 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" podStartSLOduration=1.727946975 podStartE2EDuration="2.061468789s" totalImagesPullingTime="333.521814ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:33.061130711 +0000 UTC m=+732.156962090" watchObservedRunningTime="2026-07-06 15:37:33.061468789 +0000 UTC m=+732.157300167" Jul 06 15:37:35.474632 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:35.474600 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms"] Jul 06 15:37:35.475110 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:35.474778 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" podUID="b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f" containerName="seaweedfs-tls-custom" containerID="cri-o://502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b" gracePeriod=30 Jul 06 15:37:36.708253 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:36.708222 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:36.773802 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:36.773718 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-data\") pod \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\" (UID: \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\") " Jul 06 15:37:36.773802 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:36.773764 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58hx6\" (UniqueName: \"kubernetes.io/projected/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-kube-api-access-58hx6\") pod \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\" (UID: \"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f\") " Jul 06 15:37:36.774875 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:36.774843 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-data" (OuterVolumeSpecName: "data") pod "b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f" (UID: "b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f"). InnerVolumeSpecName "data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:37:36.775784 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:36.775753 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-kube-api-access-58hx6" (OuterVolumeSpecName: "kube-api-access-58hx6") pod "b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f" (UID: "b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f"). InnerVolumeSpecName "kube-api-access-58hx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:37:36.874812 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:36.874780 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58hx6\" (UniqueName: \"kubernetes.io/projected/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-kube-api-access-58hx6\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:37:36.874812 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:36.874805 2581 reconciler_common.go:299] "Volume detached for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f-data\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:37:37.054693 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.054610 2581 generic.go:356] "Generic (PLEG): container finished" podID="b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f" containerID="502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b" exitCode=0 Jul 06 15:37:37.054693 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.054651 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" Jul 06 15:37:37.054853 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.054697 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" event={"ID":"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f","Type":"ContainerDied","Data":"502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b"} Jul 06 15:37:37.054853 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.054742 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms" event={"ID":"b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f","Type":"ContainerDied","Data":"0cefdf9307aee3266cd44f54666bbe0ff7d770adc5b28db2b8d467894e936076"} Jul 06 15:37:37.054853 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.054762 2581 scope.go:117] "RemoveContainer" containerID="502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b" Jul 06 15:37:37.063307 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.063289 2581 scope.go:117] "RemoveContainer" containerID="502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b" Jul 06 15:37:37.063562 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:37:37.063546 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b\": container with ID starting with 502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b not found: ID does not exist" containerID="502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b" Jul 06 15:37:37.063626 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.063570 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b"} err="failed to get container status \"502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b\": rpc error: code = NotFound desc = could not find container \"502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b\": container with ID starting with 502040cafc0a2fa1d3584b81b67dd947b896e891b60f205a8261e3300b0b155b not found: ID does not exist" Jul 06 15:37:37.077761 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.077740 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms"] Jul 06 15:37:37.082307 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.082284 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/seaweedfs-tls-custom-6644bf5d6c-sdvms"] Jul 06 15:37:37.119492 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.119462 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-kb44q"] Jul 06 15:37:37.119717 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.119705 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f" containerName="seaweedfs-tls-custom" Jul 06 15:37:37.119758 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.119719 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f" containerName="seaweedfs-tls-custom" Jul 06 15:37:37.119791 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.119768 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f" containerName="seaweedfs-tls-custom" Jul 06 15:37:37.122532 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.122515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.125280 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.125261 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 06 15:37:37.125383 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.125282 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom\"" Jul 06 15:37:37.133203 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.133180 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-kb44q"] Jul 06 15:37:37.177237 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.177204 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed710098-645b-4997-bf11-460e3cd3d114-data\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.177237 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.177246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt2tz\" (UniqueName: \"kubernetes.io/projected/ed710098-645b-4997-bf11-460e3cd3d114-kube-api-access-kt2tz\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.177456 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.177284 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/ed710098-645b-4997-bf11-460e3cd3d114-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.278290 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.278260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/ed710098-645b-4997-bf11-460e3cd3d114-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.278443 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.278302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed710098-645b-4997-bf11-460e3cd3d114-data\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.278443 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.278325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt2tz\" (UniqueName: \"kubernetes.io/projected/ed710098-645b-4997-bf11-460e3cd3d114-kube-api-access-kt2tz\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.278663 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.278645 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed710098-645b-4997-bf11-460e3cd3d114-data\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.280645 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.280629 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-custom\" (UniqueName: \"kubernetes.io/projected/ed710098-645b-4997-bf11-460e3cd3d114-seaweedfs-tls-custom\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.289207 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.289182 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt2tz\" (UniqueName: \"kubernetes.io/projected/ed710098-645b-4997-bf11-460e3cd3d114-kube-api-access-kt2tz\") pod \"seaweedfs-tls-custom-8b44d767d-kb44q\" (UID: \"ed710098-645b-4997-bf11-460e3cd3d114\") " pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.431067 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.431037 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" Jul 06 15:37:37.439919 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.439826 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f" path="/var/lib/kubelet/pods/b77ef3e2-6a38-40c0-80e8-fc51d98e8f3f/volumes" Jul 06 15:37:37.558078 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:37.557943 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-custom-8b44d767d-kb44q"] Jul 06 15:37:37.560692 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:37:37.560662 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded710098_645b_4997_bf11_460e3cd3d114.slice/crio-59efe1fd56649faf30ff506a6125b9635319e60a255babc8d77ab68ec267b414 WatchSource:0}: Error finding container 59efe1fd56649faf30ff506a6125b9635319e60a255babc8d77ab68ec267b414: Status 404 returned error can't find the container with id 59efe1fd56649faf30ff506a6125b9635319e60a255babc8d77ab68ec267b414 Jul 06 15:37:38.059560 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.059522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" event={"ID":"ed710098-645b-4997-bf11-460e3cd3d114","Type":"ContainerStarted","Data":"cf226a818c78cb37320c459e615de9ee9dc6ebb06cb77aceebb928a655da8f52"} Jul 06 15:37:38.060004 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.059574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" event={"ID":"ed710098-645b-4997-bf11-460e3cd3d114","Type":"ContainerStarted","Data":"59efe1fd56649faf30ff506a6125b9635319e60a255babc8d77ab68ec267b414"} Jul 06 15:37:38.079473 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.079428 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-custom-8b44d767d-kb44q" podStartSLOduration=0.806538502 podStartE2EDuration="1.079411392s" totalImagesPullingTime="272.87289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:38.077511072 +0000 UTC m=+737.173342451" watchObservedRunningTime="2026-07-06 15:37:38.079411392 +0000 UTC m=+737.175242770" Jul 06 15:37:38.388182 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.388150 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-bwl86"] Jul 06 15:37:38.390046 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.390030 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:38.399806 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.399780 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-bwl86"] Jul 06 15:37:38.487810 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.487775 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvz9m\" (UniqueName: \"kubernetes.io/projected/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-kube-api-access-qvz9m\") pod \"s3-tls-init-custom-bwl86\" (UID: \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\") " pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:38.488045 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.487833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-model-cache\") pod \"s3-tls-init-custom-bwl86\" (UID: \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\") " pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:38.589155 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.589115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvz9m\" (UniqueName: \"kubernetes.io/projected/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-kube-api-access-qvz9m\") pod \"s3-tls-init-custom-bwl86\" (UID: \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\") " pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:38.589326 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.589181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-model-cache\") pod \"s3-tls-init-custom-bwl86\" (UID: \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\") " pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:38.589578 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.589556 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-model-cache\") pod \"s3-tls-init-custom-bwl86\" (UID: \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\") " pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:38.598584 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.598559 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvz9m\" (UniqueName: \"kubernetes.io/projected/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-kube-api-access-qvz9m\") pod \"s3-tls-init-custom-bwl86\" (UID: \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\") " pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:38.698924 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.698842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:38.826057 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:38.826030 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-bwl86"] Jul 06 15:37:38.828237 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:37:38.828207 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dc7a131_27a8_4534_bd9e_9dd4639d8ddd.slice/crio-865c5cba1b13dc69962341edd8f6a7593dd5d363a751707413bcfaac81e62cf2 WatchSource:0}: Error finding container 865c5cba1b13dc69962341edd8f6a7593dd5d363a751707413bcfaac81e62cf2: Status 404 returned error can't find the container with id 865c5cba1b13dc69962341edd8f6a7593dd5d363a751707413bcfaac81e62cf2 Jul 06 15:37:39.066156 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:39.066057 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bwl86" event={"ID":"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd","Type":"ContainerStarted","Data":"e69c2e9aa865e8d1c323ab6fca31c7477e9de5ee04f4a0918307424932939d0a"} Jul 06 15:37:39.066156 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:39.066105 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bwl86" event={"ID":"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd","Type":"ContainerStarted","Data":"865c5cba1b13dc69962341edd8f6a7593dd5d363a751707413bcfaac81e62cf2"} Jul 06 15:37:41.075656 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:41.075621 2581 generic.go:356] "Generic (PLEG): container finished" podID="2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" containerID="e69c2e9aa865e8d1c323ab6fca31c7477e9de5ee04f4a0918307424932939d0a" exitCode=0 Jul 06 15:37:41.076060 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:41.075696 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bwl86" event={"ID":"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd","Type":"ContainerDied","Data":"e69c2e9aa865e8d1c323ab6fca31c7477e9de5ee04f4a0918307424932939d0a"} Jul 06 15:37:42.080494 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:42.080458 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bwl86" event={"ID":"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd","Type":"ContainerStarted","Data":"b3a4ae16d3525064dc085acc0adad598bfb558ae69a2375f8efc096cacfcf18a"} Jul 06 15:37:42.102237 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:42.102185 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-bwl86" podStartSLOduration=2.671147456 podStartE2EDuration="4.10216679s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.431019334s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:42.101022065 +0000 UTC m=+741.196853451" watchObservedRunningTime="2026-07-06 15:37:42.10216679 +0000 UTC m=+741.197998176" Jul 06 15:37:47.102279 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:47.102242 2581 generic.go:356] "Generic (PLEG): container finished" podID="2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" containerID="b3a4ae16d3525064dc085acc0adad598bfb558ae69a2375f8efc096cacfcf18a" exitCode=0 Jul 06 15:37:47.102664 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:47.102283 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bwl86" event={"ID":"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd","Type":"ContainerDied","Data":"b3a4ae16d3525064dc085acc0adad598bfb558ae69a2375f8efc096cacfcf18a"} Jul 06 15:37:48.252331 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:48.252305 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:48.368008 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:48.367909 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvz9m\" (UniqueName: \"kubernetes.io/projected/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-kube-api-access-qvz9m\") pod \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\" (UID: \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\") " Jul 06 15:37:48.368008 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:48.367952 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-model-cache\") pod \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\" (UID: \"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd\") " Jul 06 15:37:48.369970 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:48.369942 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-kube-api-access-qvz9m" (OuterVolumeSpecName: "kube-api-access-qvz9m") pod "2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" (UID: "2dc7a131-27a8-4534-bd9e-9dd4639d8ddd"). InnerVolumeSpecName "kube-api-access-qvz9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:37:48.390547 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:48.390512 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-model-cache" (OuterVolumeSpecName: "model-cache") pod "2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" (UID: "2dc7a131-27a8-4534-bd9e-9dd4639d8ddd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:37:48.468788 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:48.468747 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvz9m\" (UniqueName: \"kubernetes.io/projected/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-kube-api-access-qvz9m\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:37:48.468788 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:48.468783 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2dc7a131-27a8-4534-bd9e-9dd4639d8ddd-model-cache\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:37:49.112369 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.112333 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-bwl86" event={"ID":"2dc7a131-27a8-4534-bd9e-9dd4639d8ddd","Type":"ContainerDied","Data":"865c5cba1b13dc69962341edd8f6a7593dd5d363a751707413bcfaac81e62cf2"} Jul 06 15:37:49.112369 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.112367 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-bwl86" Jul 06 15:37:49.112567 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.112373 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="865c5cba1b13dc69962341edd8f6a7593dd5d363a751707413bcfaac81e62cf2" Jul 06 15:37:49.727885 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.727856 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-qggwx"] Jul 06 15:37:49.728237 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.728135 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" containerName="download-hf-model" Jul 06 15:37:49.728237 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.728147 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" containerName="download-hf-model" Jul 06 15:37:49.728237 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.728168 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" containerName="s3-tls-init-custom" Jul 06 15:37:49.728237 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.728175 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" containerName="s3-tls-init-custom" Jul 06 15:37:49.728237 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.728230 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dc7a131-27a8-4534-bd9e-9dd4639d8ddd" containerName="s3-tls-init-custom" Jul 06 15:37:49.730155 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.730140 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.732343 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.732325 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 06 15:37:49.732439 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.732377 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving\"" Jul 06 15:37:49.737293 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.737263 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:49.740488 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.740464 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-qggwx"] Jul 06 15:37:49.779260 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.779231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/42422c11-d4e1-46b5-b873-c75729bbe4ac-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.779390 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.779273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g7gp\" (UniqueName: \"kubernetes.io/projected/42422c11-d4e1-46b5-b873-c75729bbe4ac-kube-api-access-5g7gp\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.779390 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.779332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42422c11-d4e1-46b5-b873-c75729bbe4ac-data\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.879717 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.879686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/42422c11-d4e1-46b5-b873-c75729bbe4ac-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.879857 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.879733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g7gp\" (UniqueName: \"kubernetes.io/projected/42422c11-d4e1-46b5-b873-c75729bbe4ac-kube-api-access-5g7gp\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.879857 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.879780 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42422c11-d4e1-46b5-b873-c75729bbe4ac-data\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.880252 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.880228 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42422c11-d4e1-46b5-b873-c75729bbe4ac-data\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.882263 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.882242 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"seaweedfs-tls-serving\" (UniqueName: \"kubernetes.io/projected/42422c11-d4e1-46b5-b873-c75729bbe4ac-seaweedfs-tls-serving\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:49.889565 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:49.889534 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g7gp\" (UniqueName: \"kubernetes.io/projected/42422c11-d4e1-46b5-b873-c75729bbe4ac-kube-api-access-5g7gp\") pod \"seaweedfs-tls-serving-67b7477c6d-qggwx\" (UID: \"42422c11-d4e1-46b5-b873-c75729bbe4ac\") " pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:50.039500 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:50.039423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" Jul 06 15:37:50.164791 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:50.164757 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-tls-serving-67b7477c6d-qggwx"] Jul 06 15:37:50.167415 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:37:50.167381 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42422c11_d4e1_46b5_b873_c75729bbe4ac.slice/crio-05d12d0667bbe631016c5ca8b02b097892dc175de24539cc3a217ce6f595f3e7 WatchSource:0}: Error finding container 05d12d0667bbe631016c5ca8b02b097892dc175de24539cc3a217ce6f595f3e7: Status 404 returned error can't find the container with id 05d12d0667bbe631016c5ca8b02b097892dc175de24539cc3a217ce6f595f3e7 Jul 06 15:37:51.123332 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.123286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" event={"ID":"42422c11-d4e1-46b5-b873-c75729bbe4ac","Type":"ContainerStarted","Data":"fa77f51562e3e9376df0679ccbe89d62fd09498b17c6a2a42426c415bdbef42b"} Jul 06 15:37:51.123698 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.123385 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" event={"ID":"42422c11-d4e1-46b5-b873-c75729bbe4ac","Type":"ContainerStarted","Data":"05d12d0667bbe631016c5ca8b02b097892dc175de24539cc3a217ce6f595f3e7"} Jul 06 15:37:51.142913 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.142863 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-tls-serving-67b7477c6d-qggwx" podStartSLOduration=1.892688212 podStartE2EDuration="2.142848742s" totalImagesPullingTime="250.16053ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:51.142121489 +0000 UTC m=+750.237952870" watchObservedRunningTime="2026-07-06 15:37:51.142848742 +0000 UTC m=+750.238680121" Jul 06 15:37:51.194330 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.194298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:37:51.684234 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.684194 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-qcmwq"] Jul 06 15:37:51.687203 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.687181 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:37:51.696308 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.696282 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-qcmwq"] Jul 06 15:37:51.795649 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.795612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/446b069f-4ca7-4e57-9436-145c0772c31f-model-cache\") pod \"s3-tls-init-serving-qcmwq\" (UID: \"446b069f-4ca7-4e57-9436-145c0772c31f\") " pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:37:51.795826 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.795684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghbrg\" (UniqueName: \"kubernetes.io/projected/446b069f-4ca7-4e57-9436-145c0772c31f-kube-api-access-ghbrg\") pod \"s3-tls-init-serving-qcmwq\" (UID: \"446b069f-4ca7-4e57-9436-145c0772c31f\") " pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:37:51.896228 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.896187 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghbrg\" (UniqueName: \"kubernetes.io/projected/446b069f-4ca7-4e57-9436-145c0772c31f-kube-api-access-ghbrg\") pod \"s3-tls-init-serving-qcmwq\" (UID: \"446b069f-4ca7-4e57-9436-145c0772c31f\") " pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:37:51.896376 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.896246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/446b069f-4ca7-4e57-9436-145c0772c31f-model-cache\") pod \"s3-tls-init-serving-qcmwq\" (UID: \"446b069f-4ca7-4e57-9436-145c0772c31f\") " pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:37:51.896593 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.896578 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/446b069f-4ca7-4e57-9436-145c0772c31f-model-cache\") pod \"s3-tls-init-serving-qcmwq\" (UID: \"446b069f-4ca7-4e57-9436-145c0772c31f\") " pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:37:51.906063 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.906041 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghbrg\" (UniqueName: \"kubernetes.io/projected/446b069f-4ca7-4e57-9436-145c0772c31f-kube-api-access-ghbrg\") pod \"s3-tls-init-serving-qcmwq\" (UID: \"446b069f-4ca7-4e57-9436-145c0772c31f\") " pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:37:51.997123 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:51.997032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:37:52.125635 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:52.125611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-qcmwq"] Jul 06 15:37:52.127911 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:37:52.127887 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod446b069f_4ca7_4e57_9436_145c0772c31f.slice/crio-b89d84b349d159602a4640cf60e411a00c9283c8ccd23af7c9fcb4a04d6a2fca WatchSource:0}: Error finding container b89d84b349d159602a4640cf60e411a00c9283c8ccd23af7c9fcb4a04d6a2fca: Status 404 returned error can't find the container with id b89d84b349d159602a4640cf60e411a00c9283c8ccd23af7c9fcb4a04d6a2fca Jul 06 15:37:53.134325 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:53.134290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcmwq" event={"ID":"446b069f-4ca7-4e57-9436-145c0772c31f","Type":"ContainerStarted","Data":"b1b85cbe22e3366b33f98ce601e7c15fa1341d071b0db5ae9322a5c04057d967"} Jul 06 15:37:53.134767 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:53.134334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcmwq" event={"ID":"446b069f-4ca7-4e57-9436-145c0772c31f","Type":"ContainerStarted","Data":"b89d84b349d159602a4640cf60e411a00c9283c8ccd23af7c9fcb4a04d6a2fca"} Jul 06 15:37:54.139359 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:54.139271 2581 generic.go:356] "Generic (PLEG): container finished" podID="446b069f-4ca7-4e57-9436-145c0772c31f" containerID="b1b85cbe22e3366b33f98ce601e7c15fa1341d071b0db5ae9322a5c04057d967" exitCode=0 Jul 06 15:37:54.139359 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:54.139338 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcmwq" event={"ID":"446b069f-4ca7-4e57-9436-145c0772c31f","Type":"ContainerDied","Data":"b1b85cbe22e3366b33f98ce601e7c15fa1341d071b0db5ae9322a5c04057d967"} Jul 06 15:37:55.145182 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:55.145150 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcmwq" event={"ID":"446b069f-4ca7-4e57-9436-145c0772c31f","Type":"ContainerStarted","Data":"c86632e9f6911ec8632980b1affefc76cf2c67959b45c338be20269be881fe67"} Jul 06 15:37:55.166807 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:37:55.166760 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-qcmwq" podStartSLOduration=2.5059640720000003 podStartE2EDuration="4.166744096s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.660780024s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:55.166391254 +0000 UTC m=+754.262222634" watchObservedRunningTime="2026-07-06 15:37:55.166744096 +0000 UTC m=+754.262575475" Jul 06 15:38:01.172083 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:01.172002 2581 generic.go:356] "Generic (PLEG): container finished" podID="446b069f-4ca7-4e57-9436-145c0772c31f" containerID="c86632e9f6911ec8632980b1affefc76cf2c67959b45c338be20269be881fe67" exitCode=0 Jul 06 15:38:01.172083 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:01.172055 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcmwq" event={"ID":"446b069f-4ca7-4e57-9436-145c0772c31f","Type":"ContainerDied","Data":"c86632e9f6911ec8632980b1affefc76cf2c67959b45c338be20269be881fe67"} Jul 06 15:38:02.318201 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:02.318174 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:38:02.381450 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:02.381413 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/446b069f-4ca7-4e57-9436-145c0772c31f-model-cache\") pod \"446b069f-4ca7-4e57-9436-145c0772c31f\" (UID: \"446b069f-4ca7-4e57-9436-145c0772c31f\") " Jul 06 15:38:02.381617 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:02.381503 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghbrg\" (UniqueName: \"kubernetes.io/projected/446b069f-4ca7-4e57-9436-145c0772c31f-kube-api-access-ghbrg\") pod \"446b069f-4ca7-4e57-9436-145c0772c31f\" (UID: \"446b069f-4ca7-4e57-9436-145c0772c31f\") " Jul 06 15:38:02.383571 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:02.383539 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/446b069f-4ca7-4e57-9436-145c0772c31f-kube-api-access-ghbrg" (OuterVolumeSpecName: "kube-api-access-ghbrg") pod "446b069f-4ca7-4e57-9436-145c0772c31f" (UID: "446b069f-4ca7-4e57-9436-145c0772c31f"). InnerVolumeSpecName "kube-api-access-ghbrg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:38:02.403136 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:02.403096 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/446b069f-4ca7-4e57-9436-145c0772c31f-model-cache" (OuterVolumeSpecName: "model-cache") pod "446b069f-4ca7-4e57-9436-145c0772c31f" (UID: "446b069f-4ca7-4e57-9436-145c0772c31f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:38:02.482855 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:02.482776 2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/446b069f-4ca7-4e57-9436-145c0772c31f-model-cache\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:38:02.482855 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:02.482806 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghbrg\" (UniqueName: \"kubernetes.io/projected/446b069f-4ca7-4e57-9436-145c0772c31f-kube-api-access-ghbrg\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:38:03.182616 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:03.182584 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-qcmwq" event={"ID":"446b069f-4ca7-4e57-9436-145c0772c31f","Type":"ContainerDied","Data":"b89d84b349d159602a4640cf60e411a00c9283c8ccd23af7c9fcb4a04d6a2fca"} Jul 06 15:38:03.182616 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:03.182609 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-qcmwq" Jul 06 15:38:03.182862 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:03.182634 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b89d84b349d159602a4640cf60e411a00c9283c8ccd23af7c9fcb4a04d6a2fca" Jul 06 15:38:03.553704 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:03.553620 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:03.653936 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:03.653881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:09.903842 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.903807 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s25rw/must-gather-98nn6"] Jul 06 15:38:09.904225 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.904074 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446b069f-4ca7-4e57-9436-145c0772c31f" containerName="s3-tls-init-serving" Jul 06 15:38:09.904225 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.904085 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="446b069f-4ca7-4e57-9436-145c0772c31f" containerName="s3-tls-init-serving" Jul 06 15:38:09.904225 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.904097 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446b069f-4ca7-4e57-9436-145c0772c31f" containerName="download-hf-model" Jul 06 15:38:09.904225 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.904102 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="446b069f-4ca7-4e57-9436-145c0772c31f" containerName="download-hf-model" Jul 06 15:38:09.904225 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.904157 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="446b069f-4ca7-4e57-9436-145c0772c31f" containerName="s3-tls-init-serving" Jul 06 15:38:09.908272 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.908256 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:09.912640 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.912618 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s25rw\"/\"kube-root-ca.crt\"" Jul 06 15:38:09.913696 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.913674 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s25rw\"/\"openshift-service-ca.crt\"" Jul 06 15:38:09.913804 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.913681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s25rw\"/\"default-dockercfg-vqbws\"" Jul 06 15:38:09.922871 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.922848 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s25rw/must-gather-98nn6"] Jul 06 15:38:09.923857 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:09.923831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:10.019288 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.019259 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:10.048038 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.047999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-must-gather-output\") pod \"must-gather-98nn6\" (UID: \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\") " pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:10.048199 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.048045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqjr\" (UniqueName: \"kubernetes.io/projected/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-kube-api-access-hgqjr\") pod \"must-gather-98nn6\" (UID: \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\") " pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:10.149204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.149174 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqjr\" (UniqueName: \"kubernetes.io/projected/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-kube-api-access-hgqjr\") pod \"must-gather-98nn6\" (UID: \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\") " pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:10.149323 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.149245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-must-gather-output\") pod \"must-gather-98nn6\" (UID: \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\") " pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:10.149513 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.149499 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-must-gather-output\") pod \"must-gather-98nn6\" (UID: \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\") " pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:10.159080 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.159019 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqjr\" (UniqueName: \"kubernetes.io/projected/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-kube-api-access-hgqjr\") pod \"must-gather-98nn6\" (UID: \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\") " pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:10.216564 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.216542 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:10.364126 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:10.364103 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s25rw/must-gather-98nn6"] Jul 06 15:38:10.366267 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:38:10.366238 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c2c600a_b2ca_427f_a80f_6e2c68ad4526.slice/crio-e6e21376dbc7c34a41f8ad59e41847b72062ea5a0d00cba4992f2c41db02df81 WatchSource:0}: Error finding container e6e21376dbc7c34a41f8ad59e41847b72062ea5a0d00cba4992f2c41db02df81: Status 404 returned error can't find the container with id e6e21376dbc7c34a41f8ad59e41847b72062ea5a0d00cba4992f2c41db02df81 Jul 06 15:38:11.216644 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:11.216602 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s25rw/must-gather-98nn6" event={"ID":"2c2c600a-b2ca-427f-a80f-6e2c68ad4526","Type":"ContainerStarted","Data":"e6e21376dbc7c34a41f8ad59e41847b72062ea5a0d00cba4992f2c41db02df81"} Jul 06 15:38:17.243187 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:17.243143 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s25rw/must-gather-98nn6" event={"ID":"2c2c600a-b2ca-427f-a80f-6e2c68ad4526","Type":"ContainerStarted","Data":"87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61"} Jul 06 15:38:17.243610 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:17.243200 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s25rw/must-gather-98nn6" event={"ID":"2c2c600a-b2ca-427f-a80f-6e2c68ad4526","Type":"ContainerStarted","Data":"ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5"} Jul 06 15:38:17.263443 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:17.263388 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s25rw/must-gather-98nn6" podStartSLOduration=2.019788106 podStartE2EDuration="8.263372559s" totalImagesPullingTime="6.243584453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:38:17.262917172 +0000 UTC m=+776.358748781" watchObservedRunningTime="2026-07-06 15:38:17.263372559 +0000 UTC m=+776.359203938" Jul 06 15:38:21.917305 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:21.917263 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:35.325390 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:35.325355 2581 generic.go:356] "Generic (PLEG): container finished" podID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerID="ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5" exitCode=0 Jul 06 15:38:35.325859 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:35.325399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s25rw/must-gather-98nn6" event={"ID":"2c2c600a-b2ca-427f-a80f-6e2c68ad4526","Type":"ContainerDied","Data":"ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5"} Jul 06 15:38:35.325859 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:35.325700 2581 scope.go:117] "RemoveContainer" containerID="ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5" Jul 06 15:38:35.501860 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:35.501820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-s25rw_must-gather-98nn6_2c2c600a-b2ca-427f-a80f-6e2c68ad4526/gather/0.log" Jul 06 15:38:35.872839 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:35.872810 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:36.031328 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:36.031240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:36.128611 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:36.128572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:38.975989 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:38.975959 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-stmpf_00deaac9-c8d8-42b6-a361-9e05e1d548e3/global-pull-secret-syncer/0.log" Jul 06 15:38:39.040212 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:39.040185 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" Jul 06 15:38:39.136715 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:39.136681 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-165.ec2.internal_283731ddec37e713b989291a87b04d51/haproxy/0.log" Jul 06 15:38:40.843325 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:40.843292 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-s25rw/must-gather-98nn6"] Jul 06 15:38:40.843762 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:40.843488 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-s25rw/must-gather-98nn6" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerName="copy" containerID="cri-o://87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61" gracePeriod=2 Jul 06 15:38:40.848356 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:40.848335 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-s25rw/must-gather-98nn6"] Jul 06 15:38:41.080748 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.080717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-s25rw_must-gather-98nn6_2c2c600a-b2ca-427f-a80f-6e2c68ad4526/copy/0.log" Jul 06 15:38:41.082281 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.082265 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:41.084976 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:38:41.084953 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-98nn6\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-s25rw\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:41.108373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.108319 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgqjr\" (UniqueName: \"kubernetes.io/projected/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-kube-api-access-hgqjr\") pod \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\" (UID: \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\") " Jul 06 15:38:41.108508 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.108494 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-must-gather-output\") pod \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\" (UID: \"2c2c600a-b2ca-427f-a80f-6e2c68ad4526\") " Jul 06 15:38:41.109770 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.109747 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "2c2c600a-b2ca-427f-a80f-6e2c68ad4526" (UID: "2c2c600a-b2ca-427f-a80f-6e2c68ad4526"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:38:41.110373 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.110345 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-kube-api-access-hgqjr" (OuterVolumeSpecName: "kube-api-access-hgqjr") pod "2c2c600a-b2ca-427f-a80f-6e2c68ad4526" (UID: "2c2c600a-b2ca-427f-a80f-6e2c68ad4526"). InnerVolumeSpecName "kube-api-access-hgqjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:38:41.209204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.209172 2581 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-must-gather-output\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:38:41.209204 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.209197 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgqjr\" (UniqueName: \"kubernetes.io/projected/2c2c600a-b2ca-427f-a80f-6e2c68ad4526-kube-api-access-hgqjr\") on node \"ip-10-0-134-165.ec2.internal\" DevicePath \"\"" Jul 06 15:38:41.348399 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.348372 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-s25rw_must-gather-98nn6_2c2c600a-b2ca-427f-a80f-6e2c68ad4526/copy/0.log" Jul 06 15:38:41.348714 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.348693 2581 generic.go:356] "Generic (PLEG): container finished" podID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerID="87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61" exitCode=143 Jul 06 15:38:41.348811 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.348749 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:41.348867 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.348810 2581 scope.go:117] "RemoveContainer" containerID="87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61" Jul 06 15:38:41.351358 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:38:41.351327 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-98nn6\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-s25rw\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:41.357815 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.357733 2581 scope.go:117] "RemoveContainer" containerID="ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5" Jul 06 15:38:41.359881 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:38:41.359858 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-98nn6\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-s25rw\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:41.369904 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.369888 2581 scope.go:117] "RemoveContainer" containerID="87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61" Jul 06 15:38:41.370174 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:38:41.370156 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61\": container with ID starting with 87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61 not found: ID does not exist" containerID="87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61" Jul 06 15:38:41.370223 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.370184 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61"} err="failed to get container status \"87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61\": rpc error: code = NotFound desc = could not find container \"87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61\": container with ID starting with 87d685854ad7c4f4ffb3e09b8ea22752de51a20a8b174e03fc3ec0481bacff61 not found: ID does not exist" Jul 06 15:38:41.370223 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.370201 2581 scope.go:117] "RemoveContainer" containerID="ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5" Jul 06 15:38:41.370421 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:38:41.370404 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5\": container with ID starting with ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5 not found: ID does not exist" containerID="ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5" Jul 06 15:38:41.370459 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.370426 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5"} err="failed to get container status \"ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5\": rpc error: code = NotFound desc = could not find container \"ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5\": container with ID starting with ebb9a253d8281c93b9e13f0b88b7c08c95d888a7ac34be5e908f53068b3b24a5 not found: ID does not exist" Jul 06 15:38:41.438995 ip-10-0-134-165 kubenswrapper[2581]: E0706 15:38:41.438947 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-98nn6\" is forbidden: User \"system:node:ip-10-0-134-165.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-s25rw\": no relationship found between node 'ip-10-0-134-165.ec2.internal' and this object" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" pod="openshift-must-gather-s25rw/must-gather-98nn6" Jul 06 15:38:41.439716 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.439697 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" path="/var/lib/kubelet/pods/2c2c600a-b2ca-427f-a80f-6e2c68ad4526/volumes" Jul 06 15:38:41.739558 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.739465 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:41.834882 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:41.834834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2wz9q_d957d89f-d702-435d-87d4-a1263ead17ee/konnectivity-agent/0.log" limit=1024 Jul 06 15:38:43.637897 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:43.637795 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c67b8c5bc-229hz_f85732b4-8569-444c-bc58-3b63566a2b5d/metrics-server/0.log" Jul 06 15:38:43.939519 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:43.939426 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qj5hf_9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9/node-exporter/0.log" Jul 06 15:38:43.960599 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:43.960569 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qj5hf_9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9/kube-rbac-proxy/0.log" Jul 06 15:38:43.987353 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:43.987327 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qj5hf_9bfe1ea6-e7d4-4815-af17-b8e7a1a7a3c9/init-textfile/0.log" Jul 06 15:38:44.373446 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:44.373419 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-6n7c7_b3cdbef7-63ad-43b8-b956-af047c752f10/prometheus-operator/0.log" Jul 06 15:38:44.411513 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:44.411483 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-6n7c7_b3cdbef7-63ad-43b8-b956-af047c752f10/kube-rbac-proxy/0.log" Jul 06 15:38:44.449663 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:44.449639 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-47d9v_09b50154-a32e-4928-9341-b330703607d8/prometheus-operator-admission-webhook/0.log" Jul 06 15:38:45.953142 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:45.953109 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-vs9qx_453912a4-c635-4bc7-935e-c2b4135f6611/networking-console-plugin/0.log" Jul 06 15:38:46.955297 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.955264 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw"] Jul 06 15:38:46.955665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.955527 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerName="copy" Jul 06 15:38:46.955665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.955538 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerName="copy" Jul 06 15:38:46.955665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.955547 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerName="gather" Jul 06 15:38:46.955665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.955553 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerName="gather" Jul 06 15:38:46.955665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.955602 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerName="copy" Jul 06 15:38:46.955665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.955610 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c2c600a-b2ca-427f-a80f-6e2c68ad4526" containerName="gather" Jul 06 15:38:46.957370 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.957351 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:46.959941 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.959913 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4g7kz\"/\"kube-root-ca.crt\"" Jul 06 15:38:46.960072 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.960060 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4g7kz\"/\"openshift-service-ca.crt\"" Jul 06 15:38:46.961178 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.961159 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4g7kz\"/\"default-dockercfg-pntzw\"" Jul 06 15:38:46.968665 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:46.968645 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw"] Jul 06 15:38:47.051269 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.051230 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-sys\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.051269 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.051275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-proc\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.051472 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.051313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-podres\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.051472 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.051342 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tct2\" (UniqueName: \"kubernetes.io/projected/239cabd8-25f0-4024-b1e0-e94d8a013c66-kube-api-access-8tct2\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.051472 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.051365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-lib-modules\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.152610 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tct2\" (UniqueName: \"kubernetes.io/projected/239cabd8-25f0-4024-b1e0-e94d8a013c66-kube-api-access-8tct2\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.152610 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152621 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-lib-modules\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.152848 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-sys\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.152848 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152689 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-proc\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.152848 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-podres\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.152848 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152795 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-proc\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.152848 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152830 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-lib-modules\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.152848 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152846 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-sys\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.153071 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.152882 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/239cabd8-25f0-4024-b1e0-e94d8a013c66-podres\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.166701 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.166681 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tct2\" (UniqueName: \"kubernetes.io/projected/239cabd8-25f0-4024-b1e0-e94d8a013c66-kube-api-access-8tct2\") pod \"perf-node-gather-daemonset-68thw\" (UID: \"239cabd8-25f0-4024-b1e0-e94d8a013c66\") " pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.268074 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.267973 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:47.395076 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:47.395052 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw"] Jul 06 15:38:47.397255 ip-10-0-134-165 kubenswrapper[2581]: W0706 15:38:47.397223 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod239cabd8_25f0_4024_b1e0_e94d8a013c66.slice/crio-e953b90807ffe995df59add9d8a6db35e18bbe3818f0ebfea2bc6a96e7435e98 WatchSource:0}: Error finding container e953b90807ffe995df59add9d8a6db35e18bbe3818f0ebfea2bc6a96e7435e98: Status 404 returned error can't find the container with id e953b90807ffe995df59add9d8a6db35e18bbe3818f0ebfea2bc6a96e7435e98 Jul 06 15:38:48.378669 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:48.378628 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" event={"ID":"239cabd8-25f0-4024-b1e0-e94d8a013c66","Type":"ContainerStarted","Data":"98b02d9ef4b6ce9239a317fee769cf01d7bfd05e7bbdd6e4a2da709c0b03ffae"} Jul 06 15:38:48.379125 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:48.378725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" event={"ID":"239cabd8-25f0-4024-b1e0-e94d8a013c66","Type":"ContainerStarted","Data":"e953b90807ffe995df59add9d8a6db35e18bbe3818f0ebfea2bc6a96e7435e98"} Jul 06 15:38:48.379125 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:48.378875 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:48.398089 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:48.398044 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" podStartSLOduration=2.398031701 podStartE2EDuration="2.398031701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:38:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:38:48.396454073 +0000 UTC m=+807.492285452" watchObservedRunningTime="2026-07-06 15:38:48.398031701 +0000 UTC m=+807.493863108" Jul 06 15:38:48.696033 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:48.695929 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kvqkg_460cdb11-647b-45d1-b721-a041f17ec6e7/dns/0.log" Jul 06 15:38:48.740753 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:48.740716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kvqkg_460cdb11-647b-45d1-b721-a041f17ec6e7/kube-rbac-proxy/0.log" Jul 06 15:38:48.794506 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:48.794474 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-646k2_4dc38ba1-8cc5-4083-a2e5-a7ff17a6bd88/dns-node-resolver/0.log" Jul 06 15:38:49.454490 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:49.454461 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vww7h_b6cb8bcd-4900-4c49-b1d5-f2e1269b0e25/node-ca/0.log" Jul 06 15:38:50.251618 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:50.251590 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-84f8895bbf-wbkcb_7dac0aaf-891f-4f62-97bc-02614614ff82/router/0.log" Jul 06 15:38:50.708804 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:50.708771 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xbqcf_89a714bd-78be-4e15-b041-4898e9b8ae5c/serve-healthcheck-canary/0.log" Jul 06 15:38:51.324125 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:51.324096 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4fdk_54792a15-1fa0-4425-b3a9-0cda693505c4/kube-rbac-proxy/0.log" Jul 06 15:38:51.346567 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:51.346543 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4fdk_54792a15-1fa0-4425-b3a9-0cda693505c4/exporter/0.log" Jul 06 15:38:51.369616 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:51.369589 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s4fdk_54792a15-1fa0-4425-b3a9-0cda693505c4/extractor/0.log" Jul 06 15:38:53.507851 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.507817 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-kxjv6_9ca2d024-b430-49cb-aa5a-c9aff8a74ad8/manager/0.log" Jul 06 15:38:53.549534 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.549503 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-sgsmx_9df00f7f-3e59-4e6c-ac87-d1977653d41a/s3-init/0.log" Jul 06 15:38:53.567370 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.567345 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-sgsmx_9df00f7f-3e59-4e6c-ac87-d1977653d41a/download-hf-model/0.log" Jul 06 15:38:53.601869 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.601842 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-bwl86_2dc7a131-27a8-4534-bd9e-9dd4639d8ddd/s3-tls-init-custom/0.log" Jul 06 15:38:53.624383 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.624361 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-bwl86_2dc7a131-27a8-4534-bd9e-9dd4639d8ddd/download-hf-model/0.log" Jul 06 15:38:53.658265 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.658243 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-qcmwq_446b069f-4ca7-4e57-9436-145c0772c31f/s3-tls-init-serving/0.log" Jul 06 15:38:53.696057 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.696033 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-qcmwq_446b069f-4ca7-4e57-9436-145c0772c31f/download-hf-model/0.log" Jul 06 15:38:53.746517 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.746486 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-fthr7_d60abe1e-8e3d-47f7-a1b1-637dbcd64aac/seaweedfs/0.log" Jul 06 15:38:53.774199 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.774121 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-custom-8b44d767d-kb44q_ed710098-645b-4997-bf11-460e3cd3d114/seaweedfs-tls-custom/0.log" Jul 06 15:38:53.800647 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:53.800620 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-tls-serving-67b7477c6d-qggwx_42422c11-d4e1-46b5-b873-c75729bbe4ac/seaweedfs-tls-serving/0.log" Jul 06 15:38:54.392487 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:54.392463 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4g7kz/perf-node-gather-daemonset-68thw" Jul 06 15:38:59.968604 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:59.968576 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzdpx_dfe512d8-f2f2-4fff-b166-5aa362a458ee/kube-multus-additional-cni-plugins/0.log" Jul 06 15:38:59.995599 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:38:59.995571 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzdpx_dfe512d8-f2f2-4fff-b166-5aa362a458ee/egress-router-binary-copy/0.log" Jul 06 15:39:00.019102 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:00.019078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzdpx_dfe512d8-f2f2-4fff-b166-5aa362a458ee/cni-plugins/0.log" Jul 06 15:39:00.073573 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:00.073543 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzdpx_dfe512d8-f2f2-4fff-b166-5aa362a458ee/bond-cni-plugin/0.log" Jul 06 15:39:00.124657 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:00.124628 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzdpx_dfe512d8-f2f2-4fff-b166-5aa362a458ee/routeoverride-cni/0.log" Jul 06 15:39:00.163585 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:00.163561 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzdpx_dfe512d8-f2f2-4fff-b166-5aa362a458ee/whereabouts-cni-bincopy/0.log" Jul 06 15:39:00.194274 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:00.194253 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzdpx_dfe512d8-f2f2-4fff-b166-5aa362a458ee/whereabouts-cni/0.log" Jul 06 15:39:00.257897 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:00.257821 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qrgcs_ab00f649-48ff-4f23-8d9f-8571b60f6362/kube-multus/0.log" Jul 06 15:39:00.286856 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:00.286820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9vcwr_b60b2614-7799-4979-b5bc-8a7ba4b49339/network-metrics-daemon/0.log" Jul 06 15:39:00.308451 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:00.308423 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9vcwr_b60b2614-7799-4979-b5bc-8a7ba4b49339/kube-rbac-proxy/0.log" Jul 06 15:39:01.665343 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:01.665308 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whv5v_003a1667-1793-4f5f-839d-74360856bff9/ovn-controller/0.log" Jul 06 15:39:01.685649 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:01.685611 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whv5v_003a1667-1793-4f5f-839d-74360856bff9/ovn-acl-logging/0.log" Jul 06 15:39:01.717792 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:01.717758 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whv5v_003a1667-1793-4f5f-839d-74360856bff9/kube-rbac-proxy-node/0.log" Jul 06 15:39:01.748228 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:01.748202 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whv5v_003a1667-1793-4f5f-839d-74360856bff9/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 15:39:01.768322 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:01.768294 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whv5v_003a1667-1793-4f5f-839d-74360856bff9/northd/0.log" Jul 06 15:39:01.797830 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:01.797794 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whv5v_003a1667-1793-4f5f-839d-74360856bff9/nbdb/0.log" Jul 06 15:39:01.823491 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:01.823463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whv5v_003a1667-1793-4f5f-839d-74360856bff9/sbdb/0.log" Jul 06 15:39:01.879924 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:01.879878 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-whv5v_003a1667-1793-4f5f-839d-74360856bff9/ovnkube-controller/0.log" Jul 06 15:39:03.002426 ip-10-0-134-165 kubenswrapper[2581]: I0706 15:39:03.002332 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8vxl9_78177b4f-8184-422a-a971-a57e582e97fe/network-check-target-container/0.log"