Sep 08 06:34:51.672224 ip-10-0-135-120 systemd[1]: Starting Kubernetes Kubelet... Sep 08 06:34:52.113444 ip-10-0-135-120 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 06:34:52.113444 ip-10-0-135-120 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 06:34:52.113444 ip-10-0-135-120 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 06:34:52.113444 ip-10-0-135-120 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 06:34:52.113444 ip-10-0-135-120 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 06:34:52.115000 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.114913 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 06:34:52.119735 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119711 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:52.119735 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119731 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:52.119735 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119735 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:52.119735 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119739 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:52.119735 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119742 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119745 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119749 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119751 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119754 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119757 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119759 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119762 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119765 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119767 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119770 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119772 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119805 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119809 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119813 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119816 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119819 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119822 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119825 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119827 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:52.119952 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119830 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119833 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119836 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119838 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119841 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119844 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119847 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119853 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119856 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119858 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119860 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119863 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119866 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119869 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119872 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119874 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119877 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119880 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119882 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119884 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:52.120429 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119887 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119889 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119908 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119910 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119913 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119915 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119918 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119920 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119923 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119926 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119928 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119931 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119933 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119936 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119938 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119940 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119943 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119945 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119947 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:52.120938 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119952 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119956 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119959 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119962 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119965 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119968 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119971 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119974 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119976 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119979 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119982 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119984 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119987 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119989 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119991 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119994 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119996 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.119999 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120002 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120004 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:52.121402 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120007 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120010 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120013 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120015 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120017 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120020 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120022 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120025 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120027 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120030 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120033 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120035 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120039 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120042 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120045 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120048 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120748 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120756 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120759 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:52.121975 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120763 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120766 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120769 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120771 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120774 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120776 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120779 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120781 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120784 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120787 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120789 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120792 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120794 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120796 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120799 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120802 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120804 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120807 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120809 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120812 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:52.122444 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120814 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120817 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120819 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120822 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120824 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120827 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120829 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120832 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120834 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120837 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120839 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120842 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120845 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120848 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120850 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120853 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120855 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120859 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120861 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120863 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:52.122971 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120866 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120868 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120871 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120873 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120875 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120878 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120880 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120883 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120885 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120888 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120906 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120909 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120911 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120914 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120916 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120919 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120921 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120924 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120927 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120929 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:52.123459 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120932 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120934 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120938 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120941 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120945 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120948 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120951 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120954 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120956 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120959 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120961 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120964 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120966 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120969 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120971 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120973 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120976 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120978 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120981 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120984 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:52.123959 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120986 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120989 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120991 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120994 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.120996 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121001 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121004 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121007 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121012 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121015 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121017 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121020 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121023 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121025 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121029 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121033 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121442 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121447 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121451 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:52.124483 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121454 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121457 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121459 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121462 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121464 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121467 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121469 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121472 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121474 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121476 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121479 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121482 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121484 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121487 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121490 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121492 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121495 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121497 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121500 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121502 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:52.124980 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121505 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121508 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121510 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121512 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121515 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121517 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121520 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121522 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121525 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121528 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121531 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121533 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121536 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121538 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121541 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121543 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121546 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121548 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121553 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:52.125500 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121556 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121559 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121562 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121565 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121567 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121569 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121572 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121575 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121577 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121580 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121582 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121584 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121587 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121589 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121591 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121594 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121596 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121599 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121601 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121604 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:52.125985 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121606 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121609 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121612 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121614 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121617 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121619 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121621 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121624 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121626 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121629 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121631 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121633 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121636 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121638 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121640 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121643 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121645 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121647 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121650 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121652 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:52.126485 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121655 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121658 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121662 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121666 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121669 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121671 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121674 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121676 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121678 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121681 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121683 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121686 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121690 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121693 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121696 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121699 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.121703 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121767 2581 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121799 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121805 2581 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 06:34:52.127029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121810 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121814 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121817 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121821 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121829 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121832 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121835 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121839 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121841 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121844 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121847 2581 flags.go:64] FLAG: --cgroup-root="" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121850 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121853 2581 flags.go:64] FLAG: --client-ca-file="" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121857 2581 flags.go:64] FLAG: --cloud-provider="external" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121860 2581 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121864 2581 flags.go:64] FLAG: --cluster-domain="" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121866 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121871 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121874 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121877 2581 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121880 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121883 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121886 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 06:34:52.127594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121906 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121915 2581 flags.go:64] FLAG: --contention-profiling="false" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121919 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121924 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121928 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121931 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121935 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121938 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121940 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121943 2581 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121946 2581 flags.go:64] FLAG: --enable-server="true" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121949 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121954 2581 flags.go:64] FLAG: --event-burst="100" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121957 2581 flags.go:64] FLAG: --event-qps="50" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121959 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121962 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121965 2581 flags.go:64] FLAG: --eviction-hard="" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121969 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121972 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121975 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121978 2581 flags.go:64] FLAG: --eviction-soft="" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121981 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121984 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121991 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121994 2581 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 06:34:52.128172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.121997 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122000 2581 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122003 2581 flags.go:64] FLAG: --feature-gates="" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122006 2581 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122009 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122013 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122016 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122018 2581 flags.go:64] FLAG: --healthz-port="10248" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122022 2581 flags.go:64] FLAG: --help="false" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122025 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122028 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122031 2581 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122034 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122037 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122040 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122043 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122045 2581 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122048 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122051 2581 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122053 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122056 2581 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122059 2581 flags.go:64] FLAG: --kube-reserved="" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122062 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122064 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 06:34:52.128819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122067 2581 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122070 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122072 2581 flags.go:64] FLAG: --lock-file="" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122075 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122078 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122080 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122085 2581 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122089 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122091 2581 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122094 2581 flags.go:64] FLAG: --logging-format="text" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122097 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122100 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122103 2581 flags.go:64] FLAG: --manifest-url="" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122105 2581 flags.go:64] FLAG: --manifest-url-header="" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122109 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122112 2581 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122118 2581 flags.go:64] FLAG: --max-pods="110" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122120 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122123 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122126 2581 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122129 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122131 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122135 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122138 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122144 2581 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 06:34:52.129440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122147 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122150 2581 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122153 2581 flags.go:64] FLAG: --pod-cidr="" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122156 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122161 2581 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122163 2581 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122166 2581 flags.go:64] FLAG: --pods-per-core="0" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122169 2581 flags.go:64] FLAG: --port="10250" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122172 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122175 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e20bcef3074935d9" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122177 2581 flags.go:64] FLAG: --qos-reserved="" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122180 2581 flags.go:64] FLAG: --read-only-port="10255" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122183 2581 flags.go:64] FLAG: --register-node="true" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122186 2581 flags.go:64] FLAG: --register-with-taints="" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122189 2581 flags.go:64] FLAG: --registry-burst="10" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122193 2581 flags.go:64] FLAG: --registry-qps="5" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122196 2581 flags.go:64] FLAG: --reserved-cpus="" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122199 2581 flags.go:64] FLAG: --reserved-memory="" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122202 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122205 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122208 2581 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122211 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122213 2581 flags.go:64] FLAG: --runonce="false" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122216 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122221 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 06:34:52.130072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122224 2581 flags.go:64] FLAG: --seccomp-default="false" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122227 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122230 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122233 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122236 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122239 2581 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122241 2581 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122244 2581 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122247 2581 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122250 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122252 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122255 2581 flags.go:64] FLAG: --system-cgroups="" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122258 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122263 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122266 2581 flags.go:64] FLAG: --tls-cert-file="" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122269 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122272 2581 flags.go:64] FLAG: --tls-min-version="" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122275 2581 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122277 2581 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122280 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122283 2581 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122286 2581 flags.go:64] FLAG: --v="2" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122289 2581 flags.go:64] FLAG: --version="false" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122294 2581 flags.go:64] FLAG: --vmodule="" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122297 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 06:34:52.130725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122301 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122415 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122419 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122423 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122427 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122431 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122443 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122447 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122450 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122453 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122456 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122459 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122461 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122464 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122467 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122469 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122472 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122474 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122477 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122479 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:52.131450 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122482 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122484 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122487 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122490 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122492 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122495 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122497 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122500 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122502 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122505 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122509 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122512 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122514 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122517 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122519 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122522 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122525 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122527 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122530 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122533 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:52.131956 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122535 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122538 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122541 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122543 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122546 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122550 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122553 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122555 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122558 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122560 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122563 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122565 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122568 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122570 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122572 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122575 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122577 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122579 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122582 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:52.132446 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122584 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122587 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122589 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122593 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122595 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122598 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122600 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122603 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122605 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122608 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122610 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122614 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122616 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122619 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122621 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122624 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122626 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122629 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122631 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122634 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:52.132931 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122636 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122647 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122649 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122652 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122654 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122657 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122659 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122662 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122664 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122667 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122671 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122674 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122677 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122680 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122683 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122687 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122690 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122693 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122696 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:52.133432 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122699 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.122702 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.122710 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.129682 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.129698 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.130634 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.130641 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130701 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130707 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130711 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130715 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130718 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130721 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130724 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:52.133911 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130727 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130730 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130733 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130736 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130738 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130741 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130743 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130746 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130748 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130751 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130753 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130756 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130758 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130760 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130763 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130765 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130768 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130771 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130774 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130777 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:52.134295 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130780 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130782 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130785 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130788 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130790 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130793 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130795 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130798 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130800 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130803 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130806 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130808 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130810 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130813 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130815 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130818 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130820 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130822 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130825 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130827 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:52.134795 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130830 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130832 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130835 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130837 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130839 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130841 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130844 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130846 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130849 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130851 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130855 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130857 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130860 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130863 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130865 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130868 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130871 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130873 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130875 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130878 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:52.135352 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130881 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130884 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130886 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130889 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130909 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130913 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130929 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130931 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130934 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130936 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130939 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130941 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130944 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130948 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130952 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130955 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130958 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130961 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130963 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:52.135838 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130967 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130970 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130973 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130976 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130980 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130983 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130986 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130989 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130991 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130994 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130996 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.130998 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131001 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.131005 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131109 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 06:34:52.136333 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131113 2581 feature_gate.go:328] unrecognized feature gate: Example Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131116 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131118 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131121 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131124 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131127 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131130 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131132 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131135 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131137 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131140 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131143 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131145 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131148 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131150 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131153 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131155 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131158 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131160 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131162 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 06:34:52.136709 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131165 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131167 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131173 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131176 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131179 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131182 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131184 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131187 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131189 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131192 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131194 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131197 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131199 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131202 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131204 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131206 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131209 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131213 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131216 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 06:34:52.137221 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131218 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131221 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131223 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131225 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131228 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131230 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131232 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131235 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131237 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131240 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131242 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131244 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131247 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131249 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131251 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131254 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131258 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131260 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131263 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 06:34:52.137686 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131265 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131267 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131270 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131272 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131276 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131279 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131282 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131285 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131287 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131290 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131293 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131295 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131297 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131300 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131302 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131304 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131307 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131310 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131314 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 06:34:52.138156 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131316 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131319 2581 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131322 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131324 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131327 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131330 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131332 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131334 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131337 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131339 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131342 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131346 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131348 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131351 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131353 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131355 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131358 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131360 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131363 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131365 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 06:34:52.138626 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:52.131368 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 06:34:52.139189 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.131373 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 06:34:52.139189 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.131469 2581 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 06:34:52.139189 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.134363 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 06:34:52.139189 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.135324 2581 server.go:1019] "Starting client certificate rotation" Sep 08 06:34:52.139189 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.135423 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 06:34:52.139189 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.135466 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 06:34:52.139189 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.138342 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 06:34:52.143975 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.143865 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 06:34:52.162697 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.162676 2581 log.go:25] "Validated CRI v1 runtime API" Sep 08 06:34:52.165575 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.165558 2581 log.go:25] "Validated CRI v1 image API" Sep 08 06:34:52.167216 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.167199 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 06:34:52.172376 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.172357 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9d236b28-00ee-430b-baae-b258aa317532:/dev/nvme0n1p4 f0f27b6b-ad7a-4375-b44a-6e6af808be11:/dev/nvme0n1p3] Sep 08 06:34:52.172431 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.172377 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 06:34:52.174830 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.174814 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 06:34:52.177555 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.177438 2581 manager.go:216] Machine: {Timestamp:2026-09-08 06:34:52.176023598 +0000 UTC m=+0.368157589 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3131408 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec227e10c852c99cafe76fa1b50dc7a8 SystemUUID:ec227e10-c852-c99c-afe7-6fa1b50dc7a8 BootID:db1d197b-d06d-43a4-8831-e75826becf47 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:eb:b0:df:59 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:eb:b0:df:59 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:f3:12:bb:7e:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 06:34:52.177555 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.177550 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 06:34:52.177645 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.177634 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 06:34:52.181005 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.180699 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 06:34:52.181005 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.180721 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 06:34:52.181552 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.181540 2581 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 06:34:52.181552 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.181552 2581 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 06:34:52.181623 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.181559 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 06:34:52.182298 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.182288 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 06:34:52.183630 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.183620 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 06:34:52.186768 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.186756 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 08 06:34:52.186880 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.186871 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 06:34:52.186943 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.186916 2581 kubelet.go:486] "Attempting to sync node with API server" Sep 08 06:34:52.186943 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.186934 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 06:34:52.187031 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.186951 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 06:34:52.187031 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.186963 2581 kubelet.go:398] "Adding apiserver pod source" Sep 08 06:34:52.187031 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.186971 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 06:34:52.187340 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.187326 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 06:34:52.187390 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.187344 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 06:34:52.189621 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.189603 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 06:34:52.192143 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192126 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 06:34:52.192222 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192166 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 06:34:52.192369 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192356 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 06:34:52.192432 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192375 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 06:34:52.192432 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192384 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 06:34:52.192432 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192393 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 06:34:52.192432 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192404 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 06:34:52.192432 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192414 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 06:34:52.192938 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192928 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 06:34:52.192986 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192940 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 06:34:52.192986 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192953 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 06:34:52.192986 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192962 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 06:34:52.192986 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192975 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 06:34:52.193116 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.192987 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 06:34:52.193793 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.193783 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 06:34:52.193843 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.193796 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 06:34:52.196533 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.196345 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 06:34:52.196533 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.196445 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 06:34:52.196685 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.196659 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 06:34:52.198855 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.198839 2581 server.go:1268] "Started kubelet" Sep 08 06:34:52.199009 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.198980 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 06:34:52.199009 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.198963 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 06:34:52.199098 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.199042 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 06:34:52.199647 ip-10-0-135-120 systemd[1]: Started Kubernetes Kubelet. Sep 08 06:34:52.200463 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.200297 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 06:34:52.201349 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.201332 2581 server.go:310] "Adding debug handlers to kubelet server" Sep 08 06:34:52.203773 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.203746 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 06:34:52.205812 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.204524 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-120.ec2.internal.18d344f41a37e0ab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-120.ec2.internal,UID:ip-10-0-135-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-120.ec2.internal,},FirstTimestamp:2026-09-08 06:34:52.198797483 +0000 UTC m=+0.390931474,LastTimestamp:2026-09-08 06:34:52.198797483 +0000 UTC m=+0.390931474,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-120.ec2.internal,}" Sep 08 06:34:52.206615 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.206600 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 06:34:52.207605 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.207591 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 06:34:52.207713 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.207694 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:52.208245 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.208227 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 06:34:52.208329 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.208230 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 06:34:52.208329 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.208259 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 06:34:52.208488 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.208333 2581 reconstruct.go:97] "Volume reconstruction finished" Sep 08 06:34:52.208488 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.208343 2581 reconciler.go:29] "Reconciler: start to sync state" Sep 08 06:34:52.208814 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.208794 2581 factory.go:55] Registering systemd factory Sep 08 06:34:52.208814 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.208816 2581 factory.go:223] Registration of the systemd container factory successfully Sep 08 06:34:52.209103 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.209086 2581 factory.go:153] Registering CRI-O factory Sep 08 06:34:52.209103 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.209105 2581 factory.go:223] Registration of the crio container factory successfully Sep 08 06:34:52.209230 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.209158 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 06:34:52.209230 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.209176 2581 factory.go:103] Registering Raw factory Sep 08 06:34:52.209230 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.209191 2581 manager.go:1196] Started watching for new ooms in manager Sep 08 06:34:52.209522 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.209507 2581 manager.go:349] Starting recovery of all containers Sep 08 06:34:52.217218 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.217191 2581 manager.go:354] Recovery completed Sep 08 06:34:52.219541 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.219372 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 06:34:52.220282 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.220253 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 06:34:52.223132 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.223119 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:52.225086 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.225052 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:52.225143 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.225091 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:52.225143 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.225106 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:52.225754 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.225737 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 06:34:52.225821 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.225755 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 06:34:52.225821 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.225774 2581 state_mem.go:36] "Initialized new in-memory state store" Sep 08 06:34:52.225821 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.225742 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:52.226586 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.226564 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:52.226651 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.226596 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:52.226651 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.226607 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:52.227285 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.227272 2581 policy_none.go:49] "None policy: Start" Sep 08 06:34:52.227324 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.227293 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 06:34:52.227324 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.227308 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 06:34:52.227420 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.227350 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-120.ec2.internal.18d344f41bc8c977 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-120.ec2.internal,UID:ip-10-0-135-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-120.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-120.ec2.internal,},FirstTimestamp:2026-09-08 06:34:52.225071479 +0000 UTC m=+0.417205476,LastTimestamp:2026-09-08 06:34:52.225071479 +0000 UTC m=+0.417205476,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-120.ec2.internal,}" Sep 08 06:34:52.228520 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.228509 2581 policy_none.go:47] "Start" Sep 08 06:34:52.229331 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.229318 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2xc7f" Sep 08 06:34:52.238665 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.238598 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-120.ec2.internal.18d344f41bc93711 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-120.ec2.internal,UID:ip-10-0-135-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-120.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-120.ec2.internal,},FirstTimestamp:2026-09-08 06:34:52.225099537 +0000 UTC m=+0.417233527,LastTimestamp:2026-09-08 06:34:52.225099537 +0000 UTC m=+0.417233527,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-120.ec2.internal,}" Sep 08 06:34:52.242738 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.242720 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2xc7f" Sep 08 06:34:52.264539 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.264518 2581 manager.go:337] "Starting Device Plugin manager" Sep 08 06:34:52.264667 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.264568 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 06:34:52.264667 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.264581 2581 server.go:87] "Starting device plugin registration server" Sep 08 06:34:52.264958 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.264942 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 06:34:52.265026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.264959 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 06:34:52.265361 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.265315 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 06:34:52.265510 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.265393 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 06:34:52.265510 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.265403 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 06:34:52.265820 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.265802 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 06:34:52.266056 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.265849 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:52.293795 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.284783 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 06:34:52.293795 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.286051 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 06:34:52.293795 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.286098 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 06:34:52.293795 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.286120 2581 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 06:34:52.293795 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.286155 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 06:34:52.293795 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.288790 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:52.365672 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.365548 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:52.367069 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.367049 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:52.367177 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.367084 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:52.367177 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.367098 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:52.367177 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.367121 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.375030 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.375012 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.375123 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.375040 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-120.ec2.internal\": node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:52.387122 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.387102 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal"] Sep 08 06:34:52.387175 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.387167 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:52.388579 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.388565 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:52.388650 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.388595 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:52.388650 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.388604 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:52.390831 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.390819 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:52.390989 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.390976 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.391054 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.391011 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:52.391590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.391573 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:52.391590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.391601 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:52.391737 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.391617 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:52.391737 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.391666 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:52.391737 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.391691 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:52.391737 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.391704 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:52.393975 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.393957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.394068 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.393980 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:52.394965 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.394948 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:52.395047 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.394971 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:52.395047 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.394983 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:52.406249 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.406231 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:52.419579 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.419562 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-120.ec2.internal\" not found" node="ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.424044 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.424029 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-120.ec2.internal\" not found" node="ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.507046 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.507010 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:52.510309 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.510292 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7875ad6f3fbf4f2c59bedaba9af1fdaf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"7875ad6f3fbf4f2c59bedaba9af1fdaf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.510391 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.510315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/36e6dea94038e71ca8f1f3d66d122f60-config\") pod \"kube-apiserver-proxy-ip-10-0-135-120.ec2.internal\" (UID: \"36e6dea94038e71ca8f1f3d66d122f60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.510391 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.510333 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7875ad6f3fbf4f2c59bedaba9af1fdaf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"7875ad6f3fbf4f2c59bedaba9af1fdaf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.607604 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.607577 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:52.610862 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.610843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7875ad6f3fbf4f2c59bedaba9af1fdaf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"7875ad6f3fbf4f2c59bedaba9af1fdaf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.610982 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.610875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7875ad6f3fbf4f2c59bedaba9af1fdaf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"7875ad6f3fbf4f2c59bedaba9af1fdaf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.610982 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.610966 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7875ad6f3fbf4f2c59bedaba9af1fdaf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"7875ad6f3fbf4f2c59bedaba9af1fdaf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.611076 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.610984 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7875ad6f3fbf4f2c59bedaba9af1fdaf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal\" (UID: \"7875ad6f3fbf4f2c59bedaba9af1fdaf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.611076 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.611012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/36e6dea94038e71ca8f1f3d66d122f60-config\") pod \"kube-apiserver-proxy-ip-10-0-135-120.ec2.internal\" (UID: \"36e6dea94038e71ca8f1f3d66d122f60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.611076 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.611055 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/36e6dea94038e71ca8f1f3d66d122f60-config\") pod \"kube-apiserver-proxy-ip-10-0-135-120.ec2.internal\" (UID: \"36e6dea94038e71ca8f1f3d66d122f60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.708275 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.708201 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:52.723073 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.723054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.727850 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:52.727826 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Sep 08 06:34:52.808833 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.808799 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:52.909280 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:52.909254 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:53.009748 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:53.009673 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:53.110214 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:53.110175 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:53.135487 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.135462 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 06:34:53.135915 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.135596 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 06:34:53.168212 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.168181 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:53.210467 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:53.210432 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:53.244774 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.244729 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 06:29:53 +0000 UTC" deadline="2028-03-14 00:34:30.428631932 +0000 UTC" Sep 08 06:34:53.244774 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.244765 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13265h59m37.183870414s" Sep 08 06:34:53.291825 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:53.291794 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7875ad6f3fbf4f2c59bedaba9af1fdaf.slice/crio-2c4a1cc9905584f5a5ed35ac3bd847c2a5adee625cb515e1a434236cbd41d409 WatchSource:0}: Error finding container 2c4a1cc9905584f5a5ed35ac3bd847c2a5adee625cb515e1a434236cbd41d409: Status 404 returned error can't find the container with id 2c4a1cc9905584f5a5ed35ac3bd847c2a5adee625cb515e1a434236cbd41d409 Sep 08 06:34:53.292139 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:53.292125 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e6dea94038e71ca8f1f3d66d122f60.slice/crio-f16ebf099b60e21489556c4fb87a61ee170b6d86dc0c34b0ee2f70897bb1b052 WatchSource:0}: Error finding container f16ebf099b60e21489556c4fb87a61ee170b6d86dc0c34b0ee2f70897bb1b052: Status 404 returned error can't find the container with id f16ebf099b60e21489556c4fb87a61ee170b6d86dc0c34b0ee2f70897bb1b052 Sep 08 06:34:53.296725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.296710 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 06:34:53.311120 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:53.311076 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:53.375382 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.375356 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 06:34:53.376332 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.376315 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientMemory" Sep 08 06:34:53.376422 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.376344 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 06:34:53.376422 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.376354 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeHasSufficientPID" Sep 08 06:34:53.411668 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:53.411644 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-120.ec2.internal\" not found" Sep 08 06:34:53.483482 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.483445 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:53.508740 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.508711 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" Sep 08 06:34:53.520835 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.520811 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 06:34:53.523158 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.523142 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" Sep 08 06:34:53.534643 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.534589 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 06:34:53.673585 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:53.673544 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:55.430553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.430335 2581 apiserver.go:52] "Watching apiserver" Sep 08 06:34:55.439195 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.439169 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 06:34:55.439557 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.439535 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-26nnz","openshift-image-registry/node-ca-5pq5q","openshift-network-diagnostics/network-check-target-cqhzt","openshift-ovn-kubernetes/ovnkube-node-ht5wl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz","openshift-dns/node-resolver-57bmd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal","openshift-multus/multus-additional-cni-plugins-9s6cd","openshift-multus/multus-gc7mf","openshift-multus/network-metrics-daemon-wrk2m","openshift-network-operator/iptables-alerter-f6pr6","kube-system/global-pull-secret-syncer-7s9kb","kube-system/konnectivity-agent-gf2tr","kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal"] Sep 08 06:34:55.442109 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.442089 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:55.442232 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.442176 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:34:55.444295 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.444273 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:34:55.446715 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.446579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:34:55.446715 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.446673 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:34:55.446879 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.446808 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hdvgk\"" Sep 08 06:34:55.446879 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.446814 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 06:34:55.446879 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.446843 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 06:34:55.448934 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.448909 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.449315 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.449286 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 06:34:55.451249 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.451229 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.452049 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.451659 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 06:34:55.452049 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.451887 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 06:34:55.452049 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.451897 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 06:34:55.452049 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.451925 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 06:34:55.452806 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.452788 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 06:34:55.453021 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.453007 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-scdh4\"" Sep 08 06:34:55.453103 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.453087 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 06:34:55.454654 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.453425 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.454654 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.453810 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zgnn9\"" Sep 08 06:34:55.454654 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.454021 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 06:34:55.454654 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.454107 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 06:34:55.454654 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.454249 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 06:34:55.455768 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.455750 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.456318 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.456179 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 06:34:55.456318 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.456231 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 06:34:55.456496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.456480 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pzmcb\"" Sep 08 06:34:55.458232 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.458216 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.459908 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.459737 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 06:34:55.459908 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.459831 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 06:34:55.460155 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.460136 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k7mdf\"" Sep 08 06:34:55.460251 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.460162 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 06:34:55.460309 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.460259 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 06:34:55.460512 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.460497 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.460891 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.460877 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nwq8m\"" Sep 08 06:34:55.460979 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.460969 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 06:34:55.461244 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.461234 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 06:34:55.462121 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462102 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-cni-bin\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462204 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462133 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovn-node-metrics-cert\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462204 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462158 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.462204 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:55.462322 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-kubelet\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462322 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-ovn\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462322 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462249 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-socket-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.462322 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-registration-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.462322 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462305 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-device-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.462553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plh2p\" (UniqueName: \"kubernetes.io/projected/507684ea-943e-4a39-9b62-3d2b7d1cea29-kube-api-access-plh2p\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.462553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:34:55.462553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462466 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-systemd-units\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462499 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-systemd\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462522 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-sys-fs\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.462852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-run-netns\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462612 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-etc-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462681 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-log-socket\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462706 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovnkube-script-lib\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-cni-netd\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-env-overrides\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.462852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462797 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nj8k\" (UniqueName: \"kubernetes.io/projected/f3926a42-8ed3-4688-81da-3867f79e57d6-kube-api-access-9nj8k\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:55.462852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4df9ea7-1d58-410c-bb5a-741db75d7bf2-agent-certs\") pod \"konnectivity-agent-gf2tr\" (UID: \"f4df9ea7-1d58-410c-bb5a-741db75d7bf2\") " pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462883 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovnkube-config\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462916 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd4wr\" (UniqueName: \"kubernetes.io/projected/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-kube-api-access-qd4wr\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462932 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4df9ea7-1d58-410c-bb5a-741db75d7bf2-konnectivity-ca\") pod \"konnectivity-agent-gf2tr\" (UID: \"f4df9ea7-1d58-410c-bb5a-741db75d7bf2\") " pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-slash\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462966 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-var-lib-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.462990 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-node-log\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.463220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.463012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.463543 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.463355 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 06:34:55.467854 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.467803 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.469384 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.469182 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 06:34:55.469384 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.469322 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 06:34:55.469384 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.469356 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.469582 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.469398 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 06:34:55.469582 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.469525 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qqmkr\"" Sep 08 06:34:55.469582 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.469544 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 06:34:55.469797 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.469605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:34:55.469797 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.469716 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9g9nf\"" Sep 08 06:34:55.472693 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.472676 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 06:34:55.472775 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.472715 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 06:34:55.472831 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.472774 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 06:34:55.472831 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.472788 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zxrvx\"" Sep 08 06:34:55.473839 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.473812 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 06:34:55.488621 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.488602 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-47nx6" Sep 08 06:34:55.496516 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.496493 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-47nx6" Sep 08 06:34:55.533272 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.533229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" event={"ID":"7875ad6f3fbf4f2c59bedaba9af1fdaf","Type":"ContainerStarted","Data":"2c4a1cc9905584f5a5ed35ac3bd847c2a5adee625cb515e1a434236cbd41d409"} Sep 08 06:34:55.534470 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.534447 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" event={"ID":"36e6dea94038e71ca8f1f3d66d122f60","Type":"ContainerStarted","Data":"f16ebf099b60e21489556c4fb87a61ee170b6d86dc0c34b0ee2f70897bb1b052"} Sep 08 06:34:55.551081 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.551053 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 06:34:55.563920 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.563892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plh2p\" (UniqueName: \"kubernetes.io/projected/507684ea-943e-4a39-9b62-3d2b7d1cea29-kube-api-access-plh2p\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.564053 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.563932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:34:55.564053 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.563956 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-log-socket\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564053 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.563976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-run-netns\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564053 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564002 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-cni-multus\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.564053 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564028 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.564053 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564052 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-lib-modules\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564097 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovnkube-script-lib\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-cni-netd\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564142 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-env-overrides\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-cnibin\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564170 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-log-socket\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564198 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x46xl\" (UniqueName: \"kubernetes.io/projected/cf08eff7-23af-470a-8755-3a6ee691b2ae-kube-api-access-x46xl\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564233 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-run-netns\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564259 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-cni-netd\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564260 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nj8k\" (UniqueName: \"kubernetes.io/projected/f3926a42-8ed3-4688-81da-3867f79e57d6-kube-api-access-9nj8k\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-netns\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.564330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564321 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cnibin\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/615a0c26-426f-494b-9296-17a9bda45432-dbus\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564388 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-run\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564421 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovnkube-config\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-k8s-cni-cncf-io\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564501 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-kubelet\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564523 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-sys\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564543 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a47c6588-4fa7-40f1-ba73-28705742078e-etc-tuned\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564566 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a47c6588-4fa7-40f1-ba73-28705742078e-tmp\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4df9ea7-1d58-410c-bb5a-741db75d7bf2-konnectivity-ca\") pod \"konnectivity-agent-gf2tr\" (UID: \"f4df9ea7-1d58-410c-bb5a-741db75d7bf2\") " pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564622 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde28304-d067-452d-8c76-514bdd952e5c-tmp-dir\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564672 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-system-cni-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564686 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thfcw\" (UniqueName: \"kubernetes.io/projected/354816ae-ce0a-43bc-bc72-f5dcf1cac013-kube-api-access-thfcw\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.564826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-ovn\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-cni-bin\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564756 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-env-overrides\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysctl-conf\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-systemd\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-var-lib-kubelet\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-socket-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-registration-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovnkube-script-lib\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.564937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-device-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-device-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-etc-selinux\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-systemd-units\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565120 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-systemd\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565145 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-hostroot\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565202 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-modprobe-d\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.565496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-sys-fs\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-etc-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565299 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-cni-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565323 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4df9ea7-1d58-410c-bb5a-741db75d7bf2-konnectivity-ca\") pod \"konnectivity-agent-gf2tr\" (UID: \"f4df9ea7-1d58-410c-bb5a-741db75d7bf2\") " pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565325 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-daemon-config\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565366 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysconfig\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565390 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysctl-d\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-host\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-socket-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-etc-kubernetes\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/615a0c26-426f-494b-9296-17a9bda45432-kubelet-config\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565465 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovnkube-config\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565467 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565490 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-kubernetes\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj4r6\" (UniqueName: \"kubernetes.io/projected/bde28304-d067-452d-8c76-514bdd952e5c-kube-api-access-lj4r6\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565536 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565540 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-ovn\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565546 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-system-cni-dir\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x22nm\" (UniqueName: \"kubernetes.io/projected/6e072f8a-d3d4-4427-b9fb-56503ce678c8-kube-api-access-x22nm\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565579 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-systemd-units\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-registration-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565622 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-systemd\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565663 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-sys-fs\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-conf-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565695 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf08eff7-23af-470a-8755-3a6ee691b2ae-serviceca\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565696 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-run-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565708 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-etc-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565740 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2ft8\" (UniqueName: \"kubernetes.io/projected/a47c6588-4fa7-40f1-ba73-28705742078e-kube-api-access-k2ft8\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565762 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-iptables-alerter-script\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-host-slash\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565810 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmxtq\" (UniqueName: \"kubernetes.io/projected/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-kube-api-access-jmxtq\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-multus-certs\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565893 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4df9ea7-1d58-410c-bb5a-741db75d7bf2-agent-certs\") pod \"konnectivity-agent-gf2tr\" (UID: \"f4df9ea7-1d58-410c-bb5a-741db75d7bf2\") " pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:34:55.566961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd4wr\" (UniqueName: \"kubernetes.io/projected/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-kube-api-access-qd4wr\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.565969 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/507684ea-943e-4a39-9b62-3d2b7d1cea29-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/354816ae-ce0a-43bc-bc72-f5dcf1cac013-cni-binary-copy\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566130 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566185 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-slash\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-var-lib-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-slash\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-node-log\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566302 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-node-log\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-cni-bin\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566345 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-var-lib-openvswitch\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566376 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovn-node-metrics-cert\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566433 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-cni-bin\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566491 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-socket-dir-parent\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566531 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566542 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566569 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf08eff7-23af-470a-8755-3a6ee691b2ae-host\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.567602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:55.568273 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-kubelet\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.568273 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.566725 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:55.568273 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bde28304-d067-452d-8c76-514bdd952e5c-hosts-file\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.568273 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.566796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-host-kubelet\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.568273 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.566903 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs podName:f3926a42-8ed3-4688-81da-3867f79e57d6 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:56.066864854 +0000 UTC m=+3.017262682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs") pod "network-metrics-daemon-wrk2m" (UID: "f3926a42-8ed3-4688-81da-3867f79e57d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:55.570548 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.570529 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-ovn-node-metrics-cert\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.570785 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.570769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4df9ea7-1d58-410c-bb5a-741db75d7bf2-agent-certs\") pod \"konnectivity-agent-gf2tr\" (UID: \"f4df9ea7-1d58-410c-bb5a-741db75d7bf2\") " pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:34:55.572491 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.572061 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:55.572491 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.572089 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:55.572491 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.572101 2581 projected.go:196] Error preparing data for projected volume kube-api-access-876cx for pod openshift-network-diagnostics/network-check-target-cqhzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:55.572491 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.572168 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx podName:7351d60e-d131-459f-b79f-91c9d5c161de nodeName:}" failed. No retries permitted until 2026-09-08 06:34:56.072152596 +0000 UTC m=+3.022550436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-876cx" (UniqueName: "kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx") pod "network-check-target-cqhzt" (UID: "7351d60e-d131-459f-b79f-91c9d5c161de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:55.575038 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.575020 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd4wr\" (UniqueName: \"kubernetes.io/projected/880c9e35-1d4c-4fad-9ebc-828cbd197bc2-kube-api-access-qd4wr\") pod \"ovnkube-node-ht5wl\" (UID: \"880c9e35-1d4c-4fad-9ebc-828cbd197bc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.575167 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.575073 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nj8k\" (UniqueName: \"kubernetes.io/projected/f3926a42-8ed3-4688-81da-3867f79e57d6-kube-api-access-9nj8k\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:55.575167 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.575155 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plh2p\" (UniqueName: \"kubernetes.io/projected/507684ea-943e-4a39-9b62-3d2b7d1cea29-kube-api-access-plh2p\") pod \"aws-ebs-csi-driver-node-vhxzz\" (UID: \"507684ea-943e-4a39-9b62-3d2b7d1cea29\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.667797 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-conf-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.667797 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf08eff7-23af-470a-8755-3a6ee691b2ae-serviceca\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.668026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2ft8\" (UniqueName: \"kubernetes.io/projected/a47c6588-4fa7-40f1-ba73-28705742078e-kube-api-access-k2ft8\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.668026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667848 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-iptables-alerter-script\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.668026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-host-slash\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.668026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667892 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmxtq\" (UniqueName: \"kubernetes.io/projected/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-kube-api-access-jmxtq\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.668026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667900 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-conf-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-multus-certs\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.667965 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-host-slash\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.668026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668002 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-multus-certs\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/354816ae-ce0a-43bc-bc72-f5dcf1cac013-cni-binary-copy\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-socket-dir-parent\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf08eff7-23af-470a-8755-3a6ee691b2ae-host\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bde28304-d067-452d-8c76-514bdd952e5c-hosts-file\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668231 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-cni-multus\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668255 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668278 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-lib-modules\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668321 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-cni-multus\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668324 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-cnibin\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668350 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf08eff7-23af-470a-8755-3a6ee691b2ae-host\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.668408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x46xl\" (UniqueName: \"kubernetes.io/projected/cf08eff7-23af-470a-8755-3a6ee691b2ae-kube-api-access-x46xl\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668408 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf08eff7-23af-470a-8755-3a6ee691b2ae-serviceca\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-socket-dir-parent\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668498 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-iptables-alerter-script\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-netns\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.668522 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-netns\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668547 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cnibin\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cnibin\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:55.668596 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret podName:615a0c26-426f-494b-9296-17a9bda45432 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:56.168563341 +0000 UTC m=+3.118961182 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret") pod "global-pull-secret-syncer-7s9kb" (UID: "615a0c26-426f-494b-9296-17a9bda45432") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bde28304-d067-452d-8c76-514bdd952e5c-hosts-file\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-lib-modules\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668660 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-cnibin\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668705 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/354816ae-ce0a-43bc-bc72-f5dcf1cac013-cni-binary-copy\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/615a0c26-426f-494b-9296-17a9bda45432-dbus\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-run\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.668987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-k8s-cni-cncf-io\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668803 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-kubelet\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668824 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-sys\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668837 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/615a0c26-426f-494b-9296-17a9bda45432-dbus\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668844 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a47c6588-4fa7-40f1-ba73-28705742078e-etc-tuned\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668865 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a47c6588-4fa7-40f1-ba73-28705742078e-tmp\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668888 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-run\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde28304-d067-452d-8c76-514bdd952e5c-tmp-dir\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-system-cni-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thfcw\" (UniqueName: \"kubernetes.io/projected/354816ae-ce0a-43bc-bc72-f5dcf1cac013-kube-api-access-thfcw\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.668984 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-cni-bin\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669006 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysctl-conf\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669028 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-systemd\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-var-lib-kubelet\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669082 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-kubelet\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669121 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-hostroot\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669130 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cni-binary-copy\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.669834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669170 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-modprobe-d\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-run-k8s-cni-cncf-io\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-cni-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-daemon-config\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669249 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-cni-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-modprobe-d\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysconfig\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669290 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-host-var-lib-cni-bin\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysctl-d\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669394 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-system-cni-dir\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669404 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysctl-conf\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669446 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-hostroot\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669450 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-var-lib-kubelet\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669115 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-sys\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-systemd\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bde28304-d067-452d-8c76-514bdd952e5c-tmp-dir\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669504 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-host\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669536 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysconfig\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.670662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-sysctl-d\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-etc-kubernetes\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/354816ae-ce0a-43bc-bc72-f5dcf1cac013-etc-kubernetes\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669579 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-host\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669582 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/615a0c26-426f-494b-9296-17a9bda45432-kubelet-config\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-kubernetes\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj4r6\" (UniqueName: \"kubernetes.io/projected/bde28304-d067-452d-8c76-514bdd952e5c-kube-api-access-lj4r6\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-system-cni-dir\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x22nm\" (UniqueName: \"kubernetes.io/projected/6e072f8a-d3d4-4427-b9fb-56503ce678c8-kube-api-access-x22nm\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669693 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a47c6588-4fa7-40f1-ba73-28705742078e-etc-kubernetes\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669761 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/615a0c26-426f-494b-9296-17a9bda45432-kubelet-config\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669800 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e072f8a-d3d4-4427-b9fb-56503ce678c8-system-cni-dir\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.669830 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/354816ae-ce0a-43bc-bc72-f5dcf1cac013-multus-daemon-config\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.671469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.670076 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e072f8a-d3d4-4427-b9fb-56503ce678c8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.672099 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.671482 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a47c6588-4fa7-40f1-ba73-28705742078e-etc-tuned\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.672099 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.671955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a47c6588-4fa7-40f1-ba73-28705742078e-tmp\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.678278 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.678251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thfcw\" (UniqueName: \"kubernetes.io/projected/354816ae-ce0a-43bc-bc72-f5dcf1cac013-kube-api-access-thfcw\") pod \"multus-gc7mf\" (UID: \"354816ae-ce0a-43bc-bc72-f5dcf1cac013\") " pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.678532 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.678510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x22nm\" (UniqueName: \"kubernetes.io/projected/6e072f8a-d3d4-4427-b9fb-56503ce678c8-kube-api-access-x22nm\") pod \"multus-additional-cni-plugins-9s6cd\" (UID: \"6e072f8a-d3d4-4427-b9fb-56503ce678c8\") " pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.679039 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.679011 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x46xl\" (UniqueName: \"kubernetes.io/projected/cf08eff7-23af-470a-8755-3a6ee691b2ae-kube-api-access-x46xl\") pod \"node-ca-5pq5q\" (UID: \"cf08eff7-23af-470a-8755-3a6ee691b2ae\") " pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.679312 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.679295 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2ft8\" (UniqueName: \"kubernetes.io/projected/a47c6588-4fa7-40f1-ba73-28705742078e-kube-api-access-k2ft8\") pod \"tuned-26nnz\" (UID: \"a47c6588-4fa7-40f1-ba73-28705742078e\") " pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.679915 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.679895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmxtq\" (UniqueName: \"kubernetes.io/projected/2c3eefb3-8419-430a-9dc7-68eb9c326d8d-kube-api-access-jmxtq\") pod \"iptables-alerter-f6pr6\" (UID: \"2c3eefb3-8419-430a-9dc7-68eb9c326d8d\") " pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.679915 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.679906 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj4r6\" (UniqueName: \"kubernetes.io/projected/bde28304-d067-452d-8c76-514bdd952e5c-kube-api-access-lj4r6\") pod \"node-resolver-57bmd\" (UID: \"bde28304-d067-452d-8c76-514bdd952e5c\") " pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.755752 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.755673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:34:55.762704 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.762682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:34:55.772504 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.772339 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" Sep 08 06:34:55.779309 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.779291 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26nnz" Sep 08 06:34:55.786069 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.786054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-57bmd" Sep 08 06:34:55.791071 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.791054 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gc7mf" Sep 08 06:34:55.797723 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.797701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" Sep 08 06:34:55.803776 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.803759 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5pq5q" Sep 08 06:34:55.808525 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.808506 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f6pr6" Sep 08 06:34:55.900293 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:55.900259 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 06:34:56.071506 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.071437 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:56.071648 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.071570 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:56.071648 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.071645 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs podName:f3926a42-8ed3-4688-81da-3867f79e57d6 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:57.071614627 +0000 UTC m=+4.022012448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs") pod "network-metrics-daemon-wrk2m" (UID: "f3926a42-8ed3-4688-81da-3867f79e57d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:56.172004 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.171972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:34:56.172004 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.172008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:56.172222 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.172116 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:56.172222 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.172165 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:56.172222 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.172202 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:56.172222 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.172217 2581 projected.go:196] Error preparing data for projected volume kube-api-access-876cx for pod openshift-network-diagnostics/network-check-target-cqhzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:56.172358 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.172183 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret podName:615a0c26-426f-494b-9296-17a9bda45432 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:57.172160356 +0000 UTC m=+4.122558365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret") pod "global-pull-secret-syncer-7s9kb" (UID: "615a0c26-426f-494b-9296-17a9bda45432") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:56.172358 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.172294 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx podName:7351d60e-d131-459f-b79f-91c9d5c161de nodeName:}" failed. No retries permitted until 2026-09-08 06:34:57.172277136 +0000 UTC m=+4.122674972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-876cx" (UniqueName: "kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx") pod "network-check-target-cqhzt" (UID: "7351d60e-d131-459f-b79f-91c9d5c161de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:56.422521 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:56.422492 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880c9e35_1d4c_4fad_9ebc_828cbd197bc2.slice/crio-b8250fe7892829280a2a49b847416ce65a0647b3e025dd2e1930a434c8c986a7 WatchSource:0}: Error finding container b8250fe7892829280a2a49b847416ce65a0647b3e025dd2e1930a434c8c986a7: Status 404 returned error can't find the container with id b8250fe7892829280a2a49b847416ce65a0647b3e025dd2e1930a434c8c986a7 Sep 08 06:34:56.424087 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:56.424059 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf08eff7_23af_470a_8755_3a6ee691b2ae.slice/crio-34d77f88ac5b71af54befa9d483246969ec90cb64954b5abe2f96a3eedf16c2d WatchSource:0}: Error finding container 34d77f88ac5b71af54befa9d483246969ec90cb64954b5abe2f96a3eedf16c2d: Status 404 returned error can't find the container with id 34d77f88ac5b71af54befa9d483246969ec90cb64954b5abe2f96a3eedf16c2d Sep 08 06:34:56.427142 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:56.427121 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c3eefb3_8419_430a_9dc7_68eb9c326d8d.slice/crio-4c535f734cf3e65dc2603f4291e0fe31f497946fc734c21c1ff634b732841417 WatchSource:0}: Error finding container 4c535f734cf3e65dc2603f4291e0fe31f497946fc734c21c1ff634b732841417: Status 404 returned error can't find the container with id 4c535f734cf3e65dc2603f4291e0fe31f497946fc734c21c1ff634b732841417 Sep 08 06:34:56.427783 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:56.427733 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda47c6588_4fa7_40f1_ba73_28705742078e.slice/crio-8fec7de9237aa37f2d5aa1bd8c59cd701d48db0fc22361d132230ce3873374a3 WatchSource:0}: Error finding container 8fec7de9237aa37f2d5aa1bd8c59cd701d48db0fc22361d132230ce3873374a3: Status 404 returned error can't find the container with id 8fec7de9237aa37f2d5aa1bd8c59cd701d48db0fc22361d132230ce3873374a3 Sep 08 06:34:56.434695 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:34:56.434471 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507684ea_943e_4a39_9b62_3d2b7d1cea29.slice/crio-c35f76c407c51b48d963ae2e1293a25e38a396c42d4c05699b95a3464c3825a4 WatchSource:0}: Error finding container c35f76c407c51b48d963ae2e1293a25e38a396c42d4c05699b95a3464c3825a4: Status 404 returned error can't find the container with id c35f76c407c51b48d963ae2e1293a25e38a396c42d4c05699b95a3464c3825a4 Sep 08 06:34:56.500369 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.500339 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 06:29:55 +0000 UTC" deadline="2028-04-13 19:15:51.216520122 +0000 UTC" Sep 08 06:34:56.500369 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.500370 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14004h40m54.716153497s" Sep 08 06:34:56.528759 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.528734 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:56.528891 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.528867 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:34:56.528968 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.528926 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:34:56.529073 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:56.529050 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:34:56.537756 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.537730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gf2tr" event={"ID":"f4df9ea7-1d58-410c-bb5a-741db75d7bf2","Type":"ContainerStarted","Data":"f919327c2c059fb147e3ea9c17c7a050747104cefa48a79dd5ef35246e80b4ef"} Sep 08 06:34:56.539319 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.539300 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6pr6" event={"ID":"2c3eefb3-8419-430a-9dc7-68eb9c326d8d","Type":"ContainerStarted","Data":"4c535f734cf3e65dc2603f4291e0fe31f497946fc734c21c1ff634b732841417"} Sep 08 06:34:56.542088 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.542068 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pq5q" event={"ID":"cf08eff7-23af-470a-8755-3a6ee691b2ae","Type":"ContainerStarted","Data":"34d77f88ac5b71af54befa9d483246969ec90cb64954b5abe2f96a3eedf16c2d"} Sep 08 06:34:56.545560 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.545538 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"b8250fe7892829280a2a49b847416ce65a0647b3e025dd2e1930a434c8c986a7"} Sep 08 06:34:56.548185 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.548157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" event={"ID":"36e6dea94038e71ca8f1f3d66d122f60","Type":"ContainerStarted","Data":"9aa937b1cb1a167368dffba7ade72dbdfd3869ded25ceb74d4d5196e8005e198"} Sep 08 06:34:56.549907 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.549885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" event={"ID":"6e072f8a-d3d4-4427-b9fb-56503ce678c8","Type":"ContainerStarted","Data":"4a7c8355e13925de77f693c2a2524833fcb2c3cc87d83ba8196002a0047821d3"} Sep 08 06:34:56.551886 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.551866 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gc7mf" event={"ID":"354816ae-ce0a-43bc-bc72-f5dcf1cac013","Type":"ContainerStarted","Data":"c73a4ffec1adf74285f34ad3bc64d4d94f6780c9e47e62a0cd542be0d1795f96"} Sep 08 06:34:56.554692 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.554624 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26nnz" event={"ID":"a47c6588-4fa7-40f1-ba73-28705742078e","Type":"ContainerStarted","Data":"8fec7de9237aa37f2d5aa1bd8c59cd701d48db0fc22361d132230ce3873374a3"} Sep 08 06:34:56.556868 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.556850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" event={"ID":"507684ea-943e-4a39-9b62-3d2b7d1cea29","Type":"ContainerStarted","Data":"c35f76c407c51b48d963ae2e1293a25e38a396c42d4c05699b95a3464c3825a4"} Sep 08 06:34:56.558135 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:56.558117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57bmd" event={"ID":"bde28304-d067-452d-8c76-514bdd952e5c","Type":"ContainerStarted","Data":"b2bc26f7f0998a7570058efc21ad160ae57a7fe81e360a2e4b29721d26c79f32"} Sep 08 06:34:57.080884 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.080796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:57.081460 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.081036 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:57.081460 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.081107 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs podName:f3926a42-8ed3-4688-81da-3867f79e57d6 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:59.081087773 +0000 UTC m=+6.031485596 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs") pod "network-metrics-daemon-wrk2m" (UID: "f3926a42-8ed3-4688-81da-3867f79e57d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:57.182152 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.182113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:34:57.182335 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.182167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:57.182396 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.182340 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:57.182444 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.182403 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret podName:615a0c26-426f-494b-9296-17a9bda45432 nodeName:}" failed. No retries permitted until 2026-09-08 06:34:59.182385425 +0000 UTC m=+6.132783266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret") pod "global-pull-secret-syncer-7s9kb" (UID: "615a0c26-426f-494b-9296-17a9bda45432") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:57.182516 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.182501 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:57.182566 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.182526 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:57.182566 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.182539 2581 projected.go:196] Error preparing data for projected volume kube-api-access-876cx for pod openshift-network-diagnostics/network-check-target-cqhzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:57.182687 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.182579 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx podName:7351d60e-d131-459f-b79f-91c9d5c161de nodeName:}" failed. No retries permitted until 2026-09-08 06:34:59.182566192 +0000 UTC m=+6.132964024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-876cx" (UniqueName: "kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx") pod "network-check-target-cqhzt" (UID: "7351d60e-d131-459f-b79f-91c9d5c161de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:57.501553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.501434 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 06:29:55 +0000 UTC" deadline="2028-04-24 15:24:55.836775257 +0000 UTC" Sep 08 06:34:57.501553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.501500 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14264h49m58.335278783s" Sep 08 06:34:57.531866 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.531343 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:57.531866 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:57.531478 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:34:57.570213 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.570177 2581 generic.go:356] "Generic (PLEG): container finished" podID="7875ad6f3fbf4f2c59bedaba9af1fdaf" containerID="452bf1e343ce6a559a31079b1588335ea3b6f57cb5f93d37bbbdaf584ea27957" exitCode=0 Sep 08 06:34:57.570382 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.570268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" event={"ID":"7875ad6f3fbf4f2c59bedaba9af1fdaf","Type":"ContainerDied","Data":"452bf1e343ce6a559a31079b1588335ea3b6f57cb5f93d37bbbdaf584ea27957"} Sep 08 06:34:57.587753 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:57.587396 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-120.ec2.internal" podStartSLOduration=3.587374529 podStartE2EDuration="3.587374529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:34:56.565773873 +0000 UTC m=+3.516171713" watchObservedRunningTime="2026-09-08 06:34:57.587374529 +0000 UTC m=+4.537772376" Sep 08 06:34:58.531206 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:58.528309 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:34:58.531206 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:58.528676 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:34:58.531206 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:58.528505 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:58.531206 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:58.529094 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:34:58.591728 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:58.591690 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" event={"ID":"7875ad6f3fbf4f2c59bedaba9af1fdaf","Type":"ContainerStarted","Data":"5a359ecde2b80221e2360b1f492173337542f3d34fdf069909627d1c99be8781"} Sep 08 06:34:58.610657 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:58.610424 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-120.ec2.internal" podStartSLOduration=4.6104021809999995 podStartE2EDuration="4.610402181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:34:58.61026778 +0000 UTC m=+5.560665624" watchObservedRunningTime="2026-09-08 06:34:58.610402181 +0000 UTC m=+5.560800025" Sep 08 06:34:59.101194 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:59.100691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:59.101194 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.100824 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:59.101194 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.100883 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs podName:f3926a42-8ed3-4688-81da-3867f79e57d6 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:03.100863571 +0000 UTC m=+10.051261446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs") pod "network-metrics-daemon-wrk2m" (UID: "f3926a42-8ed3-4688-81da-3867f79e57d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:34:59.202735 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:59.201973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:34:59.202735 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:59.202027 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:34:59.202735 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.202178 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:59.202735 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.202237 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret podName:615a0c26-426f-494b-9296-17a9bda45432 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:03.202219981 +0000 UTC m=+10.152618017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret") pod "global-pull-secret-syncer-7s9kb" (UID: "615a0c26-426f-494b-9296-17a9bda45432") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:34:59.202735 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.202331 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:34:59.202735 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.202348 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:34:59.202735 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.202360 2581 projected.go:196] Error preparing data for projected volume kube-api-access-876cx for pod openshift-network-diagnostics/network-check-target-cqhzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:59.202735 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.202398 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx podName:7351d60e-d131-459f-b79f-91c9d5c161de nodeName:}" failed. No retries permitted until 2026-09-08 06:35:03.202384892 +0000 UTC m=+10.152782717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-876cx" (UniqueName: "kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx") pod "network-check-target-cqhzt" (UID: "7351d60e-d131-459f-b79f-91c9d5c161de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:34:59.529023 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:34:59.528936 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:34:59.529166 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:34:59.529138 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:00.528084 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:00.528038 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:00.528591 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:00.528161 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:00.528591 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:00.528539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:00.528744 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:00.528646 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:01.536909 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:01.535795 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:01.536909 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:01.536002 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:02.528279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:02.528241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:02.528471 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:02.528381 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:02.528844 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:02.528822 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:02.528945 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:02.528927 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:03.137446 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:03.137399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:03.137925 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.137582 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:03.137925 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.137676 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs podName:f3926a42-8ed3-4688-81da-3867f79e57d6 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:11.137654042 +0000 UTC m=+18.088051877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs") pod "network-metrics-daemon-wrk2m" (UID: "f3926a42-8ed3-4688-81da-3867f79e57d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:03.238474 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:03.238433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:03.238658 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:03.238488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:03.238719 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.238663 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:03.238719 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.238671 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:35:03.238719 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.238699 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:35:03.238719 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.238715 2581 projected.go:196] Error preparing data for projected volume kube-api-access-876cx for pod openshift-network-diagnostics/network-check-target-cqhzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:03.238945 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.238732 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret podName:615a0c26-426f-494b-9296-17a9bda45432 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:11.238713622 +0000 UTC m=+18.189111447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret") pod "global-pull-secret-syncer-7s9kb" (UID: "615a0c26-426f-494b-9296-17a9bda45432") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:03.238945 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.238780 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx podName:7351d60e-d131-459f-b79f-91c9d5c161de nodeName:}" failed. No retries permitted until 2026-09-08 06:35:11.238763786 +0000 UTC m=+18.189161622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-876cx" (UniqueName: "kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx") pod "network-check-target-cqhzt" (UID: "7351d60e-d131-459f-b79f-91c9d5c161de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:03.531794 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:03.531726 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:03.531928 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:03.531861 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:04.528092 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:04.528058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:04.528529 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:04.528058 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:04.528529 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:04.528204 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:04.528529 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:04.528302 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:05.529091 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:05.528566 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:05.529091 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:05.528731 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:06.528444 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:06.528408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:06.528610 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:06.528416 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:06.528610 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:06.528531 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:06.528610 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:06.528593 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:07.528749 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:07.528709 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:07.529180 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:07.528858 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:08.528026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:08.527994 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:08.528217 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:08.527995 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:08.528217 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:08.528115 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:08.528217 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:08.528203 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:09.528398 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:09.528366 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:09.528863 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:09.528493 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:10.528194 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:10.528148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:10.528453 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:10.528148 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:10.528453 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:10.528293 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:10.528453 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:10.528348 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:11.193063 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:11.193024 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:11.193249 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.193156 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:11.193249 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.193219 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs podName:f3926a42-8ed3-4688-81da-3867f79e57d6 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:27.193204053 +0000 UTC m=+34.143601874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs") pod "network-metrics-daemon-wrk2m" (UID: "f3926a42-8ed3-4688-81da-3867f79e57d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:11.294119 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:11.294080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:11.294283 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:11.294130 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:11.294283 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.294225 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:11.294283 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.294241 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:35:11.294283 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.294260 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:35:11.294283 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.294271 2581 projected.go:196] Error preparing data for projected volume kube-api-access-876cx for pod openshift-network-diagnostics/network-check-target-cqhzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:11.294283 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.294286 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret podName:615a0c26-426f-494b-9296-17a9bda45432 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:27.294265089 +0000 UTC m=+34.244662927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret") pod "global-pull-secret-syncer-7s9kb" (UID: "615a0c26-426f-494b-9296-17a9bda45432") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:11.294489 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.294305 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx podName:7351d60e-d131-459f-b79f-91c9d5c161de nodeName:}" failed. No retries permitted until 2026-09-08 06:35:27.294296219 +0000 UTC m=+34.244694043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-876cx" (UniqueName: "kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx") pod "network-check-target-cqhzt" (UID: "7351d60e-d131-459f-b79f-91c9d5c161de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:11.528887 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:11.528858 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:11.529328 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:11.528998 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:12.528474 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:12.528435 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:12.528700 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:12.528442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:12.528700 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:12.528565 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:12.528700 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:12.528608 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:13.528773 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:13.528743 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:13.529240 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:13.528862 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:14.528109 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:14.528075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:14.528244 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:14.528190 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:14.528244 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:14.528236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:14.528348 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:14.528330 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:15.528906 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.528673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:15.529712 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:15.529010 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:15.631514 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.631483 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" event={"ID":"507684ea-943e-4a39-9b62-3d2b7d1cea29","Type":"ContainerStarted","Data":"34d8de547a28db195027c88b5057fe5914f79f25bac5778bed398f9f77c5c44e"} Sep 08 06:35:15.633043 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.633016 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-57bmd" event={"ID":"bde28304-d067-452d-8c76-514bdd952e5c","Type":"ContainerStarted","Data":"4f00bdc768a23b86fcf36191bdb93a620658f28651dba3a0398c729a9e3f9aed"} Sep 08 06:35:15.634687 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.634661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gf2tr" event={"ID":"f4df9ea7-1d58-410c-bb5a-741db75d7bf2","Type":"ContainerStarted","Data":"0986f3e864ba16f885c331808f09ba82f696a4ca94d34bbf93c60e58c022a084"} Sep 08 06:35:15.636206 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.636177 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5pq5q" event={"ID":"cf08eff7-23af-470a-8755-3a6ee691b2ae","Type":"ContainerStarted","Data":"dc5627187e830aa8c22798a519a081198d1a6d69a249308a16c9e30ff39226ef"} Sep 08 06:35:15.639202 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.639184 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:35:15.639564 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.639546 2581 generic.go:356] "Generic (PLEG): container finished" podID="880c9e35-1d4c-4fad-9ebc-828cbd197bc2" containerID="4b462c0e1541e257046d6a5c940a87f2f4f7b69cec29f760f51d82f57a6e3902" exitCode=1 Sep 08 06:35:15.639666 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.639614 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"c8fded32c1ab9fd616b2b70e95eca3bd5a2bc7fe42bd1e1f518961e272dd6594"} Sep 08 06:35:15.639728 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.639700 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"0ebeec7cee410a748997808638840889a73aeb9a5b6fee81e2bf7f398b30ade9"} Sep 08 06:35:15.639777 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.639733 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"056967b0e15d96637b341d79baef354f8e33d5f1f7cc79b5c9510e4722057c9f"} Sep 08 06:35:15.639777 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.639761 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"8695b9ae8e9277dd7bf50de462ffc40a4d02db9e6722304ef99516b5007ee550"} Sep 08 06:35:15.639871 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.639796 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerDied","Data":"4b462c0e1541e257046d6a5c940a87f2f4f7b69cec29f760f51d82f57a6e3902"} Sep 08 06:35:15.639871 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.639831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"2ac8812c7552940dad52b1a1ed6179c2c2d6686773c03b2cb4f535ead9d5d0c2"} Sep 08 06:35:15.640984 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.640965 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e072f8a-d3d4-4427-b9fb-56503ce678c8" containerID="6a822bc4190315b31e9b66e77c716c244891e5f777ebab47f5723854ef9bef5f" exitCode=0 Sep 08 06:35:15.641066 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.641026 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" event={"ID":"6e072f8a-d3d4-4427-b9fb-56503ce678c8","Type":"ContainerDied","Data":"6a822bc4190315b31e9b66e77c716c244891e5f777ebab47f5723854ef9bef5f"} Sep 08 06:35:15.642595 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.642562 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gc7mf" event={"ID":"354816ae-ce0a-43bc-bc72-f5dcf1cac013","Type":"ContainerStarted","Data":"eb486920986132effdb0f4d4e81611138f5abc334c2abbf3e5aca90b9449be30"} Sep 08 06:35:15.644060 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.644037 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26nnz" event={"ID":"a47c6588-4fa7-40f1-ba73-28705742078e","Type":"ContainerStarted","Data":"4d667e01f097ad7366647055dd94dcc6fbc713eb3909fa8bc5d1b5d2056aa791"} Sep 08 06:35:15.649496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.649458 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-57bmd" podStartSLOduration=4.3540628 podStartE2EDuration="22.64944582s" totalImagesPullingTime="18.29538302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:15.648766262 +0000 UTC m=+22.599164105" watchObservedRunningTime="2026-09-08 06:35:15.64944582 +0000 UTC m=+22.599843664" Sep 08 06:35:15.663700 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.663667 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gf2tr" podStartSLOduration=4.749176336 podStartE2EDuration="22.663655812s" totalImagesPullingTime="17.914479476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:15.663435262 +0000 UTC m=+22.613833105" watchObservedRunningTime="2026-09-08 06:35:15.663655812 +0000 UTC m=+22.614053654" Sep 08 06:35:15.677869 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.677839 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5pq5q" podStartSLOduration=4.398286231 podStartE2EDuration="22.677828372s" totalImagesPullingTime="18.279542141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:15.677656087 +0000 UTC m=+22.628053924" watchObservedRunningTime="2026-09-08 06:35:15.677828372 +0000 UTC m=+22.628226214" Sep 08 06:35:15.695076 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.695048 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26nnz" podStartSLOduration=4.397222188 podStartE2EDuration="22.695037015s" totalImagesPullingTime="18.297814827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:15.694660806 +0000 UTC m=+22.645058644" watchObservedRunningTime="2026-09-08 06:35:15.695037015 +0000 UTC m=+22.645434858" Sep 08 06:35:15.715468 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.715398 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gc7mf" podStartSLOduration=3.942353174 podStartE2EDuration="22.715381593s" totalImagesPullingTime="18.773028419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:15.715095543 +0000 UTC m=+22.665493386" watchObservedRunningTime="2026-09-08 06:35:15.715381593 +0000 UTC m=+22.665779439" Sep 08 06:35:15.774609 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.774382 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:15.864728 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.864695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:15.963748 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:15.963702 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:16.177821 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.177773 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 06:35:16.212227 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.212183 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:16.275429 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.275407 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:16.520547 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.520303 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T06:35:16.177818343Z","UUID":"1c5de241-a19f-46cc-94f9-99d641d0dfaf","Handler":null,"Name":"","Endpoint":""} Sep 08 06:35:16.521910 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.521883 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 06:35:16.521910 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.521909 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 06:35:16.528032 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.528010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:16.528141 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.528010 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:16.528141 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:16.528116 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:16.528245 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:16.528198 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:16.649095 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.649060 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" event={"ID":"507684ea-943e-4a39-9b62-3d2b7d1cea29","Type":"ContainerStarted","Data":"7c09dc000104d19e61b895ff8dfeee115fafbca1580d994c69561a76071e8042"} Sep 08 06:35:16.650828 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.650802 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f6pr6" event={"ID":"2c3eefb3-8419-430a-9dc7-68eb9c326d8d","Type":"ContainerStarted","Data":"7ab5e0b8487637c001ab198e3dd0789b2bbcd1c8cd0d496fb8bc3883891feb4f"} Sep 08 06:35:16.813096 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.813011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:16.914335 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:16.914301 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:17.526873 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:17.526371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:17.529669 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:17.528279 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:17.529669 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:17.528387 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:17.627980 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:17.627947 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:17.655435 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:17.655354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" event={"ID":"507684ea-943e-4a39-9b62-3d2b7d1cea29","Type":"ContainerStarted","Data":"58d2a753759dad894fa8d61892590962adcc0dae12e3bb3cadd31a94b2484a99"} Sep 08 06:35:17.659031 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:17.659011 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:35:17.659458 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:17.659437 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"886e054065095c2fdf9eb4fd4e3492b25e72201d6cf3f2beb91912bc9c3a16cf"} Sep 08 06:35:17.677660 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:17.677602 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f6pr6" podStartSLOduration=6.373396009 podStartE2EDuration="24.677590834s" totalImagesPullingTime="18.304194825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:16.670819925 +0000 UTC m=+23.621217768" watchObservedRunningTime="2026-09-08 06:35:17.677590834 +0000 UTC m=+24.627988676" Sep 08 06:35:17.677980 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:17.677960 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vhxzz" podStartSLOduration=4.060476557 podStartE2EDuration="24.677953902s" totalImagesPullingTime="20.617477345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:17.677361776 +0000 UTC m=+24.627759610" watchObservedRunningTime="2026-09-08 06:35:17.677953902 +0000 UTC m=+24.628351786" Sep 08 06:35:18.414820 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:18.414788 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:35:18.415304 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:18.415286 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:35:18.494907 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:18.494874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:18.528931 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:18.528899 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:18.529061 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:18.529005 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:18.529117 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:18.529059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:18.529165 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:18.529149 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:19.528429 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:19.528384 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:19.528972 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:19.528546 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:20.528448 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:20.528313 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:20.528791 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:20.528337 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:20.528791 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:20.528532 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:20.528791 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:20.528652 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:20.671462 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:20.669763 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:35:20.671886 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:20.671845 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"85d414d689003a7396930a0f8f432de89f79d10c4075c66e7d9f85a12626bcc8"} Sep 08 06:35:20.672166 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:20.672138 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:35:20.672414 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:20.672350 2581 scope.go:117] "RemoveContainer" containerID="4b462c0e1541e257046d6a5c940a87f2f4f7b69cec29f760f51d82f57a6e3902" Sep 08 06:35:20.689528 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:20.689507 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:35:21.528892 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.528865 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:21.529426 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:21.528968 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:21.678001 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.677976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:35:21.678352 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.678330 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" event={"ID":"880c9e35-1d4c-4fad-9ebc-828cbd197bc2","Type":"ContainerStarted","Data":"6376e1a26dcab5b86ac5bc65b28cab43224d4728d6073b6abcba803e7e7a646a"} Sep 08 06:35:21.678439 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.678392 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 08 06:35:21.678682 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.678659 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:35:21.680233 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.680209 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e072f8a-d3d4-4427-b9fb-56503ce678c8" containerID="a59bf4b212b240f148f8b79bdf86c55c3de03a0a6c9b9bb1eb5ce8795cad98e9" exitCode=0 Sep 08 06:35:21.680313 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.680242 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" event={"ID":"6e072f8a-d3d4-4427-b9fb-56503ce678c8","Type":"ContainerDied","Data":"a59bf4b212b240f148f8b79bdf86c55c3de03a0a6c9b9bb1eb5ce8795cad98e9"} Sep 08 06:35:21.694119 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.694101 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:35:21.785179 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.785131 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" podStartSLOduration=10.479761775 podStartE2EDuration="28.785114117s" totalImagesPullingTime="18.305352342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:21.736907377 +0000 UTC m=+28.687305231" watchObservedRunningTime="2026-09-08 06:35:21.785114117 +0000 UTC m=+28.735512025" Sep 08 06:35:21.868887 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.868847 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:21.988139 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:21.988110 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:22.528539 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.528376 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:22.528691 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.528431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:22.528691 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:22.528601 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:22.528786 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:22.528687 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:22.682569 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.682539 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 08 06:35:22.693362 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.693337 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7s9kb"] Sep 08 06:35:22.693507 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.693427 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:22.693571 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:22.693515 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:22.696502 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.696481 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cqhzt"] Sep 08 06:35:22.696595 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.696550 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:22.696656 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:22.696615 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:22.701153 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.701061 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wrk2m"] Sep 08 06:35:22.701153 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:22.701157 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:22.701265 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:22.701225 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:23.686564 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:23.686530 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e072f8a-d3d4-4427-b9fb-56503ce678c8" containerID="583d8b41c3b0c26cec2319d66da83c311142282d34b313986353ad890ba8c0f2" exitCode=0 Sep 08 06:35:23.686978 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:23.686615 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" event={"ID":"6e072f8a-d3d4-4427-b9fb-56503ce678c8","Type":"ContainerDied","Data":"583d8b41c3b0c26cec2319d66da83c311142282d34b313986353ad890ba8c0f2"} Sep 08 06:35:23.686978 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:23.686717 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 08 06:35:23.729591 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:23.729566 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:35:24.163610 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:24.163581 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:24.260871 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:24.260820 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:24.336035 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:24.336007 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:24.528921 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:24.528882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:24.529060 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:24.528978 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:24.529060 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:24.528988 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:24.529060 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:24.529009 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:24.529174 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:24.529090 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:24.529174 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:24.529165 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:25.331451 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:25.331416 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:35:25.331935 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:25.331564 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 08 06:35:25.332098 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:25.332080 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gf2tr" Sep 08 06:35:25.434076 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:25.434043 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:25.693315 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:25.693230 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e072f8a-d3d4-4427-b9fb-56503ce678c8" containerID="85ac48a50484b0e47559dd0f1c50ae97331ff0f5f419b40335e50de2f350ef42" exitCode=0 Sep 08 06:35:25.693434 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:25.693310 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" event={"ID":"6e072f8a-d3d4-4427-b9fb-56503ce678c8","Type":"ContainerDied","Data":"85ac48a50484b0e47559dd0f1c50ae97331ff0f5f419b40335e50de2f350ef42"} Sep 08 06:35:26.528065 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:26.528032 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:26.528526 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:26.528120 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:26.528526 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:26.528244 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:26.528526 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:26.528254 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cqhzt" podUID="7351d60e-d131-459f-b79f-91c9d5c161de" Sep 08 06:35:26.528526 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:26.528345 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7s9kb" podUID="615a0c26-426f-494b-9296-17a9bda45432" Sep 08 06:35:26.528526 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:26.528400 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wrk2m" podUID="f3926a42-8ed3-4688-81da-3867f79e57d6" Sep 08 06:35:26.797900 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:26.797871 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:27.161849 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.161757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:27.207263 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.207228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:27.207433 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:27.207412 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:27.207505 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:27.207494 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs podName:f3926a42-8ed3-4688-81da-3867f79e57d6 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:59.207472231 +0000 UTC m=+66.157870055 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs") pod "network-metrics-daemon-wrk2m" (UID: "f3926a42-8ed3-4688-81da-3867f79e57d6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 06:35:27.307824 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.307790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:27.307993 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.307834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:27.307993 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:27.307940 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:27.307993 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:27.307955 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 06:35:27.307993 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:27.307972 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 06:35:27.307993 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:27.307984 2581 projected.go:196] Error preparing data for projected volume kube-api-access-876cx for pod openshift-network-diagnostics/network-check-target-cqhzt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:27.308257 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:27.308007 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret podName:615a0c26-426f-494b-9296-17a9bda45432 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:59.307988823 +0000 UTC m=+66.258386660 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret") pod "global-pull-secret-syncer-7s9kb" (UID: "615a0c26-426f-494b-9296-17a9bda45432") : object "kube-system"/"original-pull-secret" not registered Sep 08 06:35:27.308257 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:27.308023 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx podName:7351d60e-d131-459f-b79f-91c9d5c161de nodeName:}" failed. No retries permitted until 2026-09-08 06:35:59.308013224 +0000 UTC m=+66.258411044 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-876cx" (UniqueName: "kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx") pod "network-check-target-cqhzt" (UID: "7351d60e-d131-459f-b79f-91c9d5c161de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 06:35:27.803792 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.803763 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-120.ec2.internal" event="NodeReady" Sep 08 06:35:27.804216 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.803904 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 06:35:27.867026 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.866887 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jjwd2"] Sep 08 06:35:27.869035 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.869015 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c6ft7"] Sep 08 06:35:27.869178 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.869155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:27.871998 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.871979 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6ft7" Sep 08 06:35:27.872349 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.872159 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 06:35:27.872349 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.872175 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4jz89\"" Sep 08 06:35:27.872505 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.872481 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 06:35:27.875034 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.874853 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 06:35:27.875191 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.874905 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 06:35:27.875191 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.874964 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 06:35:27.875336 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.875311 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qjzjr\"" Sep 08 06:35:27.882594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.882572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jjwd2"] Sep 08 06:35:27.885113 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:27.885093 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6ft7"] Sep 08 06:35:28.013201 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.013165 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9l6l\" (UniqueName: \"kubernetes.io/projected/1c3645c6-0b9b-4b40-b51b-5154985cda53-kube-api-access-z9l6l\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.013360 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.013313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46c4ec53-1e42-4245-8069-87b30a351ca7-cert\") pod \"ingress-canary-c6ft7\" (UID: \"46c4ec53-1e42-4245-8069-87b30a351ca7\") " pod="openshift-ingress-canary/ingress-canary-c6ft7" Sep 08 06:35:28.013360 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.013350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9khbf\" (UniqueName: \"kubernetes.io/projected/46c4ec53-1e42-4245-8069-87b30a351ca7-kube-api-access-9khbf\") pod \"ingress-canary-c6ft7\" (UID: \"46c4ec53-1e42-4245-8069-87b30a351ca7\") " pod="openshift-ingress-canary/ingress-canary-c6ft7" Sep 08 06:35:28.013451 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.013368 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.013451 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.013394 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c3645c6-0b9b-4b40-b51b-5154985cda53-tmp-dir\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.013513 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.013452 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c3645c6-0b9b-4b40-b51b-5154985cda53-config-volume\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.044751 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.044714 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:28.113777 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.113746 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9l6l\" (UniqueName: \"kubernetes.io/projected/1c3645c6-0b9b-4b40-b51b-5154985cda53-kube-api-access-z9l6l\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.113947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.113828 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46c4ec53-1e42-4245-8069-87b30a351ca7-cert\") pod \"ingress-canary-c6ft7\" (UID: \"46c4ec53-1e42-4245-8069-87b30a351ca7\") " pod="openshift-ingress-canary/ingress-canary-c6ft7" Sep 08 06:35:28.113947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.113856 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9khbf\" (UniqueName: \"kubernetes.io/projected/46c4ec53-1e42-4245-8069-87b30a351ca7-kube-api-access-9khbf\") pod \"ingress-canary-c6ft7\" (UID: \"46c4ec53-1e42-4245-8069-87b30a351ca7\") " pod="openshift-ingress-canary/ingress-canary-c6ft7" Sep 08 06:35:28.113947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.113879 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.113947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.113902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c3645c6-0b9b-4b40-b51b-5154985cda53-tmp-dir\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.113947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.113938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c3645c6-0b9b-4b40-b51b-5154985cda53-config-volume\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.114198 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:28.114015 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:28.114198 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:28.114069 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls podName:1c3645c6-0b9b-4b40-b51b-5154985cda53 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:28.614051725 +0000 UTC m=+35.564449565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls") pod "dns-default-jjwd2" (UID: "1c3645c6-0b9b-4b40-b51b-5154985cda53") : secret "dns-default-metrics-tls" not found Sep 08 06:35:28.114347 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.114327 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c3645c6-0b9b-4b40-b51b-5154985cda53-tmp-dir\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.114517 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.114501 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1c3645c6-0b9b-4b40-b51b-5154985cda53-config-volume\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.116107 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.116053 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:28.118997 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.118942 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46c4ec53-1e42-4245-8069-87b30a351ca7-cert\") pod \"ingress-canary-c6ft7\" (UID: \"46c4ec53-1e42-4245-8069-87b30a351ca7\") " pod="openshift-ingress-canary/ingress-canary-c6ft7" Sep 08 06:35:28.126997 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.126972 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9l6l\" (UniqueName: \"kubernetes.io/projected/1c3645c6-0b9b-4b40-b51b-5154985cda53-kube-api-access-z9l6l\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.128049 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.128027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9khbf\" (UniqueName: \"kubernetes.io/projected/46c4ec53-1e42-4245-8069-87b30a351ca7-kube-api-access-9khbf\") pod \"ingress-canary-c6ft7\" (UID: \"46c4ec53-1e42-4245-8069-87b30a351ca7\") " pod="openshift-ingress-canary/ingress-canary-c6ft7" Sep 08 06:35:28.186895 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.186861 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c6ft7" Sep 08 06:35:28.471804 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.471705 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c6ft7"] Sep 08 06:35:28.476308 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:35:28.476284 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c4ec53_1e42_4245_8069_87b30a351ca7.slice/crio-bc8b594cd83c7216f34d64530a05b9fda137ff4d44ef40abec264720c1429d36 WatchSource:0}: Error finding container bc8b594cd83c7216f34d64530a05b9fda137ff4d44ef40abec264720c1429d36: Status 404 returned error can't find the container with id bc8b594cd83c7216f34d64530a05b9fda137ff4d44ef40abec264720c1429d36 Sep 08 06:35:28.528267 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.528241 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:28.528391 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.528270 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:28.528391 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.528275 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:28.531137 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.531116 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 06:35:28.531137 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.531129 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 06:35:28.531303 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.531185 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 06:35:28.531303 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.531130 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 06:35:28.532415 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.532208 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rcs59\"" Sep 08 06:35:28.532415 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.532212 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jhmvb\"" Sep 08 06:35:28.618143 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.618104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:28.618316 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:28.618241 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:28.618316 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:28.618300 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls podName:1c3645c6-0b9b-4b40-b51b-5154985cda53 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:29.618282718 +0000 UTC m=+36.568680559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls") pod "dns-default-jjwd2" (UID: "1c3645c6-0b9b-4b40-b51b-5154985cda53") : secret "dns-default-metrics-tls" not found Sep 08 06:35:28.701140 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:28.701108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6ft7" event={"ID":"46c4ec53-1e42-4245-8069-87b30a351ca7","Type":"ContainerStarted","Data":"bc8b594cd83c7216f34d64530a05b9fda137ff4d44ef40abec264720c1429d36"} Sep 08 06:35:29.625814 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:29.625778 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:29.626536 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:29.625980 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:29.626536 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:29.626067 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls podName:1c3645c6-0b9b-4b40-b51b-5154985cda53 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:31.626044087 +0000 UTC m=+38.576441925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls") pod "dns-default-jjwd2" (UID: "1c3645c6-0b9b-4b40-b51b-5154985cda53") : secret "dns-default-metrics-tls" not found Sep 08 06:35:30.711142 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:30.710861 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e072f8a-d3d4-4427-b9fb-56503ce678c8" containerID="a9f27afbb95f80b30d0dee31a39e01435dd5c589fca8a58d67da58292d2a3fb5" exitCode=0 Sep 08 06:35:30.711142 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:30.710927 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" event={"ID":"6e072f8a-d3d4-4427-b9fb-56503ce678c8","Type":"ContainerDied","Data":"a9f27afbb95f80b30d0dee31a39e01435dd5c589fca8a58d67da58292d2a3fb5"} Sep 08 06:35:31.639815 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:31.639781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:31.640025 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:31.639911 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:31.640025 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:31.639966 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls podName:1c3645c6-0b9b-4b40-b51b-5154985cda53 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:35.63995252 +0000 UTC m=+42.590350341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls") pod "dns-default-jjwd2" (UID: "1c3645c6-0b9b-4b40-b51b-5154985cda53") : secret "dns-default-metrics-tls" not found Sep 08 06:35:31.717237 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:31.717207 2581 generic.go:356] "Generic (PLEG): container finished" podID="6e072f8a-d3d4-4427-b9fb-56503ce678c8" containerID="a830cfdb0a32985a205110dc7f6a8b7b4bc4850d1c08d97d7f1194d795716747" exitCode=0 Sep 08 06:35:31.717615 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:31.717254 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" event={"ID":"6e072f8a-d3d4-4427-b9fb-56503ce678c8","Type":"ContainerDied","Data":"a830cfdb0a32985a205110dc7f6a8b7b4bc4850d1c08d97d7f1194d795716747"} Sep 08 06:35:32.163216 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:32.163184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:32.722918 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:32.722885 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" event={"ID":"6e072f8a-d3d4-4427-b9fb-56503ce678c8","Type":"ContainerStarted","Data":"2e1afac1c2293d0703ec597a1526e09a19d5aebfcbf26b39edb33e9210e92980"} Sep 08 06:35:32.754491 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:32.754449 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9s6cd" podStartSLOduration=8.839482457999999 podStartE2EDuration="39.754434204s" totalImagesPullingTime="30.914951746s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:32.754297061 +0000 UTC m=+39.704694906" watchObservedRunningTime="2026-09-08 06:35:32.754434204 +0000 UTC m=+39.704832046" Sep 08 06:35:32.880673 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:32.880618 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:32.950899 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:32.950825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:33.726510 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:33.726476 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c6ft7" event={"ID":"46c4ec53-1e42-4245-8069-87b30a351ca7","Type":"ContainerStarted","Data":"cb1f459478e716946efe4c26b5a3ec0591f443c0314aa15bc583d41ddff3cb4d"} Sep 08 06:35:33.748576 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:33.748535 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c6ft7" podStartSLOduration=2.55290383 podStartE2EDuration="6.748523069s" totalImagesPullingTime="4.195619239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:33.747257433 +0000 UTC m=+40.697655276" watchObservedRunningTime="2026-09-08 06:35:33.748523069 +0000 UTC m=+40.698920912" Sep 08 06:35:35.666441 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:35.666401 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:35.666814 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:35.666526 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:35.666814 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:35.666581 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls podName:1c3645c6-0b9b-4b40-b51b-5154985cda53 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:43.66656353 +0000 UTC m=+50.616961352 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls") pod "dns-default-jjwd2" (UID: "1c3645c6-0b9b-4b40-b51b-5154985cda53") : secret "dns-default-metrics-tls" not found Sep 08 06:35:38.206364 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:38.206331 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:38.269938 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:38.269896 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:43.715327 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:43.715292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:43.715776 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:43.715436 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:43.715776 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:43.715495 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls podName:1c3645c6-0b9b-4b40-b51b-5154985cda53 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:59.715477558 +0000 UTC m=+66.665875379 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls") pod "dns-default-jjwd2" (UID: "1c3645c6-0b9b-4b40-b51b-5154985cda53") : secret "dns-default-metrics-tls" not found Sep 08 06:35:46.746969 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.746937 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms"] Sep 08 06:35:46.749128 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.749106 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.752071 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.752049 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 08 06:35:46.753596 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.753568 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 06:35:46.753709 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.753599 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 06:35:46.753709 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.753603 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b28hd\"" Sep 08 06:35:46.755038 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.755015 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 08 06:35:46.766335 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.766311 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms"] Sep 08 06:35:46.835168 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.835138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.835279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.835209 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xppgv\" (UniqueName: \"kubernetes.io/projected/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-kube-api-access-xppgv\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.835279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.835243 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.851338 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.851314 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j"] Sep 08 06:35:46.853332 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.853317 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:46.856110 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.856081 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 08 06:35:46.856110 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.856085 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 08 06:35:46.856771 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.856753 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 08 06:35:46.856872 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.856778 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-t8mjh\"" Sep 08 06:35:46.856984 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.856969 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 08 06:35:46.857038 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.856996 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2"] Sep 08 06:35:46.859050 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.859033 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:46.862993 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.862975 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 08 06:35:46.863070 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.863017 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 08 06:35:46.863070 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.863024 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2x4dj\"" Sep 08 06:35:46.865206 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.865189 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 08 06:35:46.880799 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.880763 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2"] Sep 08 06:35:46.906454 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.906432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j"] Sep 08 06:35:46.936024 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xppgv\" (UniqueName: \"kubernetes.io/projected/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-kube-api-access-xppgv\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.936111 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-serving-cert\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:46.936111 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936056 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-config\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:46.936111 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936071 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:46.936111 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936091 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdnxx\" (UniqueName: \"kubernetes.io/projected/36927311-5eaf-4861-a44f-ce10fcbd0083-kube-api-access-vdnxx\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:46.936251 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.936251 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz6sq\" (UniqueName: \"kubernetes.io/projected/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-kube-api-access-dz6sq\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:46.936319 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.936384 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:46.936368 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:46.936494 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:46.936438 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls podName:bfbcc625-4c68-4958-b8c2-859fdcfb23f4 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:47.436418939 +0000 UTC m=+54.386816760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sd4ms" (UID: "bfbcc625-4c68-4958-b8c2-859fdcfb23f4") : secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:46.936942 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.936925 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.954175 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.954146 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xppgv\" (UniqueName: \"kubernetes.io/projected/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-kube-api-access-xppgv\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:46.965531 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.965512 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-584fbdc7bd-7jcq4"] Sep 08 06:35:46.967497 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.967484 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:46.971177 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.971162 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 06:35:46.971309 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.971293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 06:35:46.971662 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.971649 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 06:35:46.971774 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.971760 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-khbh2\"" Sep 08 06:35:46.980803 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.980782 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 06:35:46.991764 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:46.991742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-584fbdc7bd-7jcq4"] Sep 08 06:35:47.036869 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.036846 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-serving-cert\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:47.036976 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.036871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-config\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:47.036976 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.036888 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:47.036976 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.036904 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdnxx\" (UniqueName: \"kubernetes.io/projected/36927311-5eaf-4861-a44f-ce10fcbd0083-kube-api-access-vdnxx\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:47.036976 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.036938 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz6sq\" (UniqueName: \"kubernetes.io/projected/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-kube-api-access-dz6sq\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:47.037178 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.037046 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 06:35:47.037178 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.037163 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls podName:36927311-5eaf-4861-a44f-ce10fcbd0083 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:47.537142288 +0000 UTC m=+54.487540129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wpgd2" (UID: "36927311-5eaf-4861-a44f-ce10fcbd0083") : secret "samples-operator-tls" not found Sep 08 06:35:47.037396 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.037378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-config\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:47.039130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.039113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-serving-cert\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:47.055081 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.055061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdnxx\" (UniqueName: \"kubernetes.io/projected/36927311-5eaf-4861-a44f-ce10fcbd0083-kube-api-access-vdnxx\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:47.055259 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.055240 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz6sq\" (UniqueName: \"kubernetes.io/projected/3b254dbe-e7b3-49b3-baf5-7f15f2dd9714-kube-api-access-dz6sq\") pod \"service-ca-operator-859f94c4b-hnt6j\" (UID: \"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:47.117255 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.117235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:47.138234 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.138212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmwph\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-kube-api-access-gmwph\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.138300 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.138240 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-trusted-ca\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.138300 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.138278 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.138369 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.138327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-image-registry-private-configuration\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.138369 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.138344 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-registry-certificates\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.138369 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.138359 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-bound-sa-token\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.138459 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.138426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a8d177db-9985-4756-bd88-c0534cb91030-ca-trust-extracted\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.138491 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.138470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-installation-pull-secrets\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.161659 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.161624 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" Sep 08 06:35:47.224823 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.224793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:47.238791 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.238772 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.238889 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.238827 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-image-registry-private-configuration\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.238889 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.238857 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-registry-certificates\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.238889 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.238878 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-bound-sa-token\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.239022 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.238910 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a8d177db-9985-4756-bd88-c0534cb91030-ca-trust-extracted\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.239022 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.238922 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 06:35:47.239022 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.238936 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fbdc7bd-7jcq4: secret "image-registry-tls" not found Sep 08 06:35:47.239022 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.238988 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls podName:a8d177db-9985-4756-bd88-c0534cb91030 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:47.73897116 +0000 UTC m=+54.689368982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls") pod "image-registry-584fbdc7bd-7jcq4" (UID: "a8d177db-9985-4756-bd88-c0534cb91030") : secret "image-registry-tls" not found Sep 08 06:35:47.239201 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.239076 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-installation-pull-secrets\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.239201 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.239148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmwph\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-kube-api-access-gmwph\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.239201 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.239189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-trusted-ca\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.239329 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.239283 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a8d177db-9985-4756-bd88-c0534cb91030-ca-trust-extracted\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.239560 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.239539 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-registry-certificates\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.240069 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.240048 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-trusted-ca\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.241342 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.241315 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-image-registry-private-configuration\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.241462 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.241442 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-installation-pull-secrets\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.250829 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.250806 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-bound-sa-token\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.251183 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.251166 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmwph\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-kube-api-access-gmwph\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.428170 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.428082 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j"] Sep 08 06:35:47.431080 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:35:47.431058 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b254dbe_e7b3_49b3_baf5_7f15f2dd9714.slice/crio-5b5ae89b473f1211711493d7330afd52fbc5196eb5456bbc4493eb5165e5b753 WatchSource:0}: Error finding container 5b5ae89b473f1211711493d7330afd52fbc5196eb5456bbc4493eb5165e5b753: Status 404 returned error can't find the container with id 5b5ae89b473f1211711493d7330afd52fbc5196eb5456bbc4493eb5165e5b753 Sep 08 06:35:47.440842 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.440819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:47.440969 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.440953 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:47.441020 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.441010 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls podName:bfbcc625-4c68-4958-b8c2-859fdcfb23f4 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:48.440995888 +0000 UTC m=+55.391393714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sd4ms" (UID: "bfbcc625-4c68-4958-b8c2-859fdcfb23f4") : secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:47.541159 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.541128 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:47.541367 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.541280 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 06:35:47.541367 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.541343 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls podName:36927311-5eaf-4861-a44f-ce10fcbd0083 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:48.54132747 +0000 UTC m=+55.491725291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wpgd2" (UID: "36927311-5eaf-4861-a44f-ce10fcbd0083") : secret "samples-operator-tls" not found Sep 08 06:35:47.742543 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.742453 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:47.742715 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.742611 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 06:35:47.742715 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.742649 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fbdc7bd-7jcq4: secret "image-registry-tls" not found Sep 08 06:35:47.742715 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:47.742705 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls podName:a8d177db-9985-4756-bd88-c0534cb91030 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:48.742687748 +0000 UTC m=+55.693085569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls") pod "image-registry-584fbdc7bd-7jcq4" (UID: "a8d177db-9985-4756-bd88-c0534cb91030") : secret "image-registry-tls" not found Sep 08 06:35:47.759287 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:47.759260 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" event={"ID":"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714","Type":"ContainerStarted","Data":"5b5ae89b473f1211711493d7330afd52fbc5196eb5456bbc4493eb5165e5b753"} Sep 08 06:35:48.448126 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:48.448090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:48.448308 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:48.448223 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:48.448308 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:48.448281 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls podName:bfbcc625-4c68-4958-b8c2-859fdcfb23f4 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:50.448266177 +0000 UTC m=+57.398664000 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sd4ms" (UID: "bfbcc625-4c68-4958-b8c2-859fdcfb23f4") : secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:48.549465 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:48.549427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:48.549610 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:48.549567 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 06:35:48.549691 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:48.549622 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls podName:36927311-5eaf-4861-a44f-ce10fcbd0083 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:50.549609372 +0000 UTC m=+57.500007193 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wpgd2" (UID: "36927311-5eaf-4861-a44f-ce10fcbd0083") : secret "samples-operator-tls" not found Sep 08 06:35:48.560962 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:48.560935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:48.662874 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:48.662846 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:48.751465 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:48.751384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:48.751658 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:48.751543 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 06:35:48.751658 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:48.751561 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fbdc7bd-7jcq4: secret "image-registry-tls" not found Sep 08 06:35:48.751658 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:48.751641 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls podName:a8d177db-9985-4756-bd88-c0534cb91030 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:50.75160707 +0000 UTC m=+57.702004894 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls") pod "image-registry-584fbdc7bd-7jcq4" (UID: "a8d177db-9985-4756-bd88-c0534cb91030") : secret "image-registry-tls" not found Sep 08 06:35:49.340346 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:49.340308 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:49.441812 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:49.441786 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:49.766603 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:49.766571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" event={"ID":"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714","Type":"ContainerStarted","Data":"632a9de3edbb5fcada5db9ab89dbe310ff37e2f869783c59ad8bd518ac905806"} Sep 08 06:35:49.788542 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:49.788494 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" podStartSLOduration=1.819785406 podStartE2EDuration="3.788475247s" totalImagesPullingTime="1.968689841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:35:49.786530181 +0000 UTC m=+56.736928024" watchObservedRunningTime="2026-09-08 06:35:49.788475247 +0000 UTC m=+56.738873106" Sep 08 06:35:50.464375 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:50.464341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:50.464753 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:50.464451 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:50.464753 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:50.464503 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls podName:bfbcc625-4c68-4958-b8c2-859fdcfb23f4 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:54.464490977 +0000 UTC m=+61.414888797 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sd4ms" (UID: "bfbcc625-4c68-4958-b8c2-859fdcfb23f4") : secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:50.565408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:50.565379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:50.565550 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:50.565502 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 06:35:50.565550 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:50.565549 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls podName:36927311-5eaf-4861-a44f-ce10fcbd0083 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:54.565537653 +0000 UTC m=+61.515935487 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wpgd2" (UID: "36927311-5eaf-4861-a44f-ce10fcbd0083") : secret "samples-operator-tls" not found Sep 08 06:35:50.580590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:50.580567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:50.685461 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:50.685438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:50.767300 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:50.767269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:50.767439 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:50.767410 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 06:35:50.767439 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:50.767426 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fbdc7bd-7jcq4: secret "image-registry-tls" not found Sep 08 06:35:50.767553 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:50.767482 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls podName:a8d177db-9985-4756-bd88-c0534cb91030 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:54.767464376 +0000 UTC m=+61.717862196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls") pod "image-registry-584fbdc7bd-7jcq4" (UID: "a8d177db-9985-4756-bd88-c0534cb91030") : secret "image-registry-tls" not found Sep 08 06:35:50.880543 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:50.880510 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:50.973475 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:50.973451 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:51.301118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.301083 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:51.398812 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.398783 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:51.611296 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.611223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:51.616882 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.616859 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rpmfp"] Sep 08 06:35:51.636467 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.636443 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.642940 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.642925 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 06:35:51.643037 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.643018 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 06:35:51.643101 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.643084 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 06:35:51.643397 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.643381 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 06:35:51.644244 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.644227 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fp5c6\"" Sep 08 06:35:51.654565 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.654536 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rpmfp"] Sep 08 06:35:51.726415 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.726387 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:51.779089 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.779058 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad000d3f-b193-46cc-9748-77789f25be04-crio-socket\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.779197 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.779100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.779197 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.779151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4cqg\" (UniqueName: \"kubernetes.io/projected/ad000d3f-b193-46cc-9748-77789f25be04-kube-api-access-n4cqg\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.779197 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.779190 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.779322 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.779225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad000d3f-b193-46cc-9748-77789f25be04-data-volume\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.880089 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.880023 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad000d3f-b193-46cc-9748-77789f25be04-crio-socket\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.880089 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.880067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.880259 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.880107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4cqg\" (UniqueName: \"kubernetes.io/projected/ad000d3f-b193-46cc-9748-77789f25be04-kube-api-access-n4cqg\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.880259 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.880148 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ad000d3f-b193-46cc-9748-77789f25be04-crio-socket\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.880259 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:51.880166 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:51.880259 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:51.880238 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:52.38022363 +0000 UTC m=+59.330621455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : configmap "kube-rbac-proxy" not found Sep 08 06:35:51.880460 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.880281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.880460 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.880321 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad000d3f-b193-46cc-9748-77789f25be04-data-volume\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.880460 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:51.880406 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:51.880567 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:51.880471 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:52.380454566 +0000 UTC m=+59.330852402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:51.880680 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.880664 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ad000d3f-b193-46cc-9748-77789f25be04-data-volume\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:51.890380 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:51.890358 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4cqg\" (UniqueName: \"kubernetes.io/projected/ad000d3f-b193-46cc-9748-77789f25be04-kube-api-access-n4cqg\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:52.383190 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:52.383153 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:52.383361 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:52.383209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:52.383361 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:52.383274 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:52.383361 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:52.383294 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:52.383361 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:52.383345 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:53.383330097 +0000 UTC m=+60.333727922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : configmap "kube-rbac-proxy" not found Sep 08 06:35:52.383361 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:52.383358 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:53.38335255 +0000 UTC m=+60.333750370 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:52.445612 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:52.445582 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:52.540422 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:52.540391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:52.609954 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:52.609916 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:53.271789 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:53.271756 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:53.346141 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:53.346120 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57bmd_bde28304-d067-452d-8c76-514bdd952e5c/dns-node-resolver/0.log" Sep 08 06:35:53.374523 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:53.374498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:53.391543 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:53.391519 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:53.391664 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:53.391579 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:53.391664 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:53.391624 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:53.391752 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:53.391705 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:55.391691583 +0000 UTC m=+62.342089404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : configmap "kube-rbac-proxy" not found Sep 08 06:35:53.391752 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:53.391727 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:53.391829 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:53.391767 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:55.391756429 +0000 UTC m=+62.342154249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:54.113443 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:54.113406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:54.351100 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:54.351075 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pq5q_cf08eff7-23af-470a-8755-3a6ee691b2ae/node-ca/0.log" Sep 08 06:35:54.498541 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:54.498476 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:35:54.498683 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:54.498576 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:54.498683 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:54.498643 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls podName:bfbcc625-4c68-4958-b8c2-859fdcfb23f4 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:02.498614552 +0000 UTC m=+69.449012372 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sd4ms" (UID: "bfbcc625-4c68-4958-b8c2-859fdcfb23f4") : secret "cluster-monitoring-operator-tls" not found Sep 08 06:35:54.599784 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:54.599752 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:35:54.599943 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:54.599923 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 08 06:35:54.600016 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:54.600004 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls podName:36927311-5eaf-4861-a44f-ce10fcbd0083 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:02.599982738 +0000 UTC m=+69.550380574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-wpgd2" (UID: "36927311-5eaf-4861-a44f-ce10fcbd0083") : secret "samples-operator-tls" not found Sep 08 06:35:54.698923 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:54.698902 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ht5wl" Sep 08 06:35:54.801666 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:54.801625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:35:54.801846 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:54.801829 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 06:35:54.801921 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:54.801850 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-584fbdc7bd-7jcq4: secret "image-registry-tls" not found Sep 08 06:35:54.801921 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:54.801902 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls podName:a8d177db-9985-4756-bd88-c0534cb91030 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:02.801884605 +0000 UTC m=+69.752282443 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls") pod "image-registry-584fbdc7bd-7jcq4" (UID: "a8d177db-9985-4756-bd88-c0534cb91030") : secret "image-registry-tls" not found Sep 08 06:35:55.349852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:55.349822 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6ft7_46c4ec53-1e42-4245-8069-87b30a351ca7/serve-healthcheck-canary/0.log" Sep 08 06:35:55.406702 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:55.406674 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:55.406983 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:55.406734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:55.406983 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:55.406799 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:55.406983 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:55.406860 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:55.406983 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:55.406874 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:59.406856342 +0000 UTC m=+66.357254164 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : configmap "kube-rbac-proxy" not found Sep 08 06:35:55.406983 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:55.406896 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:35:59.406885434 +0000 UTC m=+66.357283255 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:57.759964 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:57.759927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:57.939570 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:57.939536 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:58.161684 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:58.161595 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:58.263459 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:58.263431 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:58.398541 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:58.398508 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:58.491331 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:58.491249 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:58.683429 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:58.683392 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:59.238353 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.238308 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:35:59.242759 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.242743 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 06:35:59.249395 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:59.249377 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 06:35:59.249477 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:59.249448 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs podName:f3926a42-8ed3-4688-81da-3867f79e57d6 nodeName:}" failed. No retries permitted until 2026-09-08 06:37:03.24942591 +0000 UTC m=+130.199823752 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs") pod "network-metrics-daemon-wrk2m" (UID: "f3926a42-8ed3-4688-81da-3867f79e57d6") : secret "metrics-daemon-secret" not found Sep 08 06:35:59.339598 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.339559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:59.339742 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.339617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:59.343959 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.343941 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 06:35:59.343959 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.343955 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 06:35:59.352418 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.352398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/615a0c26-426f-494b-9296-17a9bda45432-original-pull-secret\") pod \"global-pull-secret-syncer-7s9kb\" (UID: \"615a0c26-426f-494b-9296-17a9bda45432\") " pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:59.353960 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.353942 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 06:35:59.363334 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.363312 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-876cx\" (UniqueName: \"kubernetes.io/projected/7351d60e-d131-459f-b79f-91c9d5c161de-kube-api-access-876cx\") pod \"network-check-target-cqhzt\" (UID: \"7351d60e-d131-459f-b79f-91c9d5c161de\") " pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:59.440604 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.440566 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7s9kb" Sep 08 06:35:59.440837 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.440748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:59.440837 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.440806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:35:59.440947 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:59.440873 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 06:35:59.440985 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:59.440968 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:07.440945668 +0000 UTC m=+74.391343504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : configmap "kube-rbac-proxy" not found Sep 08 06:35:59.440985 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:59.440975 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:35:59.441071 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:59.441022 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:07.441010301 +0000 UTC m=+74.391408124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : secret "insights-runtime-extractor-tls" not found Sep 08 06:35:59.450489 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.450471 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jhmvb\"" Sep 08 06:35:59.458562 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.458541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:35:59.497496 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.497391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:35:59.718247 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.718219 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7s9kb"] Sep 08 06:35:59.721296 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:35:59.721270 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615a0c26_426f_494b_9296_17a9bda45432.slice/crio-5e9a4445e474c19908b072435c91194594f143dff10f2bee81fe9ea501c945a5 WatchSource:0}: Error finding container 5e9a4445e474c19908b072435c91194594f143dff10f2bee81fe9ea501c945a5: Status 404 returned error can't find the container with id 5e9a4445e474c19908b072435c91194594f143dff10f2bee81fe9ea501c945a5 Sep 08 06:35:59.744162 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.744104 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:35:59.744249 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:59.744233 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 06:35:59.744296 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:35:59.744277 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls podName:1c3645c6-0b9b-4b40-b51b-5154985cda53 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:31.744263755 +0000 UTC m=+98.694661576 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls") pod "dns-default-jjwd2" (UID: "1c3645c6-0b9b-4b40-b51b-5154985cda53") : secret "dns-default-metrics-tls" not found Sep 08 06:35:59.754446 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.754426 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cqhzt"] Sep 08 06:35:59.757401 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:35:59.757381 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7351d60e_d131_459f_b79f_91c9d5c161de.slice/crio-baa8e153013d114742b97b29e625fe598067e2c6b2813aa905457e3c6e4106b8 WatchSource:0}: Error finding container baa8e153013d114742b97b29e625fe598067e2c6b2813aa905457e3c6e4106b8: Status 404 returned error can't find the container with id baa8e153013d114742b97b29e625fe598067e2c6b2813aa905457e3c6e4106b8 Sep 08 06:35:59.790497 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.790472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7s9kb" event={"ID":"615a0c26-426f-494b-9296-17a9bda45432","Type":"ContainerStarted","Data":"5e9a4445e474c19908b072435c91194594f143dff10f2bee81fe9ea501c945a5"} Sep 08 06:35:59.791603 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:35:59.791582 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cqhzt" event={"ID":"7351d60e-d131-459f-b79f-91c9d5c161de","Type":"ContainerStarted","Data":"baa8e153013d114742b97b29e625fe598067e2c6b2813aa905457e3c6e4106b8"} Sep 08 06:36:00.158804 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:00.158771 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:00.415870 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:00.415781 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:00.618582 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:00.618541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:00.883739 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:00.883697 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:01.461664 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:01.461606 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:01.661586 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:01.661552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:01.766704 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:01.766667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:01.966348 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:01.966286 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:02.301560 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.301525 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:02.491929 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.491877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:02.571712 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.571612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:36:02.571886 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:36:02.571769 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 08 06:36:02.571886 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:36:02.571849 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls podName:bfbcc625-4c68-4958-b8c2-859fdcfb23f4 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:18.571829932 +0000 UTC m=+85.522227756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-sd4ms" (UID: "bfbcc625-4c68-4958-b8c2-859fdcfb23f4") : secret "cluster-monitoring-operator-tls" not found Sep 08 06:36:02.659618 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.659564 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:02.673016 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.672985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:36:02.675692 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.675667 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/36927311-5eaf-4861-a44f-ce10fcbd0083-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-wpgd2\" (UID: \"36927311-5eaf-4861-a44f-ce10fcbd0083\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:36:02.772794 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.772751 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-2x4dj\"" Sep 08 06:36:02.778874 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.778842 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" Sep 08 06:36:02.874593 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.874509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:36:02.877185 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.877163 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"image-registry-584fbdc7bd-7jcq4\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:36:02.897348 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:02.897319 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:03.179130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:03.179057 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-khbh2\"" Sep 08 06:36:03.187186 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:03.187163 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:36:03.258989 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:03.258936 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:03.711014 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:03.710975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:04.031415 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.031384 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:04.189297 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.189268 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:04.437204 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.437177 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:04.807928 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.807896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7s9kb" event={"ID":"615a0c26-426f-494b-9296-17a9bda45432","Type":"ContainerStarted","Data":"ec6c8d47438db7197ff30677b5693c9aaf2db29e21504d117e823e3ecc5b40c3"} Sep 08 06:36:04.809597 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.809570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cqhzt" event={"ID":"7351d60e-d131-459f-b79f-91c9d5c161de","Type":"ContainerStarted","Data":"802add9b79702b6e810f14504b8213fbb10cd480341bc884f9d0f1b1081d8b7e"} Sep 08 06:36:04.809754 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.809647 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:36:04.876579 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.876536 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7s9kb" podStartSLOduration=66.984123456 podStartE2EDuration="1m11.876520471s" totalImagesPullingTime="4.892397015s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:04.840683537 +0000 UTC m=+71.791081380" watchObservedRunningTime="2026-09-08 06:36:04.876520471 +0000 UTC m=+71.826918308" Sep 08 06:36:04.876774 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.876753 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cqhzt" podStartSLOduration=67.032892718 podStartE2EDuration="1m11.876747526s" totalImagesPullingTime="4.843854808s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:04.876037497 +0000 UTC m=+71.826435341" watchObservedRunningTime="2026-09-08 06:36:04.876747526 +0000 UTC m=+71.827145369" Sep 08 06:36:04.910824 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.910796 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-584fbdc7bd-7jcq4"] Sep 08 06:36:04.911594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.911566 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2"] Sep 08 06:36:04.912001 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:04.911972 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d177db_9985_4756_bd88_c0534cb91030.slice/crio-7a4ac9f6647ec345688973c54dd1121e2a3f9c729370680fd0ca3b7a4619ce95 WatchSource:0}: Error finding container 7a4ac9f6647ec345688973c54dd1121e2a3f9c729370680fd0ca3b7a4619ce95: Status 404 returned error can't find the container with id 7a4ac9f6647ec345688973c54dd1121e2a3f9c729370680fd0ca3b7a4619ce95 Sep 08 06:36:04.931805 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:04.931778 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:05.139443 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:05.139406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:05.303284 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:05.303251 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:05.666435 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:05.666348 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:05.814806 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:05.814772 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" event={"ID":"36927311-5eaf-4861-a44f-ce10fcbd0083","Type":"ContainerStarted","Data":"be4c7f6f00e3cd5757868e9723d240977dcd7aacaf9ab865422bef193fd45b71"} Sep 08 06:36:05.816637 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:05.816605 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" event={"ID":"a8d177db-9985-4756-bd88-c0534cb91030","Type":"ContainerStarted","Data":"fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8"} Sep 08 06:36:05.816798 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:05.816672 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" event={"ID":"a8d177db-9985-4756-bd88-c0534cb91030","Type":"ContainerStarted","Data":"7a4ac9f6647ec345688973c54dd1121e2a3f9c729370680fd0ca3b7a4619ce95"} Sep 08 06:36:05.816975 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:05.816958 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:36:06.649602 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:06.649571 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:06.737243 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:06.737202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:06.953250 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:06.953216 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:07.099810 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.099772 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:07.284904 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.284872 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:07.494373 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.494340 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:07.513074 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.513053 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:36:07.513158 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.513101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:36:07.513210 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:36:07.513198 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 06:36:07.513255 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:36:07.513246 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls podName:ad000d3f-b193-46cc-9748-77789f25be04 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:23.513233373 +0000 UTC m=+90.463631194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpmfp" (UID: "ad000d3f-b193-46cc-9748-77789f25be04") : secret "insights-runtime-extractor-tls" not found Sep 08 06:36:07.513536 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.513520 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ad000d3f-b193-46cc-9748-77789f25be04-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:36:07.824954 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.824917 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" event={"ID":"36927311-5eaf-4861-a44f-ce10fcbd0083","Type":"ContainerStarted","Data":"6aaf67a8103e084b0fc553fdea3b3a727e8da8602de3dde9b09fe0c2f9e15808"} Sep 08 06:36:07.825159 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.824976 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" event={"ID":"36927311-5eaf-4861-a44f-ce10fcbd0083","Type":"ContainerStarted","Data":"f5ea99602de752ce82ed450bd3711cbd6ff9f8c6b50088aabfcd625031ce0728"} Sep 08 06:36:07.848681 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:07.848615 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" podStartSLOduration=21.848600508 podStartE2EDuration="21.848600508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:05.868161992 +0000 UTC m=+72.818559836" watchObservedRunningTime="2026-09-08 06:36:07.848600508 +0000 UTC m=+74.798998350" Sep 08 06:36:08.253924 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:08.253832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:08.469785 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:08.469753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:08.653528 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:08.653491 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:10.902398 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:10.902370 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:11.003998 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:11.003972 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:11.079739 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:11.079704 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:11.193283 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:11.193198 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:11.397029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:11.396997 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:11.639322 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:11.639285 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:11.758213 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:11.758180 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:12.216870 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:12.216836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:12.311996 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:12.311964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:12.582480 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:12.582450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:12.780007 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:12.779979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:12.905822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:12.905742 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:15.930714 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.930547 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-wpgd2" podStartSLOduration=27.970588077 podStartE2EDuration="29.930532283s" totalImagesPullingTime="1.959944206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:07.848754597 +0000 UTC m=+74.799152427" watchObservedRunningTime="2026-09-08 06:36:15.930532283 +0000 UTC m=+82.880930125" Sep 08 06:36:15.931220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.930959 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584fbdc7bd-7jcq4"] Sep 08 06:36:15.939106 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.939079 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5"] Sep 08 06:36:15.941905 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.941882 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" Sep 08 06:36:15.948690 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.948616 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 08 06:36:15.948812 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.948733 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 08 06:36:15.948812 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.948788 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 08 06:36:15.949085 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.948882 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-hk6j9\"" Sep 08 06:36:15.949894 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.949878 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 08 06:36:15.962901 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.962883 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9"] Sep 08 06:36:15.964841 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.964825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:15.971696 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.971678 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 08 06:36:15.972377 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.972359 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5"] Sep 08 06:36:15.976456 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.976438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t7g5\" (UniqueName: \"kubernetes.io/projected/ef246893-7d04-43b7-9137-04cbd04f7801-kube-api-access-6t7g5\") pod \"managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5\" (UID: \"ef246893-7d04-43b7-9137-04cbd04f7801\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" Sep 08 06:36:15.976534 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.976470 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef246893-7d04-43b7-9137-04cbd04f7801-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5\" (UID: \"ef246893-7d04-43b7-9137-04cbd04f7801\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" Sep 08 06:36:15.985341 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:15.985320 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9"] Sep 08 06:36:16.077659 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.077603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t7g5\" (UniqueName: \"kubernetes.io/projected/ef246893-7d04-43b7-9137-04cbd04f7801-kube-api-access-6t7g5\") pod \"managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5\" (UID: \"ef246893-7d04-43b7-9137-04cbd04f7801\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" Sep 08 06:36:16.077659 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.077666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef246893-7d04-43b7-9137-04cbd04f7801-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5\" (UID: \"ef246893-7d04-43b7-9137-04cbd04f7801\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" Sep 08 06:36:16.077918 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.077689 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-tmp\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.077918 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.077764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-klusterlet-config\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.077918 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.077786 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgvkk\" (UniqueName: \"kubernetes.io/projected/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-kube-api-access-sgvkk\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.080428 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.080403 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ef246893-7d04-43b7-9137-04cbd04f7801-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5\" (UID: \"ef246893-7d04-43b7-9137-04cbd04f7801\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" Sep 08 06:36:16.101489 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.101458 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t7g5\" (UniqueName: \"kubernetes.io/projected/ef246893-7d04-43b7-9137-04cbd04f7801-kube-api-access-6t7g5\") pod \"managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5\" (UID: \"ef246893-7d04-43b7-9137-04cbd04f7801\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" Sep 08 06:36:16.141863 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.141835 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:16.179061 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.179034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-tmp\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.179177 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.179096 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-klusterlet-config\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.179177 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.179115 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgvkk\" (UniqueName: \"kubernetes.io/projected/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-kube-api-access-sgvkk\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.179504 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.179478 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-tmp\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.181650 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.181580 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-klusterlet-config\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.209720 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.209691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgvkk\" (UniqueName: \"kubernetes.io/projected/72e9d7d1-62f6-4305-99c3-a22fbee9aa06-kube-api-access-sgvkk\") pod \"klusterlet-addon-workmgr-6db5579df6-nc8v9\" (UID: \"72e9d7d1-62f6-4305-99c3-a22fbee9aa06\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.245831 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.245806 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:16.264826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.264806 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" Sep 08 06:36:16.273029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.273013 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:16.548008 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.547981 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5"] Sep 08 06:36:16.552078 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:16.552055 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef246893_7d04_43b7_9137_04cbd04f7801.slice/crio-caa81b8f9f073f47b49ce0d4c17058e6b37ff8ca08e2cdb90985b58cf8548d18 WatchSource:0}: Error finding container caa81b8f9f073f47b49ce0d4c17058e6b37ff8ca08e2cdb90985b58cf8548d18: Status 404 returned error can't find the container with id caa81b8f9f073f47b49ce0d4c17058e6b37ff8ca08e2cdb90985b58cf8548d18 Sep 08 06:36:16.571246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.571222 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9"] Sep 08 06:36:16.573839 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:16.573817 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e9d7d1_62f6_4305_99c3_a22fbee9aa06.slice/crio-7f189f2e92f28be06b1c87e0815c0e2117d320593a8f6d388719f9c60f3dc097 WatchSource:0}: Error finding container 7f189f2e92f28be06b1c87e0815c0e2117d320593a8f6d388719f9c60f3dc097: Status 404 returned error can't find the container with id 7f189f2e92f28be06b1c87e0815c0e2117d320593a8f6d388719f9c60f3dc097 Sep 08 06:36:16.853379 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.853286 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" event={"ID":"72e9d7d1-62f6-4305-99c3-a22fbee9aa06","Type":"ContainerStarted","Data":"7f189f2e92f28be06b1c87e0815c0e2117d320593a8f6d388719f9c60f3dc097"} Sep 08 06:36:16.854429 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:16.854404 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" event={"ID":"ef246893-7d04-43b7-9137-04cbd04f7801","Type":"ContainerStarted","Data":"caa81b8f9f073f47b49ce0d4c17058e6b37ff8ca08e2cdb90985b58cf8548d18"} Sep 08 06:36:17.533713 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:17.533623 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:17.607388 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:17.607348 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:18.598525 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:18.598484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:36:18.601728 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:18.601678 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/bfbcc625-4c68-4958-b8c2-859fdcfb23f4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-sd4ms\" (UID: \"bfbcc625-4c68-4958-b8c2-859fdcfb23f4\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:36:18.668466 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:18.668389 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:18.762108 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:18.762079 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:18.860766 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:18.860690 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b28hd\"" Sep 08 06:36:18.868499 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:18.868477 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" Sep 08 06:36:19.185693 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:19.185604 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms"] Sep 08 06:36:20.300028 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:20.299992 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbcc625_4c68_4958_b8c2_859fdcfb23f4.slice/crio-e4627a4cb29cccd1506aa9bab4331167dc2cfaa6a48ab82396620d77fe25345a WatchSource:0}: Error finding container e4627a4cb29cccd1506aa9bab4331167dc2cfaa6a48ab82396620d77fe25345a: Status 404 returned error can't find the container with id e4627a4cb29cccd1506aa9bab4331167dc2cfaa6a48ab82396620d77fe25345a Sep 08 06:36:20.871902 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:20.870812 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" event={"ID":"bfbcc625-4c68-4958-b8c2-859fdcfb23f4","Type":"ContainerStarted","Data":"e4627a4cb29cccd1506aa9bab4331167dc2cfaa6a48ab82396620d77fe25345a"} Sep 08 06:36:21.876261 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:21.876215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" event={"ID":"ef246893-7d04-43b7-9137-04cbd04f7801","Type":"ContainerStarted","Data":"7369ae97ce9676ee59d683888310193e9ef8d9f55b879d316de0b69d875ab0d3"} Sep 08 06:36:21.878539 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:21.878505 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" event={"ID":"72e9d7d1-62f6-4305-99c3-a22fbee9aa06","Type":"ContainerStarted","Data":"03550896bb3e48933f478a8db72cb84e0dac05aebf8ff3e3be068ef1f6d85b8e"} Sep 08 06:36:21.878809 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:21.878790 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:21.880607 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:21.880586 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" Sep 08 06:36:21.900835 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:21.900788 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5f6cbcb964-9bqt5" podStartSLOduration=2.06296051 podStartE2EDuration="6.900770809s" totalImagesPullingTime="4.837810299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:21.898577103 +0000 UTC m=+88.848974953" watchObservedRunningTime="2026-09-08 06:36:21.900770809 +0000 UTC m=+88.851168651" Sep 08 06:36:21.926182 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:21.926125 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6db5579df6-nc8v9" podStartSLOduration=2.12033964 podStartE2EDuration="6.926112607s" totalImagesPullingTime="4.805772967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:21.925841048 +0000 UTC m=+88.876238940" watchObservedRunningTime="2026-09-08 06:36:21.926112607 +0000 UTC m=+88.876510449" Sep 08 06:36:22.688875 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.688794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:22.823497 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.823469 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:22.873623 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.873594 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r"] Sep 08 06:36:22.886944 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.886916 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" event={"ID":"bfbcc625-4c68-4958-b8c2-859fdcfb23f4","Type":"ContainerStarted","Data":"ce731bc747165239a72644e5e98da627cd810e3016295bc4a1c7cb31825dcf81"} Sep 08 06:36:22.887390 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.887022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" Sep 08 06:36:22.889524 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.889499 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r"] Sep 08 06:36:22.890118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.890097 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jwbkl\"" Sep 08 06:36:22.890118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.890106 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 08 06:36:22.902888 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.902849 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-sd4ms" podStartSLOduration=34.901381147 podStartE2EDuration="36.90283547s" totalImagesPullingTime="2.001454323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:22.90173577 +0000 UTC m=+89.852133614" watchObservedRunningTime="2026-09-08 06:36:22.90283547 +0000 UTC m=+89.853233313" Sep 08 06:36:22.957601 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:22.957533 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:23.037925 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.037892 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c891d28c-a8b0-4edb-a424-2f22e5bd9877-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-9xh5r\" (UID: \"c891d28c-a8b0-4edb-a424-2f22e5bd9877\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" Sep 08 06:36:23.056758 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.056731 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:23.138557 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.138531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c891d28c-a8b0-4edb-a424-2f22e5bd9877-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-9xh5r\" (UID: \"c891d28c-a8b0-4edb-a424-2f22e5bd9877\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" Sep 08 06:36:23.141009 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.140991 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c891d28c-a8b0-4edb-a424-2f22e5bd9877-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-9xh5r\" (UID: \"c891d28c-a8b0-4edb-a424-2f22e5bd9877\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" Sep 08 06:36:23.195918 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.195893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" Sep 08 06:36:23.448350 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.448322 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:23.478228 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.478202 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r"] Sep 08 06:36:23.480012 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:23.479984 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc891d28c_a8b0_4edb_a424_2f22e5bd9877.slice/crio-24d9560249e5b4134036c64654a3968db17ab7597c4802de14858b28ce5f2a47 WatchSource:0}: Error finding container 24d9560249e5b4134036c64654a3968db17ab7597c4802de14858b28ce5f2a47: Status 404 returned error can't find the container with id 24d9560249e5b4134036c64654a3968db17ab7597c4802de14858b28ce5f2a47 Sep 08 06:36:23.542122 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.542090 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:36:23.544410 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.544393 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ad000d3f-b193-46cc-9748-77789f25be04-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpmfp\" (UID: \"ad000d3f-b193-46cc-9748-77789f25be04\") " pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:36:23.550913 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.550895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:23.747359 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.747324 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fp5c6\"" Sep 08 06:36:23.755046 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.755008 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rpmfp" Sep 08 06:36:23.887025 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:23.886989 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" event={"ID":"c891d28c-a8b0-4edb-a424-2f22e5bd9877","Type":"ContainerStarted","Data":"24d9560249e5b4134036c64654a3968db17ab7597c4802de14858b28ce5f2a47"} Sep 08 06:36:24.030727 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:24.030677 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rpmfp"] Sep 08 06:36:24.048140 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:24.048114 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad000d3f_b193_46cc_9748_77789f25be04.slice/crio-79126d180e96a5de1844505c41f210773711084523ec1afe65f2d9ee9fd6cc3f WatchSource:0}: Error finding container 79126d180e96a5de1844505c41f210773711084523ec1afe65f2d9ee9fd6cc3f: Status 404 returned error can't find the container with id 79126d180e96a5de1844505c41f210773711084523ec1afe65f2d9ee9fd6cc3f Sep 08 06:36:24.892166 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:24.892123 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" event={"ID":"c891d28c-a8b0-4edb-a424-2f22e5bd9877","Type":"ContainerStarted","Data":"d0679c97b2c989c6a7450d1e1457429b05ff66bbfb4ddb0a07932ead077808bf"} Sep 08 06:36:24.892659 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:24.892191 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" Sep 08 06:36:24.894204 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:24.894175 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpmfp" event={"ID":"ad000d3f-b193-46cc-9748-77789f25be04","Type":"ContainerStarted","Data":"0bc2ed1aaf5e8932cd54202d0d0aa18d65897b8ce261e0d917a7a4ced1e5c84b"} Sep 08 06:36:24.894303 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:24.894231 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpmfp" event={"ID":"ad000d3f-b193-46cc-9748-77789f25be04","Type":"ContainerStarted","Data":"7aec072fb5c65121e782d57f30c5c9cb2f1d90262633081a2b25493258c59692"} Sep 08 06:36:24.894303 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:24.894250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpmfp" event={"ID":"ad000d3f-b193-46cc-9748-77789f25be04","Type":"ContainerStarted","Data":"79126d180e96a5de1844505c41f210773711084523ec1afe65f2d9ee9fd6cc3f"} Sep 08 06:36:24.897258 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:24.897240 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" Sep 08 06:36:24.928469 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:24.928419 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-9xh5r" podStartSLOduration=1.946163679 podStartE2EDuration="2.928403884s" totalImagesPullingTime="982.240205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:24.910587301 +0000 UTC m=+91.860985143" watchObservedRunningTime="2026-09-08 06:36:24.928403884 +0000 UTC m=+91.878801726" Sep 08 06:36:25.609477 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.609438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:25.908529 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.908450 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:25.937655 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.937584 2581 patch_prober.go:28] interesting pod/image-registry-584fbdc7bd-7jcq4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 08 06:36:25.937832 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.937662 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" podUID="a8d177db-9985-4756-bd88-c0534cb91030" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 08 06:36:25.962977 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.962939 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-zm8lq"] Sep 08 06:36:25.965998 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.965963 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:25.973266 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.973230 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 06:36:25.973266 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.973230 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n6zl9\"" Sep 08 06:36:25.974744 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.974724 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 08 06:36:25.974837 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.974789 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 08 06:36:25.978937 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.978910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-zm8lq"] Sep 08 06:36:25.998830 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:25.998800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:26.060969 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.060937 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:26.067037 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.067017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef895a8a-7517-4ae0-9f69-43c9d6d04638-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.067099 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.067053 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mjd2\" (UniqueName: \"kubernetes.io/projected/ef895a8a-7517-4ae0-9f69-43c9d6d04638-kube-api-access-2mjd2\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.067192 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.067167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef895a8a-7517-4ae0-9f69-43c9d6d04638-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.067250 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.067229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef895a8a-7517-4ae0-9f69-43c9d6d04638-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.168091 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.168040 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef895a8a-7517-4ae0-9f69-43c9d6d04638-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.168091 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.168078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef895a8a-7517-4ae0-9f69-43c9d6d04638-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.168241 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.168109 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef895a8a-7517-4ae0-9f69-43c9d6d04638-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.168241 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.168137 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mjd2\" (UniqueName: \"kubernetes.io/projected/ef895a8a-7517-4ae0-9f69-43c9d6d04638-kube-api-access-2mjd2\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.168738 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.168720 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef895a8a-7517-4ae0-9f69-43c9d6d04638-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.170369 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.170350 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ef895a8a-7517-4ae0-9f69-43c9d6d04638-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.170450 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.170432 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef895a8a-7517-4ae0-9f69-43c9d6d04638-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.178039 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.178018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mjd2\" (UniqueName: \"kubernetes.io/projected/ef895a8a-7517-4ae0-9f69-43c9d6d04638-kube-api-access-2mjd2\") pod \"prometheus-operator-6f4946db56-zm8lq\" (UID: \"ef895a8a-7517-4ae0-9f69-43c9d6d04638\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.276564 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.276545 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" Sep 08 06:36:26.548198 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.548168 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-zm8lq"] Sep 08 06:36:26.551245 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:26.551204 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef895a8a_7517_4ae0_9f69_43c9d6d04638.slice/crio-64397fe82c415f067d583ea697fe7f99066a3b2bc1509b63d248b84205e9bd25 WatchSource:0}: Error finding container 64397fe82c415f067d583ea697fe7f99066a3b2bc1509b63d248b84205e9bd25: Status 404 returned error can't find the container with id 64397fe82c415f067d583ea697fe7f99066a3b2bc1509b63d248b84205e9bd25 Sep 08 06:36:26.903047 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.902954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" event={"ID":"ef895a8a-7517-4ae0-9f69-43c9d6d04638","Type":"ContainerStarted","Data":"64397fe82c415f067d583ea697fe7f99066a3b2bc1509b63d248b84205e9bd25"} Sep 08 06:36:26.905001 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.904977 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpmfp" event={"ID":"ad000d3f-b193-46cc-9748-77789f25be04","Type":"ContainerStarted","Data":"c0cf05db7ee6ea6007b36507f6a7cb38ef244071d8aff88fcc681686a9d121c7"} Sep 08 06:36:26.927459 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:26.927381 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rpmfp" podStartSLOduration=34.016686618 podStartE2EDuration="35.927365231s" totalImagesPullingTime="1.910678613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 06:35:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:26.925679451 +0000 UTC m=+93.876077294" watchObservedRunningTime="2026-09-08 06:36:26.927365231 +0000 UTC m=+93.877763073" Sep 08 06:36:27.620506 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:27.620463 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:27.703264 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:27.703225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:28.180023 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:28.179941 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:28.914263 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:28.914229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" event={"ID":"ef895a8a-7517-4ae0-9f69-43c9d6d04638","Type":"ContainerStarted","Data":"25c31efb04097a1f299f2daf21c2cc9c3de265ed65bd9da92de8f1b5239fe7f3"} Sep 08 06:36:28.914477 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:28.914280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" event={"ID":"ef895a8a-7517-4ae0-9f69-43c9d6d04638","Type":"ContainerStarted","Data":"b09f3897c679ab539465ba81aeac2bfdcb4ca7a83996d580b426419753dbfd5e"} Sep 08 06:36:29.807902 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:29.807869 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:29.865077 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:29.865045 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:30.400064 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:30.400030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:30.462190 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:30.462156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:30.722669 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:30.722570 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:31.044778 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.044749 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:31.312305 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.312223 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:31.420623 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.420573 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-zm8lq" podStartSLOduration=5.051985708 podStartE2EDuration="6.420554398s" totalImagesPullingTime="1.36856869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:28.940011187 +0000 UTC m=+95.890409029" watchObservedRunningTime="2026-09-08 06:36:31.420554398 +0000 UTC m=+98.370952243" Sep 08 06:36:31.421221 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.421204 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-flfvk"] Sep 08 06:36:31.423909 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.423890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.426882 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.426862 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 06:36:31.427144 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.427129 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 06:36:31.427224 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.427175 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 06:36:31.431385 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.428096 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6jbsv\"" Sep 08 06:36:31.457079 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.457046 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:31.512750 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.512712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-sys\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.512938 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.512760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-root\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.512938 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.512791 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-tls\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.512938 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.512817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-wtmp\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.512938 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.512906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7dn6\" (UniqueName: \"kubernetes.io/projected/b98fb29e-7831-4a23-be51-3ef86226dbfe-kube-api-access-x7dn6\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.513112 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.512951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98fb29e-7831-4a23-be51-3ef86226dbfe-metrics-client-ca\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.513112 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.512988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-textfile\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.513112 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.513007 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.513112 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.513045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.556333 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.556298 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:31.614477 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614383 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-root\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614477 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-tls\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614477 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614443 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-wtmp\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614477 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7dn6\" (UniqueName: \"kubernetes.io/projected/b98fb29e-7831-4a23-be51-3ef86226dbfe-kube-api-access-x7dn6\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614800 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98fb29e-7831-4a23-be51-3ef86226dbfe-metrics-client-ca\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614800 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-root\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614800 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-textfile\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614800 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614674 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-wtmp\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614800 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614695 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.614800 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.615029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-sys\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.615029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b98fb29e-7831-4a23-be51-3ef86226dbfe-sys\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.615029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.614919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-textfile\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.615179 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.615161 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b98fb29e-7831-4a23-be51-3ef86226dbfe-metrics-client-ca\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.615330 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.615310 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-accelerators-collector-config\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.617028 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.617003 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-tls\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.617115 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.617010 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b98fb29e-7831-4a23-be51-3ef86226dbfe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.624765 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.624737 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7dn6\" (UniqueName: \"kubernetes.io/projected/b98fb29e-7831-4a23-be51-3ef86226dbfe-kube-api-access-x7dn6\") pod \"node-exporter-flfvk\" (UID: \"b98fb29e-7831-4a23-be51-3ef86226dbfe\") " pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.659813 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.659776 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:31.736944 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.736911 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-flfvk" Sep 08 06:36:31.747946 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:31.747896 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb98fb29e_7831_4a23_be51_3ef86226dbfe.slice/crio-c3f15c8f2835f2fb72dad7fb7c2cb93f9170f5376e12b2249fedbcad6eac79f1 WatchSource:0}: Error finding container c3f15c8f2835f2fb72dad7fb7c2cb93f9170f5376e12b2249fedbcad6eac79f1: Status 404 returned error can't find the container with id c3f15c8f2835f2fb72dad7fb7c2cb93f9170f5376e12b2249fedbcad6eac79f1 Sep 08 06:36:31.762927 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.762895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:31.817133 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.817102 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:36:31.819589 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.819566 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1c3645c6-0b9b-4b40-b51b-5154985cda53-metrics-tls\") pod \"dns-default-jjwd2\" (UID: \"1c3645c6-0b9b-4b40-b51b-5154985cda53\") " pod="openshift-dns/dns-default-jjwd2" Sep 08 06:36:31.925834 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:31.925753 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-flfvk" event={"ID":"b98fb29e-7831-4a23-be51-3ef86226dbfe","Type":"ContainerStarted","Data":"c3f15c8f2835f2fb72dad7fb7c2cb93f9170f5376e12b2249fedbcad6eac79f1"} Sep 08 06:36:32.084050 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:32.084019 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4jz89\"" Sep 08 06:36:32.092307 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:32.092285 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jjwd2" Sep 08 06:36:32.101123 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:32.101095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:32.342746 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:32.342703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:32.386409 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:32.386373 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jjwd2"] Sep 08 06:36:32.389274 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:32.389244 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3645c6_0b9b_4b40_b51b_5154985cda53.slice/crio-099519913d46d8b8420f0cb6e3cc2d47009162c7650b9631177e85f6e5e03a09 WatchSource:0}: Error finding container 099519913d46d8b8420f0cb6e3cc2d47009162c7650b9631177e85f6e5e03a09: Status 404 returned error can't find the container with id 099519913d46d8b8420f0cb6e3cc2d47009162c7650b9631177e85f6e5e03a09 Sep 08 06:36:32.498982 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:32.498899 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:32.631912 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:32.631875 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:32.929719 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:32.929682 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jjwd2" event={"ID":"1c3645c6-0b9b-4b40-b51b-5154985cda53","Type":"ContainerStarted","Data":"099519913d46d8b8420f0cb6e3cc2d47009162c7650b9631177e85f6e5e03a09"} Sep 08 06:36:34.035702 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.035666 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:34.134898 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.134857 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:34.341313 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.341232 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:34.474531 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.474502 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-665b7d545b-6x54w"] Sep 08 06:36:34.489998 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.489969 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.494118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.494090 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 08 06:36:34.497166 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.497141 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 08 06:36:34.497419 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.497397 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 08 06:36:34.497531 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.497433 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 08 06:36:34.497531 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.497435 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 08 06:36:34.497670 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.497509 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2ojf0th2jd3e6\"" Sep 08 06:36:34.497941 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.497897 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hznzm\"" Sep 08 06:36:34.511809 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.511782 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-665b7d545b-6x54w"] Sep 08 06:36:34.512130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.512100 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:34.641890 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.641813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-tls\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.641890 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.641854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.641890 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.641876 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rdmz\" (UniqueName: \"kubernetes.io/projected/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-kube-api-access-5rdmz\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.642118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.641897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.642118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.641980 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-metrics-client-ca\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.642118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.642008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.642118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.642041 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.642118 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.642073 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-grpc-tls\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.742698 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.742663 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.742698 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.742704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-metrics-client-ca\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.742928 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.742729 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.742928 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.742765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.742928 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.742797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-grpc-tls\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.742928 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.742819 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-tls\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.742928 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.742890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.743177 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.742937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rdmz\" (UniqueName: \"kubernetes.io/projected/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-kube-api-access-5rdmz\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.743541 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.743454 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-metrics-client-ca\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.744040 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.743954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:34.745757 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.745722 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.746129 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.746103 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.746263 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.746241 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.746366 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.746347 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-tls\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.746422 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.746351 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.746422 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.746412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-secret-grpc-tls\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.753071 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.753046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rdmz\" (UniqueName: \"kubernetes.io/projected/b5fff704-505b-4f6f-8ab1-5f0f86b62e80-kube-api-access-5rdmz\") pod \"thanos-querier-665b7d545b-6x54w\" (UID: \"b5fff704-505b-4f6f-8ab1-5f0f86b62e80\") " pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:34.803379 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:34.802085 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:35.337682 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.337614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-665b7d545b-6x54w"] Sep 08 06:36:35.357590 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:35.357562 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5fff704_505b_4f6f_8ab1_5f0f86b62e80.slice/crio-fa6fad6313ab988c3c78e5e777ce64af6fccd7fa588d11d56f74c424f94ad531 WatchSource:0}: Error finding container fa6fad6313ab988c3c78e5e777ce64af6fccd7fa588d11d56f74c424f94ad531: Status 404 returned error can't find the container with id fa6fad6313ab988c3c78e5e777ce64af6fccd7fa588d11d56f74c424f94ad531 Sep 08 06:36:35.597292 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.597209 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:35.695608 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.695572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:35.819732 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.819700 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cqhzt" Sep 08 06:36:35.935521 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.935456 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:36:35.941965 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.941940 2581 generic.go:356] "Generic (PLEG): container finished" podID="b98fb29e-7831-4a23-be51-3ef86226dbfe" containerID="51faa557497152f5c54a0b71a5513d4a2f4725fc30cef7035b02a7c89cc21ddd" exitCode=0 Sep 08 06:36:35.942084 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.941995 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-flfvk" event={"ID":"b98fb29e-7831-4a23-be51-3ef86226dbfe","Type":"ContainerDied","Data":"51faa557497152f5c54a0b71a5513d4a2f4725fc30cef7035b02a7c89cc21ddd"} Sep 08 06:36:35.944122 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.944102 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jjwd2" event={"ID":"1c3645c6-0b9b-4b40-b51b-5154985cda53","Type":"ContainerStarted","Data":"59d4ece6dc830662d0ad553cb0b391117c8d41602aa1c4a2c047eb6117d70468"} Sep 08 06:36:35.944237 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.944145 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jjwd2" event={"ID":"1c3645c6-0b9b-4b40-b51b-5154985cda53","Type":"ContainerStarted","Data":"a39a0d94b4cf80d175f1b0ae35263dd2e2487fd5dd9a6484330e77645a7f7c4c"} Sep 08 06:36:35.944300 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.944256 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jjwd2" Sep 08 06:36:35.945386 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.945368 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" event={"ID":"b5fff704-505b-4f6f-8ab1-5f0f86b62e80","Type":"ContainerStarted","Data":"fa6fad6313ab988c3c78e5e777ce64af6fccd7fa588d11d56f74c424f94ad531"} Sep 08 06:36:35.984600 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:35.984559 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jjwd2" podStartSLOduration=66.325922328 podStartE2EDuration="1m8.984543689s" totalImagesPullingTime="2.658621361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:35.984410136 +0000 UTC m=+102.934807980" watchObservedRunningTime="2026-09-08 06:36:35.984543689 +0000 UTC m=+102.934941531" Sep 08 06:36:36.085919 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.085892 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:36.096271 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.096239 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q"] Sep 08 06:36:36.116736 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.116713 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q"] Sep 08 06:36:36.116855 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.116835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:36.119954 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.119934 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 08 06:36:36.120310 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.120289 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-225c6\"" Sep 08 06:36:36.161527 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.161496 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:36.255385 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.255351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5ghk\" (UniqueName: \"kubernetes.io/projected/f977af7d-cda4-404f-8e12-6a362b2c9645-kube-api-access-m5ghk\") pod \"monitoring-plugin-85bbbbbf4-xxj2q\" (UID: \"f977af7d-cda4-404f-8e12-6a362b2c9645\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:36.255540 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.255397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f977af7d-cda4-404f-8e12-6a362b2c9645-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xxj2q\" (UID: \"f977af7d-cda4-404f-8e12-6a362b2c9645\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:36.356045 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.356011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5ghk\" (UniqueName: \"kubernetes.io/projected/f977af7d-cda4-404f-8e12-6a362b2c9645-kube-api-access-m5ghk\") pod \"monitoring-plugin-85bbbbbf4-xxj2q\" (UID: \"f977af7d-cda4-404f-8e12-6a362b2c9645\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:36.356045 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.356052 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f977af7d-cda4-404f-8e12-6a362b2c9645-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xxj2q\" (UID: \"f977af7d-cda4-404f-8e12-6a362b2c9645\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:36.356453 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:36:36.356237 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Sep 08 06:36:36.356453 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:36:36.356303 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f977af7d-cda4-404f-8e12-6a362b2c9645-monitoring-plugin-cert podName:f977af7d-cda4-404f-8e12-6a362b2c9645 nodeName:}" failed. No retries permitted until 2026-09-08 06:36:36.856288078 +0000 UTC m=+103.806685899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f977af7d-cda4-404f-8e12-6a362b2c9645-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-xxj2q" (UID: "f977af7d-cda4-404f-8e12-6a362b2c9645") : secret "monitoring-plugin-cert" not found Sep 08 06:36:36.366274 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.366245 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5ghk\" (UniqueName: \"kubernetes.io/projected/f977af7d-cda4-404f-8e12-6a362b2c9645-kube-api-access-m5ghk\") pod \"monitoring-plugin-85bbbbbf4-xxj2q\" (UID: \"f977af7d-cda4-404f-8e12-6a362b2c9645\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:36.861576 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.861545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f977af7d-cda4-404f-8e12-6a362b2c9645-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xxj2q\" (UID: \"f977af7d-cda4-404f-8e12-6a362b2c9645\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:36.864084 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.864060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f977af7d-cda4-404f-8e12-6a362b2c9645-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-xxj2q\" (UID: \"f977af7d-cda4-404f-8e12-6a362b2c9645\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:36.901962 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.901931 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:36.951370 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.951334 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-flfvk" event={"ID":"b98fb29e-7831-4a23-be51-3ef86226dbfe","Type":"ContainerStarted","Data":"4c67d269d59fdd76c31b4a6bced86a32247ff0977639752541dd85e6653e6e39"} Sep 08 06:36:36.951528 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.951432 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-flfvk" event={"ID":"b98fb29e-7831-4a23-be51-3ef86226dbfe","Type":"ContainerStarted","Data":"31d103f8d56baa0644ee3e23e5d2562c66e33a5a2d171bd2e359af6ac5594eb1"} Sep 08 06:36:36.981264 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:36.981222 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-flfvk" podStartSLOduration=2.580452225 podStartE2EDuration="5.981209558s" totalImagesPullingTime="3.301305355s" totalInitContainerRuntime="99.451978ms" isStatefulPod=true podCreationTimestamp="2026-09-08 06:36:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:36.979942796 +0000 UTC m=+103.930340640" watchObservedRunningTime="2026-09-08 06:36:36.981209558 +0000 UTC m=+103.931607422" Sep 08 06:36:37.050102 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:37.050073 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:37.339750 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:37.339715 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q"] Sep 08 06:36:37.345124 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:36:37.345091 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf977af7d_cda4_404f_8e12_6a362b2c9645.slice/crio-3e0e1c8ae1883193a3c19e09aab8193574658dbd45df49a9d937e22706d2422c WatchSource:0}: Error finding container 3e0e1c8ae1883193a3c19e09aab8193574658dbd45df49a9d937e22706d2422c: Status 404 returned error can't find the container with id 3e0e1c8ae1883193a3c19e09aab8193574658dbd45df49a9d937e22706d2422c Sep 08 06:36:37.651756 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:37.651717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:37.811303 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:37.811264 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:37.959227 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:37.959146 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" event={"ID":"f977af7d-cda4-404f-8e12-6a362b2c9645","Type":"ContainerStarted","Data":"3e0e1c8ae1883193a3c19e09aab8193574658dbd45df49a9d937e22706d2422c"} Sep 08 06:36:38.415522 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:38.415488 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:38.528020 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:38.527987 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:39.447990 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.447902 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:39.535135 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.535100 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:39.968349 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.968317 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" event={"ID":"b5fff704-505b-4f6f-8ab1-5f0f86b62e80","Type":"ContainerStarted","Data":"a031cbcd55bb8ccfb3268a2177b64051ea86b98caa7ad50e0848c3866152f92b"} Sep 08 06:36:39.968549 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.968386 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" event={"ID":"b5fff704-505b-4f6f-8ab1-5f0f86b62e80","Type":"ContainerStarted","Data":"647a8c0ad9eb0c6aef243440a95c87e8ea81dbb005de76d58c4c6d262eebfef1"} Sep 08 06:36:39.968549 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.968420 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" event={"ID":"b5fff704-505b-4f6f-8ab1-5f0f86b62e80","Type":"ContainerStarted","Data":"5d68349b8075458c8dae26873820f11491b2c9d488e70fd4cbcd30255664a289"} Sep 08 06:36:39.969803 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.969782 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" event={"ID":"f977af7d-cda4-404f-8e12-6a362b2c9645","Type":"ContainerStarted","Data":"c272c5b17e1be3a841cf29150dd0fcf73d675e5ba5b3ba0713dec5e43dd8c9e5"} Sep 08 06:36:39.970010 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.969992 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:39.974930 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.974913 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" Sep 08 06:36:39.997491 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:39.997444 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-xxj2q" podStartSLOduration=2.193549844 podStartE2EDuration="3.997428562s" totalImagesPullingTime="1.803878718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:39.996477308 +0000 UTC m=+106.946875142" watchObservedRunningTime="2026-09-08 06:36:39.997428562 +0000 UTC m=+106.947826406" Sep 08 06:36:40.223891 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:40.223805 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:40.319266 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:40.319221 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:40.479612 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:40.479503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:40.547615 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:40.547567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:40.951555 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:40.951509 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" podUID="a8d177db-9985-4756-bd88-c0534cb91030" containerName="registry" containerID="cri-o://fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8" gracePeriod=30 Sep 08 06:36:41.185231 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.185207 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:36:41.301719 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.301681 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-installation-pull-secrets\") pod \"a8d177db-9985-4756-bd88-c0534cb91030\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " Sep 08 06:36:41.301719 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.301723 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-image-registry-private-configuration\") pod \"a8d177db-9985-4756-bd88-c0534cb91030\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " Sep 08 06:36:41.301932 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.301744 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-bound-sa-token\") pod \"a8d177db-9985-4756-bd88-c0534cb91030\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " Sep 08 06:36:41.301932 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.301784 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a8d177db-9985-4756-bd88-c0534cb91030-ca-trust-extracted\") pod \"a8d177db-9985-4756-bd88-c0534cb91030\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " Sep 08 06:36:41.301932 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.301832 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-registry-certificates\") pod \"a8d177db-9985-4756-bd88-c0534cb91030\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " Sep 08 06:36:41.301932 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.301852 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-trusted-ca\") pod \"a8d177db-9985-4756-bd88-c0534cb91030\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " Sep 08 06:36:41.302108 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.301952 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmwph\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-kube-api-access-gmwph\") pod \"a8d177db-9985-4756-bd88-c0534cb91030\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " Sep 08 06:36:41.302108 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.302026 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") pod \"a8d177db-9985-4756-bd88-c0534cb91030\" (UID: \"a8d177db-9985-4756-bd88-c0534cb91030\") " Sep 08 06:36:41.302361 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.302332 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a8d177db-9985-4756-bd88-c0534cb91030" (UID: "a8d177db-9985-4756-bd88-c0534cb91030"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:36:41.302465 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.302360 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a8d177db-9985-4756-bd88-c0534cb91030" (UID: "a8d177db-9985-4756-bd88-c0534cb91030"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:36:41.304614 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.304583 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a8d177db-9985-4756-bd88-c0534cb91030" (UID: "a8d177db-9985-4756-bd88-c0534cb91030"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:36:41.304742 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.304622 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a8d177db-9985-4756-bd88-c0534cb91030" (UID: "a8d177db-9985-4756-bd88-c0534cb91030"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:36:41.304813 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.304744 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a8d177db-9985-4756-bd88-c0534cb91030" (UID: "a8d177db-9985-4756-bd88-c0534cb91030"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:36:41.304813 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.304769 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a8d177db-9985-4756-bd88-c0534cb91030" (UID: "a8d177db-9985-4756-bd88-c0534cb91030"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:36:41.304920 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.304901 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-kube-api-access-gmwph" (OuterVolumeSpecName: "kube-api-access-gmwph") pod "a8d177db-9985-4756-bd88-c0534cb91030" (UID: "a8d177db-9985-4756-bd88-c0534cb91030"). InnerVolumeSpecName "kube-api-access-gmwph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:36:41.310936 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.310911 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8d177db-9985-4756-bd88-c0534cb91030-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a8d177db-9985-4756-bd88-c0534cb91030" (UID: "a8d177db-9985-4756-bd88-c0534cb91030"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:36:41.403060 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.403013 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-registry-certificates\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:36:41.403060 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.403058 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a8d177db-9985-4756-bd88-c0534cb91030-trusted-ca\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:36:41.403257 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.403075 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmwph\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-kube-api-access-gmwph\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:36:41.403257 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.403090 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-registry-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:36:41.403257 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.403106 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-installation-pull-secrets\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:36:41.403257 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.403122 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a8d177db-9985-4756-bd88-c0534cb91030-image-registry-private-configuration\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:36:41.403257 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.403137 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a8d177db-9985-4756-bd88-c0534cb91030-bound-sa-token\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:36:41.403257 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.403152 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a8d177db-9985-4756-bd88-c0534cb91030-ca-trust-extracted\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:36:41.978120 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.978091 2581 generic.go:356] "Generic (PLEG): container finished" podID="a8d177db-9985-4756-bd88-c0534cb91030" containerID="fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8" exitCode=0 Sep 08 06:36:41.978426 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.978149 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" Sep 08 06:36:41.978426 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.978182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" event={"ID":"a8d177db-9985-4756-bd88-c0534cb91030","Type":"ContainerDied","Data":"fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8"} Sep 08 06:36:41.978426 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.978241 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-584fbdc7bd-7jcq4" event={"ID":"a8d177db-9985-4756-bd88-c0534cb91030","Type":"ContainerDied","Data":"7a4ac9f6647ec345688973c54dd1121e2a3f9c729370680fd0ca3b7a4619ce95"} Sep 08 06:36:41.978426 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.978267 2581 scope.go:117] "RemoveContainer" containerID="fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8" Sep 08 06:36:41.981915 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.981891 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" event={"ID":"b5fff704-505b-4f6f-8ab1-5f0f86b62e80","Type":"ContainerStarted","Data":"578c2b4eca5c7a73508f8746abb2930a06ed15a7debfef78697bb6aec2001064"} Sep 08 06:36:41.982021 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.981952 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" event={"ID":"b5fff704-505b-4f6f-8ab1-5f0f86b62e80","Type":"ContainerStarted","Data":"d308e46df863b35ea3a4663e4825babc95a8782eae9b97eb40fa78724fa1fdca"} Sep 08 06:36:41.982021 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.981980 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" event={"ID":"b5fff704-505b-4f6f-8ab1-5f0f86b62e80","Type":"ContainerStarted","Data":"bf37737f1cab86491f73f3a123a23a818b98423bbaf769d07a1f9eb41bff52bf"} Sep 08 06:36:41.987679 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.987662 2581 scope.go:117] "RemoveContainer" containerID="fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8" Sep 08 06:36:41.987964 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:36:41.987942 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8\": container with ID starting with fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8 not found: ID does not exist" containerID="fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8" Sep 08 06:36:41.988022 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:41.987973 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8"} err="failed to get container status \"fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8\": rpc error: code = NotFound desc = could not find container \"fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8\": container with ID starting with fc25630130bdbf30b5a9a2a8a1226d82e874625bea04eabb6179866e56ac12e8 not found: ID does not exist" Sep 08 06:36:42.001277 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:42.001251 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-584fbdc7bd-7jcq4"] Sep 08 06:36:42.006450 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:42.006428 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-584fbdc7bd-7jcq4"] Sep 08 06:36:42.986686 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:42.986654 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:43.533106 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:43.533075 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8d177db-9985-4756-bd88-c0534cb91030" path="/var/lib/kubelet/pods/a8d177db-9985-4756-bd88-c0534cb91030/volumes" Sep 08 06:36:43.879978 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:43.879894 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:43.985153 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:43.985111 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:45.040556 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:45.040524 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:45.115784 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:45.115739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:45.493524 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:45.493435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:45.553765 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:45.553734 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:45.953138 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:45.953110 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jjwd2" Sep 08 06:36:45.986675 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:45.986604 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" podStartSLOduration=5.698011975 podStartE2EDuration="11.986584251s" totalImagesPullingTime="6.288572276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:36:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:36:42.037436906 +0000 UTC m=+108.987834759" watchObservedRunningTime="2026-09-08 06:36:45.986584251 +0000 UTC m=+112.936982096" Sep 08 06:36:48.490190 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:48.490156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:48.562494 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:48.562462 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:48.995727 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:48.995703 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-665b7d545b-6x54w" Sep 08 06:36:50.349376 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:50.349342 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:50.413269 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:50.413236 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:50.660369 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:50.660281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:50.761403 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:50.761370 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:50.830864 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:50.830831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:51.133122 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:51.133090 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:51.203447 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:51.203420 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:55.117155 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:55.117119 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:55.218499 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:55.218472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:56.323519 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:56.323458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:56.472491 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:56.472456 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:56.574936 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:56.574869 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:59.459773 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:59.459715 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:59.564952 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:59.564927 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:59.662912 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:59.662877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:36:59.730196 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:36:59.730129 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:02.527835 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:02.527802 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:02.628910 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:02.628881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:03.264564 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:03.264535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:37:03.266926 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:03.266905 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3926a42-8ed3-4688-81da-3867f79e57d6-metrics-certs\") pod \"network-metrics-daemon-wrk2m\" (UID: \"f3926a42-8ed3-4688-81da-3867f79e57d6\") " pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:37:03.355826 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:03.355784 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rcs59\"" Sep 08 06:37:03.363909 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:03.363885 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wrk2m" Sep 08 06:37:03.636932 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:03.636858 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wrk2m"] Sep 08 06:37:03.639953 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:37:03.639927 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3926a42_8ed3_4688_81da_3867f79e57d6.slice/crio-e42b52b63a71a0d283b754531503f9d52dee3144a0adb21aa5a80cfd92146f77 WatchSource:0}: Error finding container e42b52b63a71a0d283b754531503f9d52dee3144a0adb21aa5a80cfd92146f77: Status 404 returned error can't find the container with id e42b52b63a71a0d283b754531503f9d52dee3144a0adb21aa5a80cfd92146f77 Sep 08 06:37:04.065197 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:04.065163 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrk2m" event={"ID":"f3926a42-8ed3-4688-81da-3867f79e57d6","Type":"ContainerStarted","Data":"e42b52b63a71a0d283b754531503f9d52dee3144a0adb21aa5a80cfd92146f77"} Sep 08 06:37:04.127586 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:04.127552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:04.228871 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:04.228843 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:05.070800 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:05.070769 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrk2m" event={"ID":"f3926a42-8ed3-4688-81da-3867f79e57d6","Type":"ContainerStarted","Data":"7e5b4566ab3d99e62815fe2e070ceee71673af90a82e07975835fbb773c4369c"} Sep 08 06:37:05.071166 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:05.070820 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wrk2m" event={"ID":"f3926a42-8ed3-4688-81da-3867f79e57d6","Type":"ContainerStarted","Data":"af25a3b93954f0f9ef1ccece63549c6148b559a0b255162f5cdbd4506de9e71d"} Sep 08 06:37:05.089361 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:05.089313 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wrk2m" podStartSLOduration=131.203257119 podStartE2EDuration="2m12.089299799s" totalImagesPullingTime="886.04268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:34:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:37:05.087777574 +0000 UTC m=+132.038175430" watchObservedRunningTime="2026-09-08 06:37:05.089299799 +0000 UTC m=+132.039697641" Sep 08 06:37:05.223888 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:05.223854 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:05.324539 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:05.324442 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:11.094993 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:11.094956 2581 generic.go:356] "Generic (PLEG): container finished" podID="3b254dbe-e7b3-49b3-baf5-7f15f2dd9714" containerID="632a9de3edbb5fcada5db9ab89dbe310ff37e2f869783c59ad8bd518ac905806" exitCode=0 Sep 08 06:37:11.095385 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:11.095031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" event={"ID":"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714","Type":"ContainerDied","Data":"632a9de3edbb5fcada5db9ab89dbe310ff37e2f869783c59ad8bd518ac905806"} Sep 08 06:37:11.095385 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:11.095341 2581 scope.go:117] "RemoveContainer" containerID="632a9de3edbb5fcada5db9ab89dbe310ff37e2f869783c59ad8bd518ac905806" Sep 08 06:37:12.100183 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:12.100152 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hnt6j" event={"ID":"3b254dbe-e7b3-49b3-baf5-7f15f2dd9714","Type":"ContainerStarted","Data":"f90aef6b8bc14c5512a2f2d22ae5ad7fe7e63f6a1666ccd94d0d2001c250e737"} Sep 08 06:37:17.528440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:17.528403 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:17.629912 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:17.629840 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:50.572456 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:50.572355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:50.993074 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:50.992954 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:58.889539 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:58.889497 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:58.960504 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:58.960472 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:59.031852 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:59.031823 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:59.631463 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:59.631428 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:37:59.732136 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:37:59.732097 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:38:05.880384 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:38:05.880349 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:38:09.978592 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:38:09.978563 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:38:10.083721 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:38:10.083679 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:38:10.183161 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:38:10.183133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:38:32.594453 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:38:32.594406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:38:32.655861 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:38:32.655830 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:01.392269 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:01.392214 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:05.879980 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:05.879925 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:05.950167 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:05.950102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:08.790793 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:08.790747 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:08.853286 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:08.853246 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:08.934420 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:08.934390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:17.882158 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:17.882080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:18.196525 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:18.196444 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:20.211961 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:20.211926 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:20.276170 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:20.276136 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:20.335595 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:20.335566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:32.548558 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:32.548522 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:32.647237 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:32.647205 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:39:53.469427 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:53.469393 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:39:53.472166 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:53.472141 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:39:53.472794 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:39:53.472775 2581 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 06:41:26.901770 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:26.901737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:28.287331 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:28.287297 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:37.497290 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:37.497253 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:37.597536 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:37.597498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:37.885217 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:37.885186 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:37.961506 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:37.961480 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:38.368098 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.368064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:38.368251 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.368158 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk"] Sep 08 06:41:38.368455 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.368442 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8d177db-9985-4756-bd88-c0534cb91030" containerName="registry" Sep 08 06:41:38.368490 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.368457 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8d177db-9985-4756-bd88-c0534cb91030" containerName="registry" Sep 08 06:41:38.368526 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.368508 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8d177db-9985-4756-bd88-c0534cb91030" containerName="registry" Sep 08 06:41:38.371167 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.371152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:41:38.375061 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.375036 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 06:41:38.375061 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.375055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-88879\"" Sep 08 06:41:38.375239 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.375042 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 08 06:41:38.380232 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.380207 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk"] Sep 08 06:41:38.474608 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.474573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v5sm\" (UniqueName: \"kubernetes.io/projected/2fac86c7-a9c1-4d95-912c-995817f3ada2-kube-api-access-5v5sm\") pod \"feast-operator-controller-manager-777d78558f-wggnk\" (UID: \"2fac86c7-a9c1-4d95-912c-995817f3ada2\") " pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:41:38.574933 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.574902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v5sm\" (UniqueName: \"kubernetes.io/projected/2fac86c7-a9c1-4d95-912c-995817f3ada2-kube-api-access-5v5sm\") pod \"feast-operator-controller-manager-777d78558f-wggnk\" (UID: \"2fac86c7-a9c1-4d95-912c-995817f3ada2\") " pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:41:38.583365 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.583340 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v5sm\" (UniqueName: \"kubernetes.io/projected/2fac86c7-a9c1-4d95-912c-995817f3ada2-kube-api-access-5v5sm\") pod \"feast-operator-controller-manager-777d78558f-wggnk\" (UID: \"2fac86c7-a9c1-4d95-912c-995817f3ada2\") " pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:41:38.681864 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.681781 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:41:38.951553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.951480 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk"] Sep 08 06:41:38.955394 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:41:38.955365 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fac86c7_a9c1_4d95_912c_995817f3ada2.slice/crio-a3a7ed4b8efed4e2c6bc29eb1b28f448cc2482387fa61036cf6c9225c7e52487 WatchSource:0}: Error finding container a3a7ed4b8efed4e2c6bc29eb1b28f448cc2482387fa61036cf6c9225c7e52487: Status 404 returned error can't find the container with id a3a7ed4b8efed4e2c6bc29eb1b28f448cc2482387fa61036cf6c9225c7e52487 Sep 08 06:41:38.957148 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:38.957129 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 06:41:39.043994 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:39.043964 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" event={"ID":"2fac86c7-a9c1-4d95-912c-995817f3ada2","Type":"ContainerStarted","Data":"a3a7ed4b8efed4e2c6bc29eb1b28f448cc2482387fa61036cf6c9225c7e52487"} Sep 08 06:41:42.059665 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:42.059144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" event={"ID":"2fac86c7-a9c1-4d95-912c-995817f3ada2","Type":"ContainerStarted","Data":"d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef"} Sep 08 06:41:42.060102 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:42.060019 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:41:42.076624 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:42.076578 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" podStartSLOduration=1.735136867 podStartE2EDuration="4.076562996s" totalImagesPullingTime="2.341426129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:41:42.075963223 +0000 UTC m=+409.026361065" watchObservedRunningTime="2026-09-08 06:41:42.076562996 +0000 UTC m=+409.026960839" Sep 08 06:41:54.068594 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:54.068560 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:41:55.954752 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:55.954717 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:56.013474 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:56.013445 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:57.801391 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:57.801355 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:41:57.864944 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:41:57.864913 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:14.892239 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:14.892139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:14.994550 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:14.994514 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:15.480984 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.480948 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:15.582111 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.582070 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:15.610360 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.610330 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42"] Sep 08 06:42:15.615304 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.615278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.619766 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.619741 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 08 06:42:15.619951 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.619824 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4tvhj\"" Sep 08 06:42:15.619951 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.619830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 08 06:42:15.620612 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.620593 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 08 06:42:15.620612 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.620603 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 08 06:42:15.620781 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.620666 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 06:42:15.620781 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.620698 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 08 06:42:15.620883 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.620869 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 06:42:15.629951 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.629926 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42"] Sep 08 06:42:15.647559 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.647538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-ui-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.647684 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.647565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4svw\" (UniqueName: \"kubernetes.io/projected/483d88ab-20ac-4839-ab73-0d28fe87f505-kube-api-access-z4svw\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.647684 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.647583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.647684 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.647608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/483d88ab-20ac-4839-ab73-0d28fe87f505-feast-data\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.647813 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.647712 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.647813 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.647733 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-offline-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.657775 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.657751 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:15.748545 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.748461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.748545 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.748492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-offline-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.748545 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.748523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-ui-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.748545 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.748543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4svw\" (UniqueName: \"kubernetes.io/projected/483d88ab-20ac-4839-ab73-0d28fe87f505-kube-api-access-z4svw\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.748895 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.748567 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.748895 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.748605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/483d88ab-20ac-4839-ab73-0d28fe87f505-feast-data\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.748895 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:42:15.748652 2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 08 06:42:15.748895 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:42:15.748738 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls podName:483d88ab-20ac-4839-ab73-0d28fe87f505 nodeName:}" failed. No retries permitted until 2026-09-08 06:42:16.248716321 +0000 UTC m=+443.199114142 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls") pod "feast-simple-feast-setup-74846d5c55-jll42" (UID: "483d88ab-20ac-4839-ab73-0d28fe87f505") : secret "feast-simple-feast-setup-registry-tls" not found Sep 08 06:42:15.749060 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:42:15.748919 2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 08 06:42:15.749060 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:42:15.748979 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls podName:483d88ab-20ac-4839-ab73-0d28fe87f505 nodeName:}" failed. No retries permitted until 2026-09-08 06:42:16.24896357 +0000 UTC m=+443.199361391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls") pod "feast-simple-feast-setup-74846d5c55-jll42" (UID: "483d88ab-20ac-4839-ab73-0d28fe87f505") : secret "feast-simple-feast-setup-online-tls" not found Sep 08 06:42:15.749060 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.749047 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/483d88ab-20ac-4839-ab73-0d28fe87f505-feast-data\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.751103 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.751078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-ui-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.751205 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.751119 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-offline-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.757663 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.757620 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4svw\" (UniqueName: \"kubernetes.io/projected/483d88ab-20ac-4839-ab73-0d28fe87f505-kube-api-access-z4svw\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:15.776080 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.776055 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:15.999179 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:15.999085 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:16.240397 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:16.240346 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:42:16.251504 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:16.251433 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:16.251669 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:16.251502 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:16.253992 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:16.253969 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:16.254115 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:16.254031 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls\") pod \"feast-simple-feast-setup-74846d5c55-jll42\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:16.524677 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:16.524646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:16.805029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:16.805005 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42"] Sep 08 06:42:16.807349 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:42:16.807322 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod483d88ab_20ac_4839_ab73_0d28fe87f505.slice/crio-e4b82085a157766adf120860813d2a90d380fa921e1f5f4b6d2c0604f317ebd7 WatchSource:0}: Error finding container e4b82085a157766adf120860813d2a90d380fa921e1f5f4b6d2c0604f317ebd7: Status 404 returned error can't find the container with id e4b82085a157766adf120860813d2a90d380fa921e1f5f4b6d2c0604f317ebd7 Sep 08 06:42:17.188139 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:17.188050 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerStarted","Data":"e4b82085a157766adf120860813d2a90d380fa921e1f5f4b6d2c0604f317ebd7"} Sep 08 06:42:45.301320 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:45.301279 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerStarted","Data":"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396"} Sep 08 06:42:49.318308 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:49.318277 2581 generic.go:356] "Generic (PLEG): container finished" podID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerID="7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396" exitCode=0 Sep 08 06:42:49.318705 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:49.318359 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerDied","Data":"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396"} Sep 08 06:42:50.323882 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:50.323844 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerStarted","Data":"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49"} Sep 08 06:42:55.345038 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:55.345004 2581 generic.go:356] "Generic (PLEG): container finished" podID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerID="c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49" exitCode=0 Sep 08 06:42:55.345387 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:55.345078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerDied","Data":"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49"} Sep 08 06:42:55.349220 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:55.349175 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 08 06:42:56.355156 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.355113 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerStarted","Data":"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43"} Sep 08 06:42:56.355659 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.355182 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerStarted","Data":"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a"} Sep 08 06:42:56.355659 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.355205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerStarted","Data":"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed"} Sep 08 06:42:56.355659 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.355225 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerStarted","Data":"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4"} Sep 08 06:42:56.382406 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.382340 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podStartSLOduration=13.772618092 podStartE2EDuration="41.382314321s" totalImagesPullingTime="27.609696229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:42:56.381000273 +0000 UTC m=+483.331398118" watchObservedRunningTime="2026-09-08 06:42:56.382314321 +0000 UTC m=+483.332712177" Sep 08 06:42:56.525308 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.525264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:56.525503 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.525341 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:56.525503 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.525368 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:56.525503 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:56.525387 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:58.526097 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:58.525852 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:58.526579 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:58.526123 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:58.526579 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:58.526145 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:58.526579 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:58.526163 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:42:58.528038 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:58.527989 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Sep 08 06:42:58.528175 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:58.527999 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 06:42:58.528175 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:58.527991 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused" Sep 08 06:42:58.528175 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:42:58.527989 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 06:43:01.525505 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:01.525460 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.20:8816: connect: connection refused" Sep 08 06:43:01.526020 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:01.525526 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.20:6571: connect: connection refused" Sep 08 06:43:01.526020 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:01.525479 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 06:43:01.526020 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:01.525459 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 06:43:04.525952 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:04.525921 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:43:04.526417 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:04.526087 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:43:04.526840 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:04.526815 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:43:04.532491 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:04.532461 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:43:04.532651 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:04.532531 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:43:04.532651 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:04.532575 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:43:04.535517 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:04.535495 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:43:05.404774 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:05.404740 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:43:05.782985 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:05.782955 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:43:57.693388 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:43:57.693341 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:07.877526 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:07.877491 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:07.893051 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:07.893022 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42"] Sep 08 06:44:07.893324 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:07.893301 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="registry" containerID="cri-o://9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4" gracePeriod=30 Sep 08 06:44:07.893698 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:07.893435 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="offline" containerID="cri-o://9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a" gracePeriod=30 Sep 08 06:44:07.893698 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:07.893478 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" containerID="cri-o://8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43" gracePeriod=30 Sep 08 06:44:07.893698 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:07.893495 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" containerID="cri-o://9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed" gracePeriod=30 Sep 08 06:44:07.978362 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:07.978313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:08.157698 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.157573 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:08.259211 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.259167 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:08.320115 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.320079 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx"] Sep 08 06:44:08.323656 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.323619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.327197 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.327175 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-thjfj\"" Sep 08 06:44:08.350370 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.350340 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx"] Sep 08 06:44:08.426818 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.426739 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:08.435953 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.435924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2785dd38-330d-44ba-8bd3-99604d0a8415-feast-data\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.436105 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.435961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-registry-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.436105 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.435978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-offline-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.436105 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.436017 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-ui-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.436105 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.436085 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2ht9\" (UniqueName: \"kubernetes.io/projected/2785dd38-330d-44ba-8bd3-99604d0a8415-kube-api-access-z2ht9\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.436268 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.436124 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.537402 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.537239 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2ht9\" (UniqueName: \"kubernetes.io/projected/2785dd38-330d-44ba-8bd3-99604d0a8415-kube-api-access-z2ht9\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.537402 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.537286 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.537402 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.537325 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2785dd38-330d-44ba-8bd3-99604d0a8415-feast-data\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.537402 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.537348 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-registry-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.537402 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.537370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-offline-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.537703 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:44:08.537493 2581 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 08 06:44:08.537703 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:44:08.537571 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls podName:2785dd38-330d-44ba-8bd3-99604d0a8415 nodeName:}" failed. No retries permitted until 2026-09-08 06:44:09.037548311 +0000 UTC m=+555.987946151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls") pod "feast-simple-feast-setup-74846d5c55-452gx" (UID: "2785dd38-330d-44ba-8bd3-99604d0a8415") : secret "feast-simple-feast-setup-online-tls" not found Sep 08 06:44:08.537703 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.537614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-ui-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.537860 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.537776 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2785dd38-330d-44ba-8bd3-99604d0a8415-feast-data\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.540132 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.540108 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-offline-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.540441 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.540422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-ui-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.540518 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.540446 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-registry-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.547912 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.547884 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2ht9\" (UniqueName: \"kubernetes.io/projected/2785dd38-330d-44ba-8bd3-99604d0a8415-kube-api-access-z2ht9\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:08.638738 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.638706 2581 generic.go:356] "Generic (PLEG): container finished" podID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerID="8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43" exitCode=0 Sep 08 06:44:08.638882 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.638786 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerDied","Data":"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43"} Sep 08 06:44:08.787073 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.787034 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:08.889737 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:08.889699 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:09.040813 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:09.040781 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:09.043188 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:09.043171 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls\") pod \"feast-simple-feast-setup-74846d5c55-452gx\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:09.232610 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:09.232573 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:09.512175 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:09.512152 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx"] Sep 08 06:44:09.513007 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:44:09.512978 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2785dd38_330d_44ba_8bd3_99604d0a8415.slice/crio-e50f759d4f5a43a14ac6e38457ed139ad33792d0d85cc00db6e41a0610afacfb WatchSource:0}: Error finding container e50f759d4f5a43a14ac6e38457ed139ad33792d0d85cc00db6e41a0610afacfb: Status 404 returned error can't find the container with id e50f759d4f5a43a14ac6e38457ed139ad33792d0d85cc00db6e41a0610afacfb Sep 08 06:44:09.646388 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:09.646357 2581 generic.go:356] "Generic (PLEG): container finished" podID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerID="9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed" exitCode=0 Sep 08 06:44:09.646563 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:09.646430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerDied","Data":"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed"} Sep 08 06:44:09.648059 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:09.648024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerStarted","Data":"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5"} Sep 08 06:44:09.648059 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:09.648056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerStarted","Data":"e50f759d4f5a43a14ac6e38457ed139ad33792d0d85cc00db6e41a0610afacfb"} Sep 08 06:44:14.527870 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:14.527822 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 06:44:14.669018 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:14.668947 2581 generic.go:356] "Generic (PLEG): container finished" podID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerID="e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5" exitCode=0 Sep 08 06:44:14.669146 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:14.669021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerDied","Data":"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5"} Sep 08 06:44:15.401951 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:15.401916 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 06:44:15.675240 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:15.675153 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerStarted","Data":"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330"} Sep 08 06:44:20.697084 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:20.697012 2581 generic.go:356] "Generic (PLEG): container finished" podID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerID="c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330" exitCode=0 Sep 08 06:44:20.697084 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:20.697049 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerDied","Data":"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330"} Sep 08 06:44:21.707940 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:21.707902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerStarted","Data":"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0"} Sep 08 06:44:21.708415 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:21.707962 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerStarted","Data":"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5"} Sep 08 06:44:21.708415 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:21.707983 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerStarted","Data":"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f"} Sep 08 06:44:21.708415 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:21.708003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerStarted","Data":"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea"} Sep 08 06:44:21.740615 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:21.735991 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podStartSLOduration=13.735967875 podStartE2EDuration="13.735967875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:44:21.734279428 +0000 UTC m=+568.684677274" watchObservedRunningTime="2026-09-08 06:44:21.735967875 +0000 UTC m=+568.686365719" Sep 08 06:44:24.232970 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.232930 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:24.233512 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.233488 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:24.233672 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.233520 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:24.233672 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.233537 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:24.235068 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.234957 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused" Sep 08 06:44:24.235068 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.234978 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Sep 08 06:44:24.235068 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.234978 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Sep 08 06:44:24.235068 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.235017 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.21:6571: connect: connection refused" Sep 08 06:44:24.528650 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:24.528583 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 06:44:25.401957 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:25.401909 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 06:44:27.233832 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:27.233790 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused" Sep 08 06:44:27.234401 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:27.233790 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Sep 08 06:44:27.234598 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:27.233880 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.21:6571: connect: connection refused" Sep 08 06:44:27.234598 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:27.233877 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Sep 08 06:44:29.233515 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:29.233473 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:29.233515 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:29.233532 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:29.233969 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:29.233550 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:29.233969 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:29.233592 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:30.233593 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:30.233557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:30.234088 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:30.234010 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:30.234193 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:30.234178 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:30.238765 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:30.238744 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:30.757130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:30.757097 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:30.757309 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:30.757254 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:30.757386 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:30.757314 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:30.760154 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:30.760136 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:44:31.052200 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:31.052126 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:34.527940 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:34.527901 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.20:8443: connect: connection refused" Sep 08 06:44:34.528404 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:34.528104 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:44:35.402568 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:35.402530 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" probeResult="failure" output="Get \"https://10.134.0.20:6567/health\": dial tcp 10.134.0.20:6567: connect: connection refused" Sep 08 06:44:35.402759 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:35.402669 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:44:38.543125 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.543104 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:44:38.577121 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.577098 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-offline-tls\") pod \"483d88ab-20ac-4839-ab73-0d28fe87f505\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " Sep 08 06:44:38.577237 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.577136 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls\") pod \"483d88ab-20ac-4839-ab73-0d28fe87f505\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " Sep 08 06:44:38.577237 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.577158 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4svw\" (UniqueName: \"kubernetes.io/projected/483d88ab-20ac-4839-ab73-0d28fe87f505-kube-api-access-z4svw\") pod \"483d88ab-20ac-4839-ab73-0d28fe87f505\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " Sep 08 06:44:38.577379 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.577250 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-ui-tls\") pod \"483d88ab-20ac-4839-ab73-0d28fe87f505\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " Sep 08 06:44:38.577379 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.577295 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls\") pod \"483d88ab-20ac-4839-ab73-0d28fe87f505\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " Sep 08 06:44:38.577379 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.577342 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/483d88ab-20ac-4839-ab73-0d28fe87f505-feast-data\") pod \"483d88ab-20ac-4839-ab73-0d28fe87f505\" (UID: \"483d88ab-20ac-4839-ab73-0d28fe87f505\") " Sep 08 06:44:38.578316 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.578275 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/483d88ab-20ac-4839-ab73-0d28fe87f505-feast-data" (OuterVolumeSpecName: "feast-data") pod "483d88ab-20ac-4839-ab73-0d28fe87f505" (UID: "483d88ab-20ac-4839-ab73-0d28fe87f505"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:44:38.579807 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.579757 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls" (OuterVolumeSpecName: "online-tls") pod "483d88ab-20ac-4839-ab73-0d28fe87f505" (UID: "483d88ab-20ac-4839-ab73-0d28fe87f505"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:44:38.579807 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.579714 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/483d88ab-20ac-4839-ab73-0d28fe87f505-kube-api-access-z4svw" (OuterVolumeSpecName: "kube-api-access-z4svw") pod "483d88ab-20ac-4839-ab73-0d28fe87f505" (UID: "483d88ab-20ac-4839-ab73-0d28fe87f505"). InnerVolumeSpecName "kube-api-access-z4svw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:44:38.579946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.579814 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "483d88ab-20ac-4839-ab73-0d28fe87f505" (UID: "483d88ab-20ac-4839-ab73-0d28fe87f505"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:44:38.579946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.579828 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "483d88ab-20ac-4839-ab73-0d28fe87f505" (UID: "483d88ab-20ac-4839-ab73-0d28fe87f505"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:44:38.579946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.579854 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "483d88ab-20ac-4839-ab73-0d28fe87f505" (UID: "483d88ab-20ac-4839-ab73-0d28fe87f505"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:44:38.678794 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.678745 2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-ui-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:44:38.678794 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.678782 2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-online-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:44:38.678794 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.678793 2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/483d88ab-20ac-4839-ab73-0d28fe87f505-feast-data\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:44:38.678943 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.678802 2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-offline-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:44:38.678943 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.678810 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/483d88ab-20ac-4839-ab73-0d28fe87f505-registry-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:44:38.678943 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.678818 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4svw\" (UniqueName: \"kubernetes.io/projected/483d88ab-20ac-4839-ab73-0d28fe87f505-kube-api-access-z4svw\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:44:38.789018 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.788991 2581 generic.go:356] "Generic (PLEG): container finished" podID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerID="9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a" exitCode=137 Sep 08 06:44:38.789018 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.789011 2581 generic.go:356] "Generic (PLEG): container finished" podID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerID="9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4" exitCode=137 Sep 08 06:44:38.789144 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.789054 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" Sep 08 06:44:38.789144 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.789078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerDied","Data":"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a"} Sep 08 06:44:38.789144 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.789120 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerDied","Data":"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4"} Sep 08 06:44:38.789144 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.789135 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42" event={"ID":"483d88ab-20ac-4839-ab73-0d28fe87f505","Type":"ContainerDied","Data":"e4b82085a157766adf120860813d2a90d380fa921e1f5f4b6d2c0604f317ebd7"} Sep 08 06:44:38.789269 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.789157 2581 scope.go:117] "RemoveContainer" containerID="8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43" Sep 08 06:44:38.797323 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.797309 2581 scope.go:117] "RemoveContainer" containerID="9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a" Sep 08 06:44:38.805204 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.805189 2581 scope.go:117] "RemoveContainer" containerID="9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed" Sep 08 06:44:38.812225 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.812193 2581 scope.go:117] "RemoveContainer" containerID="9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4" Sep 08 06:44:38.814698 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.814678 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42"] Sep 08 06:44:38.818303 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.818284 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-jll42"] Sep 08 06:44:38.820767 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.820746 2581 scope.go:117] "RemoveContainer" containerID="c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49" Sep 08 06:44:38.827680 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.827666 2581 scope.go:117] "RemoveContainer" containerID="7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396" Sep 08 06:44:38.836337 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.836319 2581 scope.go:117] "RemoveContainer" containerID="8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43" Sep 08 06:44:38.836618 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:44:38.836602 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43\": container with ID starting with 8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43 not found: ID does not exist" containerID="8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43" Sep 08 06:44:38.836681 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.836640 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43"} err="failed to get container status \"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43\": rpc error: code = NotFound desc = could not find container \"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43\": container with ID starting with 8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43 not found: ID does not exist" Sep 08 06:44:38.836681 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.836660 2581 scope.go:117] "RemoveContainer" containerID="9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a" Sep 08 06:44:38.836929 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:44:38.836914 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a\": container with ID starting with 9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a not found: ID does not exist" containerID="9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a" Sep 08 06:44:38.836973 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.836933 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a"} err="failed to get container status \"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a\": rpc error: code = NotFound desc = could not find container \"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a\": container with ID starting with 9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a not found: ID does not exist" Sep 08 06:44:38.836973 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.836948 2581 scope.go:117] "RemoveContainer" containerID="9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed" Sep 08 06:44:38.837215 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:44:38.837195 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed\": container with ID starting with 9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed not found: ID does not exist" containerID="9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed" Sep 08 06:44:38.837270 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.837220 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed"} err="failed to get container status \"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed\": rpc error: code = NotFound desc = could not find container \"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed\": container with ID starting with 9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed not found: ID does not exist" Sep 08 06:44:38.837270 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.837234 2581 scope.go:117] "RemoveContainer" containerID="9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4" Sep 08 06:44:38.837460 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:44:38.837445 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4\": container with ID starting with 9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4 not found: ID does not exist" containerID="9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4" Sep 08 06:44:38.837498 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.837463 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4"} err="failed to get container status \"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4\": rpc error: code = NotFound desc = could not find container \"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4\": container with ID starting with 9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4 not found: ID does not exist" Sep 08 06:44:38.837498 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.837475 2581 scope.go:117] "RemoveContainer" containerID="c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49" Sep 08 06:44:38.837751 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:44:38.837720 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49\": container with ID starting with c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49 not found: ID does not exist" containerID="c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49" Sep 08 06:44:38.837808 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.837757 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49"} err="failed to get container status \"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49\": rpc error: code = NotFound desc = could not find container \"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49\": container with ID starting with c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49 not found: ID does not exist" Sep 08 06:44:38.837808 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.837776 2581 scope.go:117] "RemoveContainer" containerID="7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396" Sep 08 06:44:38.838054 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:44:38.838038 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396\": container with ID starting with 7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396 not found: ID does not exist" containerID="7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396" Sep 08 06:44:38.838099 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.838059 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396"} err="failed to get container status \"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396\": rpc error: code = NotFound desc = could not find container \"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396\": container with ID starting with 7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396 not found: ID does not exist" Sep 08 06:44:38.838099 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.838073 2581 scope.go:117] "RemoveContainer" containerID="8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43" Sep 08 06:44:38.838295 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.838278 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43"} err="failed to get container status \"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43\": rpc error: code = NotFound desc = could not find container \"8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43\": container with ID starting with 8134e106db9aa66dba2b574d407eb73f7ff9a89a4cd2d0800042b5031f500c43 not found: ID does not exist" Sep 08 06:44:38.838341 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.838295 2581 scope.go:117] "RemoveContainer" containerID="9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a" Sep 08 06:44:38.838530 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.838511 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a"} err="failed to get container status \"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a\": rpc error: code = NotFound desc = could not find container \"9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a\": container with ID starting with 9d4b4d7c4013fce38a89ca7b3f416dfe29d585edd69701390dd44cd29437154a not found: ID does not exist" Sep 08 06:44:38.838577 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.838529 2581 scope.go:117] "RemoveContainer" containerID="9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed" Sep 08 06:44:38.838818 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.838796 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed"} err="failed to get container status \"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed\": rpc error: code = NotFound desc = could not find container \"9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed\": container with ID starting with 9affc4f7176b43b3698966fc417aefab22831f356c43223c2fa6d6e0320b00ed not found: ID does not exist" Sep 08 06:44:38.838818 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.838818 2581 scope.go:117] "RemoveContainer" containerID="9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4" Sep 08 06:44:38.839046 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.839031 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4"} err="failed to get container status \"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4\": rpc error: code = NotFound desc = could not find container \"9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4\": container with ID starting with 9689105cc2b21d5dbae9704536a9ca49d65079f438cb9db7305f4648af453cb4 not found: ID does not exist" Sep 08 06:44:38.839046 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.839045 2581 scope.go:117] "RemoveContainer" containerID="c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49" Sep 08 06:44:38.839245 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.839231 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49"} err="failed to get container status \"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49\": rpc error: code = NotFound desc = could not find container \"c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49\": container with ID starting with c2ea76f3095df572652e24b44c87e4ad6b0597dbfb2f84bbfceb6b0e1a1c8e49 not found: ID does not exist" Sep 08 06:44:38.839286 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.839245 2581 scope.go:117] "RemoveContainer" containerID="7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396" Sep 08 06:44:38.839415 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:38.839401 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396"} err="failed to get container status \"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396\": rpc error: code = NotFound desc = could not find container \"7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396\": container with ID starting with 7b40311a24d42ca4bb04cf619fa870b69cf21ae01766b7e1567cdf6793347396 not found: ID does not exist" Sep 08 06:44:39.533395 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:39.533363 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" path="/var/lib/kubelet/pods/483d88ab-20ac-4839-ab73-0d28fe87f505/volumes" Sep 08 06:44:52.964722 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:52.964691 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:44:53.495036 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:53.495001 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:44:53.495787 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:44:53.495765 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:45:32.726194 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:32.726115 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:45:32.826884 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:32.826850 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:45:33.192134 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.192098 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:45:33.269803 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.269764 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48"] Sep 08 06:45:33.270087 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270073 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" Sep 08 06:45:33.270130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270093 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" Sep 08 06:45:33.270130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270105 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" Sep 08 06:45:33.270130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270110 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" Sep 08 06:45:33.270130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270121 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="registry" Sep 08 06:45:33.270130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270127 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="registry" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270134 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="offline" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270139 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="offline" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270147 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="feast-apply" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270151 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="feast-apply" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270159 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="feast-init" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270167 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="feast-init" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270226 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="registry" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270232 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="offline" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270237 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="ui" Sep 08 06:45:33.270279 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.270246 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="483d88ab-20ac-4839-ab73-0d28fe87f505" containerName="online" Sep 08 06:45:33.273785 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.273768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.276720 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.276681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 08 06:45:33.276720 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.276710 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 08 06:45:33.276946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.276770 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-xb5pf\"" Sep 08 06:45:33.276946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.276681 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 08 06:45:33.276946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.276828 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 08 06:45:33.276946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.276863 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 08 06:45:33.276946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.276927 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 08 06:45:33.277243 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.276682 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 08 06:45:33.289874 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.289852 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48"] Sep 08 06:45:33.300173 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.300153 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:45:33.373810 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.373783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-ui-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.373966 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.373823 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-offline-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.373966 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.373842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-online-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.373966 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.373938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-registry-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.374066 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.373965 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrv4s\" (UniqueName: \"kubernetes.io/projected/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-kube-api-access-xrv4s\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.374066 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.374008 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-feast-data\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.391836 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.391790 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:45:33.475364 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.475276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-registry-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.475364 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.475319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrv4s\" (UniqueName: \"kubernetes.io/projected/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-kube-api-access-xrv4s\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.475364 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.475359 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-feast-data\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.475675 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.475399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-ui-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.475675 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.475424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-offline-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.475675 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.475439 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-online-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.475970 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.475942 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-feast-data\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.476171 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.476146 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-registry-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.478734 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.478708 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-ui-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.478869 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.478849 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-offline-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.478917 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.478867 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-online-tls\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.486205 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.486173 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrv4s\" (UniqueName: \"kubernetes.io/projected/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-kube-api-access-xrv4s\") pod \"feast-simple-feast-remote-setup-6754cb847c-9qr48\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.501814 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.501784 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:45:33.583540 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.583516 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:45:33.861160 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:33.861139 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48"] Sep 08 06:45:33.863797 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:45:33.863771 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod396c6e16_e3d2_47a4_b0ab_3cd6ba050052.slice/crio-0f821a7443a6f4c5c36ba9f3d14e2600ded720a2931e0ef4cef9047b48e3f321 WatchSource:0}: Error finding container 0f821a7443a6f4c5c36ba9f3d14e2600ded720a2931e0ef4cef9047b48e3f321: Status 404 returned error can't find the container with id 0f821a7443a6f4c5c36ba9f3d14e2600ded720a2931e0ef4cef9047b48e3f321 Sep 08 06:45:34.002438 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:34.002406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerStarted","Data":"e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46"} Sep 08 06:45:34.002565 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:34.002446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerStarted","Data":"0f821a7443a6f4c5c36ba9f3d14e2600ded720a2931e0ef4cef9047b48e3f321"} Sep 08 06:45:39.023462 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:39.023426 2581 generic.go:356] "Generic (PLEG): container finished" podID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerID="e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46" exitCode=0 Sep 08 06:45:39.023883 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:39.023500 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerDied","Data":"e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46"} Sep 08 06:45:40.029412 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:40.029378 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerStarted","Data":"d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7"} Sep 08 06:45:42.007917 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:45:42.007885 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:46:01.115972 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:01.115887 2581 generic.go:356] "Generic (PLEG): container finished" podID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerID="d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7" exitCode=0 Sep 08 06:46:01.115972 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:01.115942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerDied","Data":"d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7"} Sep 08 06:46:01.120970 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:01.120946 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 08 06:46:02.127334 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:02.127293 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerStarted","Data":"e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295"} Sep 08 06:46:02.127845 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:02.127345 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerStarted","Data":"a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc"} Sep 08 06:46:02.127845 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:02.127358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerStarted","Data":"86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd"} Sep 08 06:46:02.158498 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:02.158441 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podStartSLOduration=29.158423483 podStartE2EDuration="29.158423483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:46:02.156273813 +0000 UTC m=+669.106671658" watchObservedRunningTime="2026-09-08 06:46:02.158423483 +0000 UTC m=+669.108821325" Sep 08 06:46:03.584357 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.584301 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:03.584955 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.584454 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:03.584955 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.584496 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:03.584955 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.584516 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:03.584955 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.584533 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:03.584955 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.584548 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:03.586335 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.586298 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 06:46:03.586478 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.586331 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused" Sep 08 06:46:03.586478 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:03.586358 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 06:46:06.584320 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:06.584273 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 06:46:06.584792 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:06.584266 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused" Sep 08 06:46:06.584792 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:06.584284 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 06:46:09.584898 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:09.584870 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:09.585361 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:09.584984 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:09.585821 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:09.585800 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:09.585928 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:09.585854 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:09.605864 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:09.605838 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:10.185978 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:10.185948 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:46:10.416403 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:46:10.416372 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:47:11.606792 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.606758 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48"] Sep 08 06:47:11.607307 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.606974 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" containerID="cri-o://86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd" gracePeriod=30 Sep 08 06:47:11.607307 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.607041 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="offline" containerID="cri-o://a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc" gracePeriod=30 Sep 08 06:47:11.607307 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.607030 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" containerID="cri-o://e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295" gracePeriod=30 Sep 08 06:47:11.698418 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.698384 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:47:11.714164 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.714130 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx"] Sep 08 06:47:11.714458 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.714432 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="registry" containerID="cri-o://465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea" gracePeriod=30 Sep 08 06:47:11.714571 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.714537 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" containerID="cri-o://5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0" gracePeriod=30 Sep 08 06:47:11.714664 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.714519 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" containerID="cri-o://2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f" gracePeriod=30 Sep 08 06:47:11.714761 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:11.714520 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="offline" containerID="cri-o://f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5" gracePeriod=30 Sep 08 06:47:13.414012 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.413980 2581 generic.go:356] "Generic (PLEG): container finished" podID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerID="e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295" exitCode=0 Sep 08 06:47:13.414012 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.414006 2581 generic.go:356] "Generic (PLEG): container finished" podID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerID="86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd" exitCode=0 Sep 08 06:47:13.414442 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.414053 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerDied","Data":"e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295"} Sep 08 06:47:13.414442 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.414097 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerDied","Data":"86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd"} Sep 08 06:47:13.417035 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.417011 2581 generic.go:356] "Generic (PLEG): container finished" podID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerID="5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0" exitCode=0 Sep 08 06:47:13.417035 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.417032 2581 generic.go:356] "Generic (PLEG): container finished" podID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerID="2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f" exitCode=0 Sep 08 06:47:13.417173 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.417059 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerDied","Data":"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0"} Sep 08 06:47:13.417173 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.417085 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerDied","Data":"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f"} Sep 08 06:47:13.715444 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:13.715358 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:47:16.865108 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:16.865074 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:47:19.586333 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:19.586275 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 06:47:20.168512 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:20.168469 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 06:47:20.756821 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:20.756778 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Sep 08 06:47:20.757203 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:20.756819 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Sep 08 06:47:29.585557 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:29.585517 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 06:47:30.168584 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:30.168539 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 06:47:30.756862 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:30.756815 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Sep 08 06:47:30.757282 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:30.756956 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Sep 08 06:47:39.586187 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:39.586142 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused" Sep 08 06:47:39.586586 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:39.586254 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:47:40.168108 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:40.168069 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused" Sep 08 06:47:40.168302 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:40.168200 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:47:40.757611 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:40.757563 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused" Sep 08 06:47:40.758102 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:40.757668 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused" Sep 08 06:47:40.758102 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:40.757725 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:47:40.758102 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:40.757786 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:47:41.827808 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.827789 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:47:41.862841 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.862774 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-ui-tls\") pod \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " Sep 08 06:47:41.862841 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.862805 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-offline-tls\") pod \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " Sep 08 06:47:41.862841 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.862832 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-registry-tls\") pod \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " Sep 08 06:47:41.863055 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.862848 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrv4s\" (UniqueName: \"kubernetes.io/projected/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-kube-api-access-xrv4s\") pod \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " Sep 08 06:47:41.863055 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.862891 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-online-tls\") pod \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " Sep 08 06:47:41.863055 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.862925 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-feast-data\") pod \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\" (UID: \"396c6e16-e3d2-47a4-b0ab-3cd6ba050052\") " Sep 08 06:47:41.863219 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.863172 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "396c6e16-e3d2-47a4-b0ab-3cd6ba050052" (UID: "396c6e16-e3d2-47a4-b0ab-3cd6ba050052"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 06:47:41.863534 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.863498 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-feast-data" (OuterVolumeSpecName: "feast-data") pod "396c6e16-e3d2-47a4-b0ab-3cd6ba050052" (UID: "396c6e16-e3d2-47a4-b0ab-3cd6ba050052"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:47:41.865154 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.865122 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "396c6e16-e3d2-47a4-b0ab-3cd6ba050052" (UID: "396c6e16-e3d2-47a4-b0ab-3cd6ba050052"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:47:41.865293 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.865269 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-online-tls" (OuterVolumeSpecName: "online-tls") pod "396c6e16-e3d2-47a4-b0ab-3cd6ba050052" (UID: "396c6e16-e3d2-47a4-b0ab-3cd6ba050052"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:47:41.865509 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.865485 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-kube-api-access-xrv4s" (OuterVolumeSpecName: "kube-api-access-xrv4s") pod "396c6e16-e3d2-47a4-b0ab-3cd6ba050052" (UID: "396c6e16-e3d2-47a4-b0ab-3cd6ba050052"). InnerVolumeSpecName "kube-api-access-xrv4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:47:41.865567 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.865512 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "396c6e16-e3d2-47a4-b0ab-3cd6ba050052" (UID: "396c6e16-e3d2-47a4-b0ab-3cd6ba050052"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:47:41.964486 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.964454 2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-ui-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:41.964590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.964489 2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-offline-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:41.964590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.964506 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-registry-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:41.964590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.964523 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrv4s\" (UniqueName: \"kubernetes.io/projected/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-kube-api-access-xrv4s\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:41.964590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.964537 2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-online-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:41.964590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:41.964553 2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/396c6e16-e3d2-47a4-b0ab-3cd6ba050052-feast-data\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:42.353463 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.353439 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:47:42.466718 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.466679 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-registry-tls\") pod \"2785dd38-330d-44ba-8bd3-99604d0a8415\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " Sep 08 06:47:42.466718 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.466724 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-ui-tls\") pod \"2785dd38-330d-44ba-8bd3-99604d0a8415\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " Sep 08 06:47:42.466947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.466750 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls\") pod \"2785dd38-330d-44ba-8bd3-99604d0a8415\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " Sep 08 06:47:42.466947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.466783 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2ht9\" (UniqueName: \"kubernetes.io/projected/2785dd38-330d-44ba-8bd3-99604d0a8415-kube-api-access-z2ht9\") pod \"2785dd38-330d-44ba-8bd3-99604d0a8415\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " Sep 08 06:47:42.466947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.466823 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2785dd38-330d-44ba-8bd3-99604d0a8415-feast-data\") pod \"2785dd38-330d-44ba-8bd3-99604d0a8415\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " Sep 08 06:47:42.466947 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.466843 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-offline-tls\") pod \"2785dd38-330d-44ba-8bd3-99604d0a8415\" (UID: \"2785dd38-330d-44ba-8bd3-99604d0a8415\") " Sep 08 06:47:42.467375 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.467347 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2785dd38-330d-44ba-8bd3-99604d0a8415-feast-data" (OuterVolumeSpecName: "feast-data") pod "2785dd38-330d-44ba-8bd3-99604d0a8415" (UID: "2785dd38-330d-44ba-8bd3-99604d0a8415"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:47:42.468988 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.468965 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2785dd38-330d-44ba-8bd3-99604d0a8415" (UID: "2785dd38-330d-44ba-8bd3-99604d0a8415"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:47:42.469396 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.469372 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls" (OuterVolumeSpecName: "online-tls") pod "2785dd38-330d-44ba-8bd3-99604d0a8415" (UID: "2785dd38-330d-44ba-8bd3-99604d0a8415"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:47:42.469396 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.469381 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2785dd38-330d-44ba-8bd3-99604d0a8415" (UID: "2785dd38-330d-44ba-8bd3-99604d0a8415"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:47:42.469586 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.469567 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2785dd38-330d-44ba-8bd3-99604d0a8415" (UID: "2785dd38-330d-44ba-8bd3-99604d0a8415"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:47:42.469672 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.469587 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2785dd38-330d-44ba-8bd3-99604d0a8415-kube-api-access-z2ht9" (OuterVolumeSpecName: "kube-api-access-z2ht9") pod "2785dd38-330d-44ba-8bd3-99604d0a8415" (UID: "2785dd38-330d-44ba-8bd3-99604d0a8415"). InnerVolumeSpecName "kube-api-access-z2ht9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:47:42.532688 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.532657 2581 generic.go:356] "Generic (PLEG): container finished" podID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerID="a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc" exitCode=137 Sep 08 06:47:42.532844 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.532708 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" Sep 08 06:47:42.532844 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.532746 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerDied","Data":"a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc"} Sep 08 06:47:42.532844 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.532785 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48" event={"ID":"396c6e16-e3d2-47a4-b0ab-3cd6ba050052","Type":"ContainerDied","Data":"0f821a7443a6f4c5c36ba9f3d14e2600ded720a2931e0ef4cef9047b48e3f321"} Sep 08 06:47:42.532844 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.532805 2581 scope.go:117] "RemoveContainer" containerID="e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295" Sep 08 06:47:42.536096 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.536071 2581 generic.go:356] "Generic (PLEG): container finished" podID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerID="f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5" exitCode=137 Sep 08 06:47:42.536223 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.536098 2581 generic.go:356] "Generic (PLEG): container finished" podID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerID="465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea" exitCode=137 Sep 08 06:47:42.536223 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.536127 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerDied","Data":"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5"} Sep 08 06:47:42.536223 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.536185 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerDied","Data":"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea"} Sep 08 06:47:42.536223 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.536128 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" Sep 08 06:47:42.536395 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.536216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx" event={"ID":"2785dd38-330d-44ba-8bd3-99604d0a8415","Type":"ContainerDied","Data":"e50f759d4f5a43a14ac6e38457ed139ad33792d0d85cc00db6e41a0610afacfb"} Sep 08 06:47:42.542060 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.541980 2581 scope.go:117] "RemoveContainer" containerID="a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc" Sep 08 06:47:42.550092 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.550076 2581 scope.go:117] "RemoveContainer" containerID="86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd" Sep 08 06:47:42.557906 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.557887 2581 scope.go:117] "RemoveContainer" containerID="d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7" Sep 08 06:47:42.558086 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.558068 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48"] Sep 08 06:47:42.562608 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.562590 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-6754cb847c-9qr48"] Sep 08 06:47:42.565408 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.565394 2581 scope.go:117] "RemoveContainer" containerID="e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46" Sep 08 06:47:42.567621 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.567600 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-registry-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:42.567768 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.567731 2581 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-ui-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:42.567768 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.567752 2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-online-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:42.567768 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.567765 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2ht9\" (UniqueName: \"kubernetes.io/projected/2785dd38-330d-44ba-8bd3-99604d0a8415-kube-api-access-z2ht9\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:42.567874 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.567778 2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2785dd38-330d-44ba-8bd3-99604d0a8415-feast-data\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:42.567874 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.567791 2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2785dd38-330d-44ba-8bd3-99604d0a8415-offline-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:47:42.572492 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.572470 2581 scope.go:117] "RemoveContainer" containerID="e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295" Sep 08 06:47:42.572917 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.572846 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295\": container with ID starting with e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295 not found: ID does not exist" containerID="e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295" Sep 08 06:47:42.572917 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.572877 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295"} err="failed to get container status \"e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295\": rpc error: code = NotFound desc = could not find container \"e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295\": container with ID starting with e549c12e3e7d5418b3eb9069a475fcf04c14e4c9f193cebb053a835ce8f16295 not found: ID does not exist" Sep 08 06:47:42.572917 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.572897 2581 scope.go:117] "RemoveContainer" containerID="a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc" Sep 08 06:47:42.573220 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.573200 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc\": container with ID starting with a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc not found: ID does not exist" containerID="a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc" Sep 08 06:47:42.573298 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.573227 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc"} err="failed to get container status \"a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc\": rpc error: code = NotFound desc = could not find container \"a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc\": container with ID starting with a1af9ffd015fce57a1d46a2a6a6593a621e3afc21e4b9900ba950b1eecbf5ebc not found: ID does not exist" Sep 08 06:47:42.573298 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.573250 2581 scope.go:117] "RemoveContainer" containerID="86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd" Sep 08 06:47:42.573520 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.573504 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd\": container with ID starting with 86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd not found: ID does not exist" containerID="86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd" Sep 08 06:47:42.573580 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.573527 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd"} err="failed to get container status \"86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd\": rpc error: code = NotFound desc = could not find container \"86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd\": container with ID starting with 86dcc5a2740319ad414eaa61d4eddefd7ae0c1f209998913a7ba1ab859ee07dd not found: ID does not exist" Sep 08 06:47:42.573580 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.573546 2581 scope.go:117] "RemoveContainer" containerID="d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7" Sep 08 06:47:42.573842 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.573826 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7\": container with ID starting with d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7 not found: ID does not exist" containerID="d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7" Sep 08 06:47:42.573908 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.573850 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7"} err="failed to get container status \"d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7\": rpc error: code = NotFound desc = could not find container \"d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7\": container with ID starting with d88bc8d42abdee6dd282a11af7550d4965a121b7813d02d9c8dfe3b70240e6b7 not found: ID does not exist" Sep 08 06:47:42.573908 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.573871 2581 scope.go:117] "RemoveContainer" containerID="e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46" Sep 08 06:47:42.574159 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.574143 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46\": container with ID starting with e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46 not found: ID does not exist" containerID="e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46" Sep 08 06:47:42.574231 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.574189 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46"} err="failed to get container status \"e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46\": rpc error: code = NotFound desc = could not find container \"e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46\": container with ID starting with e1e273e4ad5e7956374253ea86b782b680b9e9b643af5a0a4515e179927e3e46 not found: ID does not exist" Sep 08 06:47:42.574231 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.574210 2581 scope.go:117] "RemoveContainer" containerID="5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0" Sep 08 06:47:42.574500 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.574482 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx"] Sep 08 06:47:42.578792 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.578773 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-74846d5c55-452gx"] Sep 08 06:47:42.581732 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.581616 2581 scope.go:117] "RemoveContainer" containerID="f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5" Sep 08 06:47:42.588768 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.588731 2581 scope.go:117] "RemoveContainer" containerID="2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f" Sep 08 06:47:42.595537 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.595496 2581 scope.go:117] "RemoveContainer" containerID="465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea" Sep 08 06:47:42.602525 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.602477 2581 scope.go:117] "RemoveContainer" containerID="c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330" Sep 08 06:47:42.609316 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.609299 2581 scope.go:117] "RemoveContainer" containerID="e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5" Sep 08 06:47:42.616250 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.616035 2581 scope.go:117] "RemoveContainer" containerID="5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0" Sep 08 06:47:42.616326 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.616298 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0\": container with ID starting with 5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0 not found: ID does not exist" containerID="5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0" Sep 08 06:47:42.616378 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.616318 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0"} err="failed to get container status \"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0\": rpc error: code = NotFound desc = could not find container \"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0\": container with ID starting with 5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0 not found: ID does not exist" Sep 08 06:47:42.616378 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.616335 2581 scope.go:117] "RemoveContainer" containerID="f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5" Sep 08 06:47:42.616582 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.616564 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5\": container with ID starting with f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5 not found: ID does not exist" containerID="f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5" Sep 08 06:47:42.616625 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.616587 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5"} err="failed to get container status \"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5\": rpc error: code = NotFound desc = could not find container \"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5\": container with ID starting with f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5 not found: ID does not exist" Sep 08 06:47:42.616625 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.616602 2581 scope.go:117] "RemoveContainer" containerID="2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f" Sep 08 06:47:42.616875 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.616854 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f\": container with ID starting with 2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f not found: ID does not exist" containerID="2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f" Sep 08 06:47:42.616951 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.616881 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f"} err="failed to get container status \"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f\": rpc error: code = NotFound desc = could not find container \"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f\": container with ID starting with 2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f not found: ID does not exist" Sep 08 06:47:42.616951 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.616900 2581 scope.go:117] "RemoveContainer" containerID="465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea" Sep 08 06:47:42.617184 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.617165 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea\": container with ID starting with 465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea not found: ID does not exist" containerID="465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea" Sep 08 06:47:42.617225 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.617188 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea"} err="failed to get container status \"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea\": rpc error: code = NotFound desc = could not find container \"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea\": container with ID starting with 465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea not found: ID does not exist" Sep 08 06:47:42.617225 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.617201 2581 scope.go:117] "RemoveContainer" containerID="c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330" Sep 08 06:47:42.617449 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.617433 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330\": container with ID starting with c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330 not found: ID does not exist" containerID="c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330" Sep 08 06:47:42.617505 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.617454 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330"} err="failed to get container status \"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330\": rpc error: code = NotFound desc = could not find container \"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330\": container with ID starting with c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330 not found: ID does not exist" Sep 08 06:47:42.617505 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.617467 2581 scope.go:117] "RemoveContainer" containerID="e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5" Sep 08 06:47:42.617733 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:47:42.617717 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5\": container with ID starting with e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5 not found: ID does not exist" containerID="e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5" Sep 08 06:47:42.617788 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.617736 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5"} err="failed to get container status \"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5\": rpc error: code = NotFound desc = could not find container \"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5\": container with ID starting with e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5 not found: ID does not exist" Sep 08 06:47:42.617788 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.617749 2581 scope.go:117] "RemoveContainer" containerID="5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0" Sep 08 06:47:42.617988 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.617969 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0"} err="failed to get container status \"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0\": rpc error: code = NotFound desc = could not find container \"5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0\": container with ID starting with 5f4fa8eadf4c3f23ef9f5493ed14d8ab43b2ab2192f19b5a48aa722d6f16b4e0 not found: ID does not exist" Sep 08 06:47:42.618037 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.617989 2581 scope.go:117] "RemoveContainer" containerID="f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5" Sep 08 06:47:42.618199 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.618180 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5"} err="failed to get container status \"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5\": rpc error: code = NotFound desc = could not find container \"f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5\": container with ID starting with f295b7eb8c57feb778384e34961918f4de0b421533b739fa15a696ce655d27d5 not found: ID does not exist" Sep 08 06:47:42.618247 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.618199 2581 scope.go:117] "RemoveContainer" containerID="2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f" Sep 08 06:47:42.618421 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.618407 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f"} err="failed to get container status \"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f\": rpc error: code = NotFound desc = could not find container \"2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f\": container with ID starting with 2fec11cf47a519dfae0d499e17f23432bcca90fe46cbab49877e26c50b23c96f not found: ID does not exist" Sep 08 06:47:42.618421 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.618420 2581 scope.go:117] "RemoveContainer" containerID="465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea" Sep 08 06:47:42.618623 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.618604 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea"} err="failed to get container status \"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea\": rpc error: code = NotFound desc = could not find container \"465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea\": container with ID starting with 465ba90d4444f7aa72482a0aa00c52068707f250e5c495bf6a61ebfd845e8bea not found: ID does not exist" Sep 08 06:47:42.618701 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.618668 2581 scope.go:117] "RemoveContainer" containerID="c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330" Sep 08 06:47:42.618933 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.618910 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330"} err="failed to get container status \"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330\": rpc error: code = NotFound desc = could not find container \"c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330\": container with ID starting with c02a1da90a912db2173ed2844ea27e5f811d2257591950f290516a3e28b84330 not found: ID does not exist" Sep 08 06:47:42.618983 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.618935 2581 scope.go:117] "RemoveContainer" containerID="e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5" Sep 08 06:47:42.619151 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:42.619134 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5"} err="failed to get container status \"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5\": rpc error: code = NotFound desc = could not find container \"e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5\": container with ID starting with e58bcaf0af0dea06ac8e513fb221592f031af389538805743a82bde31aa6a5a5 not found: ID does not exist" Sep 08 06:47:43.533968 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:43.533936 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" path="/var/lib/kubelet/pods/2785dd38-330d-44ba-8bd3-99604d0a8415/volumes" Sep 08 06:47:43.534516 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:43.534501 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" path="/var/lib/kubelet/pods/396c6e16-e3d2-47a4-b0ab-3cd6ba050052/volumes" Sep 08 06:47:51.062234 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:51.062197 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:47:54.305333 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.305295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:47:54.487165 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487134 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-tzpsm"] Sep 08 06:47:54.487462 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487447 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="feast-init" Sep 08 06:47:54.487462 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487462 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="feast-init" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487472 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="feast-apply" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487478 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="feast-apply" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487485 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="offline" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487491 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="offline" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487498 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487503 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487511 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487516 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487523 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="offline" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487528 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="offline" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487533 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487538 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487545 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="feast-init" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487549 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="feast-init" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487554 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" Sep 08 06:47:54.487553 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487559 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487566 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="registry" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487571 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="registry" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487577 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="feast-apply" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487581 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="feast-apply" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487624 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="offline" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487652 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="registry" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487657 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="ui" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487663 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="ui" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487670 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="offline" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487676 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="396c6e16-e3d2-47a4-b0ab-3cd6ba050052" containerName="online" Sep 08 06:47:54.488094 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.487681 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2785dd38-330d-44ba-8bd3-99604d0a8415" containerName="online" Sep 08 06:47:54.491609 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.491594 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:47:54.494180 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.494107 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-sch28\"" Sep 08 06:47:54.494180 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.494154 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 08 06:47:54.494379 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.494250 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 08 06:47:54.495335 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.495315 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 08 06:47:54.498313 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.498294 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-tzpsm"] Sep 08 06:47:54.519810 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.519780 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-66w4l"] Sep 08 06:47:54.522466 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.522449 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-66w4l" Sep 08 06:47:54.526857 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.526825 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-66w4l"] Sep 08 06:47:54.526969 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.526828 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:47:54.548552 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.548524 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brftj\" (UniqueName: \"kubernetes.io/projected/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-kube-api-access-brftj\") pod \"postgres-864846d4f5-tzpsm\" (UID: \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\") " pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:47:54.548670 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.548555 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-postgresdata\") pod \"postgres-864846d4f5-tzpsm\" (UID: \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\") " pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:47:54.583699 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.583644 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:47:54.649889 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.649869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brftj\" (UniqueName: \"kubernetes.io/projected/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-kube-api-access-brftj\") pod \"postgres-864846d4f5-tzpsm\" (UID: \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\") " pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:47:54.649987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.649897 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-postgresdata\") pod \"postgres-864846d4f5-tzpsm\" (UID: \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\") " pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:47:54.649987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.649919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtt22\" (UniqueName: \"kubernetes.io/projected/5bcc0373-01b8-4797-9e1c-74b49590b72f-kube-api-access-xtt22\") pod \"redis-69bbd798b6-66w4l\" (UID: \"5bcc0373-01b8-4797-9e1c-74b49590b72f\") " pod="test-ns-feast/redis-69bbd798b6-66w4l" Sep 08 06:47:54.650265 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.650246 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-postgresdata\") pod \"postgres-864846d4f5-tzpsm\" (UID: \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\") " pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:47:54.660456 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.660437 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brftj\" (UniqueName: \"kubernetes.io/projected/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-kube-api-access-brftj\") pod \"postgres-864846d4f5-tzpsm\" (UID: \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\") " pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:47:54.750697 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.750671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtt22\" (UniqueName: \"kubernetes.io/projected/5bcc0373-01b8-4797-9e1c-74b49590b72f-kube-api-access-xtt22\") pod \"redis-69bbd798b6-66w4l\" (UID: \"5bcc0373-01b8-4797-9e1c-74b49590b72f\") " pod="test-ns-feast/redis-69bbd798b6-66w4l" Sep 08 06:47:54.759974 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.759954 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtt22\" (UniqueName: \"kubernetes.io/projected/5bcc0373-01b8-4797-9e1c-74b49590b72f-kube-api-access-xtt22\") pod \"redis-69bbd798b6-66w4l\" (UID: \"5bcc0373-01b8-4797-9e1c-74b49590b72f\") " pod="test-ns-feast/redis-69bbd798b6-66w4l" Sep 08 06:47:54.802274 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.802254 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:47:54.833243 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:54.833221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-66w4l" Sep 08 06:47:55.071266 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:55.071238 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-tzpsm"] Sep 08 06:47:55.074870 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:47:55.074847 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod773457a4_c0f3_4c5f_a39a_bc8c56f9fafb.slice/crio-359c0dafaef68c8870fa0c767ed4c0edb437f7b90a35db9f90ce17e659171a22 WatchSource:0}: Error finding container 359c0dafaef68c8870fa0c767ed4c0edb437f7b90a35db9f90ce17e659171a22: Status 404 returned error can't find the container with id 359c0dafaef68c8870fa0c767ed4c0edb437f7b90a35db9f90ce17e659171a22 Sep 08 06:47:55.076623 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:55.076607 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 06:47:55.105897 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:55.105855 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-66w4l"] Sep 08 06:47:55.108100 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:47:55.108078 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bcc0373_01b8_4797_9e1c_74b49590b72f.slice/crio-c53a78b514cff4d26f8303d75d9d2e686461d0135b90f27f65a902a26f82511f WatchSource:0}: Error finding container c53a78b514cff4d26f8303d75d9d2e686461d0135b90f27f65a902a26f82511f: Status 404 returned error can't find the container with id c53a78b514cff4d26f8303d75d9d2e686461d0135b90f27f65a902a26f82511f Sep 08 06:47:55.585270 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:55.585234 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-66w4l" event={"ID":"5bcc0373-01b8-4797-9e1c-74b49590b72f","Type":"ContainerStarted","Data":"c53a78b514cff4d26f8303d75d9d2e686461d0135b90f27f65a902a26f82511f"} Sep 08 06:47:55.586232 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:55.586215 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-tzpsm" event={"ID":"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb","Type":"ContainerStarted","Data":"359c0dafaef68c8870fa0c767ed4c0edb437f7b90a35db9f90ce17e659171a22"} Sep 08 06:47:57.596381 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:57.596344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-66w4l" event={"ID":"5bcc0373-01b8-4797-9e1c-74b49590b72f","Type":"ContainerStarted","Data":"28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12"} Sep 08 06:47:57.612434 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:47:57.612387 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-66w4l" podStartSLOduration=1.737179377 podStartE2EDuration="3.612373981s" totalImagesPullingTime="1.875194604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:47:57.611561217 +0000 UTC m=+784.561959072" watchObservedRunningTime="2026-09-08 06:47:57.612373981 +0000 UTC m=+784.562771824" Sep 08 06:48:00.609611 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:00.609583 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-tzpsm" event={"ID":"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb","Type":"ContainerStarted","Data":"b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc"} Sep 08 06:48:00.625106 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:00.625033 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-tzpsm" podStartSLOduration=1.177334141 podStartE2EDuration="6.625014688s" totalImagesPullingTime="5.447680547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:48:00.624496812 +0000 UTC m=+787.574894667" watchObservedRunningTime="2026-09-08 06:48:00.625014688 +0000 UTC m=+787.575412532" Sep 08 06:48:05.224651 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.224600 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:48:05.328591 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.328552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:48:05.332822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.332785 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq"] Sep 08 06:48:05.338430 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.338412 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.341126 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.341106 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 08 06:48:05.341326 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.341298 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 08 06:48:05.341477 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.341462 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-w5dcq\"" Sep 08 06:48:05.341552 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.341478 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 08 06:48:05.341552 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.341533 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 08 06:48:05.350213 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.350192 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq"] Sep 08 06:48:05.417778 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.417750 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:48:05.431951 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.431926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-registry-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.432056 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.431961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bb4z\" (UniqueName: \"kubernetes.io/projected/41acd668-a6cf-443f-9fd8-bc3a36afd26a-kube-api-access-7bb4z\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.432056 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.431988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-online-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.432140 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.432068 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.432140 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.432126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/41acd668-a6cf-443f-9fd8-bc3a36afd26a-feast-data\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.520088 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.520060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:48:05.537029 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.537000 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/41acd668-a6cf-443f-9fd8-bc3a36afd26a-feast-data\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.537191 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.537056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-registry-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.537191 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.537100 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bb4z\" (UniqueName: \"kubernetes.io/projected/41acd668-a6cf-443f-9fd8-bc3a36afd26a-kube-api-access-7bb4z\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.537191 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.537148 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-online-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.537347 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.537193 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.537347 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:48:05.537310 2581 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found Sep 08 06:48:05.537453 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:48:05.537369 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls podName:41acd668-a6cf-443f-9fd8-bc3a36afd26a nodeName:}" failed. No retries permitted until 2026-09-08 06:48:06.037348121 +0000 UTC m=+792.987745956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls") pod "feast-credit-scoring-6fc7cf98c6-rk6mq" (UID: "41acd668-a6cf-443f-9fd8-bc3a36afd26a") : secret "feast-credit-scoring-offline-tls" not found Sep 08 06:48:05.537513 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.537447 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/41acd668-a6cf-443f-9fd8-bc3a36afd26a-feast-data\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.539667 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.539618 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-registry-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.539761 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.539692 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-online-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:05.545735 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:05.545717 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bb4z\" (UniqueName: \"kubernetes.io/projected/41acd668-a6cf-443f-9fd8-bc3a36afd26a-kube-api-access-7bb4z\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:06.040391 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:06.040355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:06.040547 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:48:06.040513 2581 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-offline-tls: secret "feast-credit-scoring-offline-tls" not found Sep 08 06:48:06.040599 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:48:06.040594 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls podName:41acd668-a6cf-443f-9fd8-bc3a36afd26a nodeName:}" failed. No retries permitted until 2026-09-08 06:48:07.040577214 +0000 UTC m=+793.990975039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls") pod "feast-credit-scoring-6fc7cf98c6-rk6mq" (UID: "41acd668-a6cf-443f-9fd8-bc3a36afd26a") : secret "feast-credit-scoring-offline-tls" not found Sep 08 06:48:06.173603 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:06.173567 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:48:07.046209 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:07.046180 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:07.048592 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:07.048569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls\") pod \"feast-credit-scoring-6fc7cf98c6-rk6mq\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:07.147097 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:07.147070 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:07.425792 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:07.425771 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq"] Sep 08 06:48:07.427123 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:48:07.427094 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41acd668_a6cf_443f_9fd8_bc3a36afd26a.slice/crio-85ebf417b05eecab4b7d9da10f5d80b855b776f96884960f36cf2001ecc23941 WatchSource:0}: Error finding container 85ebf417b05eecab4b7d9da10f5d80b855b776f96884960f36cf2001ecc23941: Status 404 returned error can't find the container with id 85ebf417b05eecab4b7d9da10f5d80b855b776f96884960f36cf2001ecc23941 Sep 08 06:48:07.639820 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:07.639791 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerStarted","Data":"7da5a5b5846fee851562a0298a248269900b16263fec6be5c4175c6323466c0a"} Sep 08 06:48:07.639963 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:07.639845 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerStarted","Data":"85ebf417b05eecab4b7d9da10f5d80b855b776f96884960f36cf2001ecc23941"} Sep 08 06:48:09.649191 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:09.649157 2581 generic.go:356] "Generic (PLEG): container finished" podID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerID="7da5a5b5846fee851562a0298a248269900b16263fec6be5c4175c6323466c0a" exitCode=0 Sep 08 06:48:09.649549 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:09.649230 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerDied","Data":"7da5a5b5846fee851562a0298a248269900b16263fec6be5c4175c6323466c0a"} Sep 08 06:48:10.655346 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:10.655312 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerStarted","Data":"1b4422307068c45ab840f825c4494b9bd703cf7ef5cbd7f50aaa9c46d616dae8"} Sep 08 06:48:16.681374 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:16.681287 2581 generic.go:356] "Generic (PLEG): container finished" podID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerID="1b4422307068c45ab840f825c4494b9bd703cf7ef5cbd7f50aaa9c46d616dae8" exitCode=0 Sep 08 06:48:16.681374 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:16.681363 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerDied","Data":"1b4422307068c45ab840f825c4494b9bd703cf7ef5cbd7f50aaa9c46d616dae8"} Sep 08 06:48:17.690585 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:17.690538 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerStarted","Data":"edc77173425a9e4c94fe85bb35683c2ce04ef4aa04260d0f87fcce8e31e68554"} Sep 08 06:48:17.691072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:17.690658 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerStarted","Data":"49c505df36c84622b8f1faf20cb074c3152c2ee18cfda95dcf3225a95d16f215"} Sep 08 06:48:17.691072 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:17.690687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerStarted","Data":"e85508e181fa6c580ff27588c928957a5556cd4f9acdbf76c269bfb6840a7ba3"} Sep 08 06:48:17.716051 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:17.715241 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podStartSLOduration=12.715222269 podStartE2EDuration="12.715222269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:48:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:48:17.714753466 +0000 UTC m=+804.665151310" watchObservedRunningTime="2026-09-08 06:48:17.715222269 +0000 UTC m=+804.665620114" Sep 08 06:48:19.147546 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:19.147507 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:19.148151 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:19.148123 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:19.148270 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:19.148164 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:19.149652 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:19.149598 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused" Sep 08 06:48:19.149652 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:19.149617 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" Sep 08 06:48:19.149835 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:19.149657 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 08 06:48:22.147563 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:22.147508 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.25:8816: connect: connection refused" Sep 08 06:48:22.148196 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:22.147535 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused" Sep 08 06:48:22.148326 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:22.147594 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 08 06:48:25.147726 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:25.147679 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused" Sep 08 06:48:25.148709 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:25.148687 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:25.149167 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:25.149146 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:25.149554 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:25.149538 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:25.155906 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:25.155881 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:25.730677 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:25.730618 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:25.733983 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:25.733955 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:27.147950 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:27.147906 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:28.148328 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:28.148275 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.25:6571: connect: connection refused" Sep 08 06:48:31.147905 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:31.147876 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:31.148647 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:31.148615 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:48:31.576725 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:48:31.576690 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:49:31.703523 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:31.703494 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:49:36.678972 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.678352 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq"] Sep 08 06:49:36.678972 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.678655 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="registry" containerID="cri-o://e85508e181fa6c580ff27588c928957a5556cd4f9acdbf76c269bfb6840a7ba3" gracePeriod=30 Sep 08 06:49:36.679494 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.679040 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" containerID="cri-o://49c505df36c84622b8f1faf20cb074c3152c2ee18cfda95dcf3225a95d16f215" gracePeriod=30 Sep 08 06:49:36.679494 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.679060 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="offline" containerID="cri-o://edc77173425a9e4c94fe85bb35683c2ce04ef4aa04260d0f87fcce8e31e68554" gracePeriod=30 Sep 08 06:49:36.688485 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.688453 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-tzpsm"] Sep 08 06:49:36.688672 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.688623 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-tzpsm" podUID="773457a4-c0f3-4c5f-a39a-bc8c56f9fafb" containerName="postgres" containerID="cri-o://b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc" gracePeriod=30 Sep 08 06:49:36.697687 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.697665 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-66w4l"] Sep 08 06:49:36.697845 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.697826 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-66w4l" podUID="5bcc0373-01b8-4797-9e1c-74b49590b72f" containerName="redis" containerID="cri-o://28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12" gracePeriod=30 Sep 08 06:49:36.811432 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.811397 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:49:36.967849 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.967830 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-66w4l" Sep 08 06:49:36.970447 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:36.970429 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:49:37.015426 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.015384 2581 generic.go:356] "Generic (PLEG): container finished" podID="5bcc0373-01b8-4797-9e1c-74b49590b72f" containerID="28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12" exitCode=0 Sep 08 06:49:37.015613 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.015455 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-66w4l" Sep 08 06:49:37.015613 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.015475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-66w4l" event={"ID":"5bcc0373-01b8-4797-9e1c-74b49590b72f","Type":"ContainerDied","Data":"28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12"} Sep 08 06:49:37.015613 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.015518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-66w4l" event={"ID":"5bcc0373-01b8-4797-9e1c-74b49590b72f","Type":"ContainerDied","Data":"c53a78b514cff4d26f8303d75d9d2e686461d0135b90f27f65a902a26f82511f"} Sep 08 06:49:37.015613 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.015541 2581 scope.go:117] "RemoveContainer" containerID="28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12" Sep 08 06:49:37.017535 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.017511 2581 generic.go:356] "Generic (PLEG): container finished" podID="773457a4-c0f3-4c5f-a39a-bc8c56f9fafb" containerID="b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc" exitCode=0 Sep 08 06:49:37.017679 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.017572 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-tzpsm" Sep 08 06:49:37.017679 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.017597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-tzpsm" event={"ID":"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb","Type":"ContainerDied","Data":"b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc"} Sep 08 06:49:37.017807 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.017686 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-tzpsm" event={"ID":"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb","Type":"ContainerDied","Data":"359c0dafaef68c8870fa0c767ed4c0edb437f7b90a35db9f90ce17e659171a22"} Sep 08 06:49:37.024600 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.024579 2581 scope.go:117] "RemoveContainer" containerID="28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12" Sep 08 06:49:37.024959 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:49:37.024936 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12\": container with ID starting with 28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12 not found: ID does not exist" containerID="28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12" Sep 08 06:49:37.025011 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.024973 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12"} err="failed to get container status \"28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12\": rpc error: code = NotFound desc = could not find container \"28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12\": container with ID starting with 28d50c84a4ede5052e25ec579817c6d69661af1bef478e046cd0d65fe6073c12 not found: ID does not exist" Sep 08 06:49:37.025011 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.024999 2581 scope.go:117] "RemoveContainer" containerID="b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc" Sep 08 06:49:37.033550 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.033533 2581 scope.go:117] "RemoveContainer" containerID="b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc" Sep 08 06:49:37.033865 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:49:37.033839 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc\": container with ID starting with b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc not found: ID does not exist" containerID="b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc" Sep 08 06:49:37.033957 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.033873 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc"} err="failed to get container status \"b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc\": rpc error: code = NotFound desc = could not find container \"b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc\": container with ID starting with b5e00fe3d5984ef1d4dc4b4372d0ddf28e294f65978c3b08ffa185d21e358cbc not found: ID does not exist" Sep 08 06:49:37.057742 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.057716 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtt22\" (UniqueName: \"kubernetes.io/projected/5bcc0373-01b8-4797-9e1c-74b49590b72f-kube-api-access-xtt22\") pod \"5bcc0373-01b8-4797-9e1c-74b49590b72f\" (UID: \"5bcc0373-01b8-4797-9e1c-74b49590b72f\") " Sep 08 06:49:37.057888 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.057757 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-postgresdata\") pod \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\" (UID: \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\") " Sep 08 06:49:37.057888 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.057799 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-brftj\" (UniqueName: \"kubernetes.io/projected/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-kube-api-access-brftj\") pod \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\" (UID: \"773457a4-c0f3-4c5f-a39a-bc8c56f9fafb\") " Sep 08 06:49:37.059862 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.059829 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bcc0373-01b8-4797-9e1c-74b49590b72f-kube-api-access-xtt22" (OuterVolumeSpecName: "kube-api-access-xtt22") pod "5bcc0373-01b8-4797-9e1c-74b49590b72f" (UID: "5bcc0373-01b8-4797-9e1c-74b49590b72f"). InnerVolumeSpecName "kube-api-access-xtt22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:49:37.059985 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.059868 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-kube-api-access-brftj" (OuterVolumeSpecName: "kube-api-access-brftj") pod "773457a4-c0f3-4c5f-a39a-bc8c56f9fafb" (UID: "773457a4-c0f3-4c5f-a39a-bc8c56f9fafb"). InnerVolumeSpecName "kube-api-access-brftj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:49:37.087155 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.087108 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "773457a4-c0f3-4c5f-a39a-bc8c56f9fafb" (UID: "773457a4-c0f3-4c5f-a39a-bc8c56f9fafb"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:49:37.158971 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.158929 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtt22\" (UniqueName: \"kubernetes.io/projected/5bcc0373-01b8-4797-9e1c-74b49590b72f-kube-api-access-xtt22\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:49:37.158971 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.158957 2581 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-postgresdata\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:49:37.158971 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.158969 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brftj\" (UniqueName: \"kubernetes.io/projected/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb-kube-api-access-brftj\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:49:37.344890 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.344852 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-66w4l"] Sep 08 06:49:37.347775 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.347751 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-66w4l"] Sep 08 06:49:37.358343 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.358319 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-tzpsm"] Sep 08 06:49:37.362296 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.362273 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-tzpsm"] Sep 08 06:49:37.533740 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.533706 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bcc0373-01b8-4797-9e1c-74b49590b72f" path="/var/lib/kubelet/pods/5bcc0373-01b8-4797-9e1c-74b49590b72f/volumes" Sep 08 06:49:37.534052 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:37.534040 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="773457a4-c0f3-4c5f-a39a-bc8c56f9fafb" path="/var/lib/kubelet/pods/773457a4-c0f3-4c5f-a39a-bc8c56f9fafb/volumes" Sep 08 06:49:38.023770 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:38.023739 2581 generic.go:356] "Generic (PLEG): container finished" podID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerID="49c505df36c84622b8f1faf20cb074c3152c2ee18cfda95dcf3225a95d16f215" exitCode=0 Sep 08 06:49:38.024093 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:38.023816 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerDied","Data":"49c505df36c84622b8f1faf20cb074c3152c2ee18cfda95dcf3225a95d16f215"} Sep 08 06:49:45.731688 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:45.731593 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 08 06:49:53.520267 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:53.520236 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:49:53.520920 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:53.520901 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:49:55.730950 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:55.730904 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 08 06:49:58.865923 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:58.865886 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:49:58.931263 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:49:58.931230 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:50:00.310157 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:00.310122 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:50:05.730831 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:05.730790 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" probeResult="failure" output="Get \"https://10.134.0.25:6567/health\": dial tcp 10.134.0.25:6567: connect: connection refused" Sep 08 06:50:05.731192 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:05.730928 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:50:07.139710 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.139666 2581 generic.go:356] "Generic (PLEG): container finished" podID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerID="edc77173425a9e4c94fe85bb35683c2ce04ef4aa04260d0f87fcce8e31e68554" exitCode=137 Sep 08 06:50:07.139710 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.139693 2581 generic.go:356] "Generic (PLEG): container finished" podID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerID="e85508e181fa6c580ff27588c928957a5556cd4f9acdbf76c269bfb6840a7ba3" exitCode=137 Sep 08 06:50:07.140145 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.139742 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerDied","Data":"edc77173425a9e4c94fe85bb35683c2ce04ef4aa04260d0f87fcce8e31e68554"} Sep 08 06:50:07.140145 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.139807 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerDied","Data":"e85508e181fa6c580ff27588c928957a5556cd4f9acdbf76c269bfb6840a7ba3"} Sep 08 06:50:07.324075 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.324052 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:50:07.375532 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.375497 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-registry-tls\") pod \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " Sep 08 06:50:07.375532 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.375535 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bb4z\" (UniqueName: \"kubernetes.io/projected/41acd668-a6cf-443f-9fd8-bc3a36afd26a-kube-api-access-7bb4z\") pod \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " Sep 08 06:50:07.375798 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.375559 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/41acd668-a6cf-443f-9fd8-bc3a36afd26a-feast-data\") pod \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " Sep 08 06:50:07.375798 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.375602 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls\") pod \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " Sep 08 06:50:07.375798 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.375619 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-online-tls\") pod \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\" (UID: \"41acd668-a6cf-443f-9fd8-bc3a36afd26a\") " Sep 08 06:50:07.377841 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.377807 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "41acd668-a6cf-443f-9fd8-bc3a36afd26a" (UID: "41acd668-a6cf-443f-9fd8-bc3a36afd26a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:50:07.377963 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.377921 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-online-tls" (OuterVolumeSpecName: "online-tls") pod "41acd668-a6cf-443f-9fd8-bc3a36afd26a" (UID: "41acd668-a6cf-443f-9fd8-bc3a36afd26a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:50:07.378226 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.378207 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "41acd668-a6cf-443f-9fd8-bc3a36afd26a" (UID: "41acd668-a6cf-443f-9fd8-bc3a36afd26a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:50:07.378226 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.378216 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41acd668-a6cf-443f-9fd8-bc3a36afd26a-kube-api-access-7bb4z" (OuterVolumeSpecName: "kube-api-access-7bb4z") pod "41acd668-a6cf-443f-9fd8-bc3a36afd26a" (UID: "41acd668-a6cf-443f-9fd8-bc3a36afd26a"). InnerVolumeSpecName "kube-api-access-7bb4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:50:07.387203 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.387179 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41acd668-a6cf-443f-9fd8-bc3a36afd26a-feast-data" (OuterVolumeSpecName: "feast-data") pod "41acd668-a6cf-443f-9fd8-bc3a36afd26a" (UID: "41acd668-a6cf-443f-9fd8-bc3a36afd26a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:50:07.477024 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.476945 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bb4z\" (UniqueName: \"kubernetes.io/projected/41acd668-a6cf-443f-9fd8-bc3a36afd26a-kube-api-access-7bb4z\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:50:07.477024 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.476979 2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/41acd668-a6cf-443f-9fd8-bc3a36afd26a-feast-data\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:50:07.477024 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.476989 2581 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-offline-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:50:07.477024 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.476997 2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-online-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:50:07.477024 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:07.477005 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/41acd668-a6cf-443f-9fd8-bc3a36afd26a-registry-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:50:08.146429 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.146390 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" event={"ID":"41acd668-a6cf-443f-9fd8-bc3a36afd26a","Type":"ContainerDied","Data":"85ebf417b05eecab4b7d9da10f5d80b855b776f96884960f36cf2001ecc23941"} Sep 08 06:50:08.146911 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.146438 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq" Sep 08 06:50:08.146911 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.146480 2581 scope.go:117] "RemoveContainer" containerID="edc77173425a9e4c94fe85bb35683c2ce04ef4aa04260d0f87fcce8e31e68554" Sep 08 06:50:08.154944 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.154924 2581 scope.go:117] "RemoveContainer" containerID="49c505df36c84622b8f1faf20cb074c3152c2ee18cfda95dcf3225a95d16f215" Sep 08 06:50:08.162109 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.162094 2581 scope.go:117] "RemoveContainer" containerID="e85508e181fa6c580ff27588c928957a5556cd4f9acdbf76c269bfb6840a7ba3" Sep 08 06:50:08.166272 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.166251 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq"] Sep 08 06:50:08.170184 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.170150 2581 scope.go:117] "RemoveContainer" containerID="1b4422307068c45ab840f825c4494b9bd703cf7ef5cbd7f50aaa9c46d616dae8" Sep 08 06:50:08.171352 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.171332 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-6fc7cf98c6-rk6mq"] Sep 08 06:50:08.177194 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:08.177177 2581 scope.go:117] "RemoveContainer" containerID="7da5a5b5846fee851562a0298a248269900b16263fec6be5c4175c6323466c0a" Sep 08 06:50:09.533645 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:09.533596 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" path="/var/lib/kubelet/pods/41acd668-a6cf-443f-9fd8-bc3a36afd26a/volumes" Sep 08 06:50:13.865673 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:13.865643 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:50:13.936156 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:13.936120 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:50:14.724536 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:14.724505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:50:14.787413 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:14.787381 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:50:14.887516 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:50:14.887487 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:03.727410 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.727377 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:03.807381 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807350 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-f5q8n"] Sep 08 06:52:03.807731 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807714 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bcc0373-01b8-4797-9e1c-74b49590b72f" containerName="redis" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807734 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bcc0373-01b8-4797-9e1c-74b49590b72f" containerName="redis" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807744 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="feast-init" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807752 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="feast-init" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807773 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807781 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807797 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="feast-apply" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807804 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="feast-apply" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807813 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="registry" Sep 08 06:52:03.807822 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807821 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="registry" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807834 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="773457a4-c0f3-4c5f-a39a-bc8c56f9fafb" containerName="postgres" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807842 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="773457a4-c0f3-4c5f-a39a-bc8c56f9fafb" containerName="postgres" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807858 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="offline" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807865 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="offline" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807954 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="registry" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807967 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="773457a4-c0f3-4c5f-a39a-bc8c56f9fafb" containerName="postgres" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807980 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bcc0373-01b8-4797-9e1c-74b49590b72f" containerName="redis" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807989 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="online" Sep 08 06:52:03.808246 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.807997 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="41acd668-a6cf-443f-9fd8-bc3a36afd26a" containerName="offline" Sep 08 06:52:03.810992 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.810972 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" Sep 08 06:52:03.814846 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.814825 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 08 06:52:03.814846 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.814838 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-kvkgr\"" Sep 08 06:52:03.815894 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.815876 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 08 06:52:03.821605 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.821585 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:03.838743 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.838711 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-f5q8n"] Sep 08 06:52:03.906391 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:03.906363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:04.003368 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:04.003285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5vm8\" (UniqueName: \"kubernetes.io/projected/729102fc-5124-4d7f-a501-538006cb7bbf-kube-api-access-n5vm8\") pod \"redis-69bbd798b6-f5q8n\" (UID: \"729102fc-5124-4d7f-a501-538006cb7bbf\") " pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" Sep 08 06:52:04.104200 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:04.104163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5vm8\" (UniqueName: \"kubernetes.io/projected/729102fc-5124-4d7f-a501-538006cb7bbf-kube-api-access-n5vm8\") pod \"redis-69bbd798b6-f5q8n\" (UID: \"729102fc-5124-4d7f-a501-538006cb7bbf\") " pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" Sep 08 06:52:04.115809 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:04.115784 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5vm8\" (UniqueName: \"kubernetes.io/projected/729102fc-5124-4d7f-a501-538006cb7bbf-kube-api-access-n5vm8\") pod \"redis-69bbd798b6-f5q8n\" (UID: \"729102fc-5124-4d7f-a501-538006cb7bbf\") " pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" Sep 08 06:52:04.120561 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:04.120540 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" Sep 08 06:52:04.399987 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:04.399951 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-f5q8n"] Sep 08 06:52:04.405456 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:52:04.405434 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod729102fc_5124_4d7f_a501_538006cb7bbf.slice/crio-e39fb53550b5c34e9bd47ba87cdb586c149791bb2cc06efcfebf936c4e1337b6 WatchSource:0}: Error finding container e39fb53550b5c34e9bd47ba87cdb586c149791bb2cc06efcfebf936c4e1337b6: Status 404 returned error can't find the container with id e39fb53550b5c34e9bd47ba87cdb586c149791bb2cc06efcfebf936c4e1337b6 Sep 08 06:52:04.571538 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:04.571503 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" event={"ID":"729102fc-5124-4d7f-a501-538006cb7bbf","Type":"ContainerStarted","Data":"464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8"} Sep 08 06:52:04.571538 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:04.571542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" event={"ID":"729102fc-5124-4d7f-a501-538006cb7bbf","Type":"ContainerStarted","Data":"e39fb53550b5c34e9bd47ba87cdb586c149791bb2cc06efcfebf936c4e1337b6"} Sep 08 06:52:04.599167 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:04.599110 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" podStartSLOduration=1.599092711 podStartE2EDuration="1.599092711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:52:04.59848284 +0000 UTC m=+1031.548880682" watchObservedRunningTime="2026-09-08 06:52:04.599092711 +0000 UTC m=+1031.549490553" Sep 08 06:52:09.260672 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.260625 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kjdv2"] Sep 08 06:52:09.263782 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.263765 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:52:09.270963 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.270765 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 08 06:52:09.272410 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.272389 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kjdv2"] Sep 08 06:52:09.339618 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.339579 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/14582735-f879-4459-9936-c61b0b8aca38-postgresdata\") pod \"postgres-864846d4f5-kjdv2\" (UID: \"14582735-f879-4459-9936-c61b0b8aca38\") " pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:52:09.339816 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.339658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2bqx\" (UniqueName: \"kubernetes.io/projected/14582735-f879-4459-9936-c61b0b8aca38-kube-api-access-n2bqx\") pod \"postgres-864846d4f5-kjdv2\" (UID: \"14582735-f879-4459-9936-c61b0b8aca38\") " pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:52:09.353215 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.353172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:09.440656 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.440600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2bqx\" (UniqueName: \"kubernetes.io/projected/14582735-f879-4459-9936-c61b0b8aca38-kube-api-access-n2bqx\") pod \"postgres-864846d4f5-kjdv2\" (UID: \"14582735-f879-4459-9936-c61b0b8aca38\") " pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:52:09.440811 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.440716 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/14582735-f879-4459-9936-c61b0b8aca38-postgresdata\") pod \"postgres-864846d4f5-kjdv2\" (UID: \"14582735-f879-4459-9936-c61b0b8aca38\") " pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:52:09.441042 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.441027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/14582735-f879-4459-9936-c61b0b8aca38-postgresdata\") pod \"postgres-864846d4f5-kjdv2\" (UID: \"14582735-f879-4459-9936-c61b0b8aca38\") " pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:52:09.451155 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.451128 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2bqx\" (UniqueName: \"kubernetes.io/projected/14582735-f879-4459-9936-c61b0b8aca38-kube-api-access-n2bqx\") pod \"postgres-864846d4f5-kjdv2\" (UID: \"14582735-f879-4459-9936-c61b0b8aca38\") " pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:52:09.573603 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.573520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:52:09.844358 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:09.844286 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kjdv2"] Sep 08 06:52:09.847438 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:52:09.847405 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14582735_f879_4459_9936_c61b0b8aca38.slice/crio-6beda7b070866ba27a9a3e24a247e3619bb02a1adfb69be055f66cd06c6b1ce7 WatchSource:0}: Error finding container 6beda7b070866ba27a9a3e24a247e3619bb02a1adfb69be055f66cd06c6b1ce7: Status 404 returned error can't find the container with id 6beda7b070866ba27a9a3e24a247e3619bb02a1adfb69be055f66cd06c6b1ce7 Sep 08 06:52:10.593457 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:10.593412 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" event={"ID":"14582735-f879-4459-9936-c61b0b8aca38","Type":"ContainerStarted","Data":"088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd"} Sep 08 06:52:10.593908 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:10.593471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" event={"ID":"14582735-f879-4459-9936-c61b0b8aca38","Type":"ContainerStarted","Data":"6beda7b070866ba27a9a3e24a247e3619bb02a1adfb69be055f66cd06c6b1ce7"} Sep 08 06:52:10.626283 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:10.626216 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" podStartSLOduration=1.6261944050000001 podStartE2EDuration="1.626194405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:52:10.626069684 +0000 UTC m=+1037.576467528" watchObservedRunningTime="2026-09-08 06:52:10.626194405 +0000 UTC m=+1037.576592248" Sep 08 06:52:14.766491 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.766457 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:14.871619 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.871585 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw"] Sep 08 06:52:14.875090 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.875075 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.875946 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.875920 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.876057 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.875955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-online-tls\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.876057 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.875970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb4mt\" (UniqueName: \"kubernetes.io/projected/96952422-a3ab-4845-b67c-7ad4515770cd-kube-api-access-lb4mt\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.876057 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.876026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96952422-a3ab-4845-b67c-7ad4515770cd-feast-data\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.878915 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.878891 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 08 06:52:14.879655 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.879619 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 08 06:52:14.879655 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.879651 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 08 06:52:14.879832 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.879814 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-jgzx9\"" Sep 08 06:52:14.897041 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.897017 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw"] Sep 08 06:52:14.976909 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.976866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96952422-a3ab-4845-b67c-7ad4515770cd-feast-data\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.977095 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.976965 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.977095 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.976988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-online-tls\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.977095 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.977010 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb4mt\" (UniqueName: \"kubernetes.io/projected/96952422-a3ab-4845-b67c-7ad4515770cd-kube-api-access-lb4mt\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.977248 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:52:14.977109 2581 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found Sep 08 06:52:14.977248 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:52:14.977189 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls podName:96952422-a3ab-4845-b67c-7ad4515770cd nodeName:}" failed. No retries permitted until 2026-09-08 06:52:15.477165867 +0000 UTC m=+1042.427563702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls") pod "feast-credit-scoring-6c8ccc4fb5-xcgbw" (UID: "96952422-a3ab-4845-b67c-7ad4515770cd") : secret "feast-credit-scoring-registry-tls" not found Sep 08 06:52:14.977359 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.977286 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96952422-a3ab-4845-b67c-7ad4515770cd-feast-data\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.979595 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.979574 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-online-tls\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:14.990521 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:14.990489 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb4mt\" (UniqueName: \"kubernetes.io/projected/96952422-a3ab-4845-b67c-7ad4515770cd-kube-api-access-lb4mt\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:15.480652 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:15.480594 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:15.483098 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:15.483074 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls\") pod \"feast-credit-scoring-6c8ccc4fb5-xcgbw\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:15.483953 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:15.483938 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:15.763120 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:15.763092 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw"] Sep 08 06:52:15.765060 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:52:15.765035 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96952422_a3ab_4845_b67c_7ad4515770cd.slice/crio-c30c93667d84d2a5987db2e3a2176f71679caf494e61cc64fd860c0d4d4b96b8 WatchSource:0}: Error finding container c30c93667d84d2a5987db2e3a2176f71679caf494e61cc64fd860c0d4d4b96b8: Status 404 returned error can't find the container with id c30c93667d84d2a5987db2e3a2176f71679caf494e61cc64fd860c0d4d4b96b8 Sep 08 06:52:16.129422 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:16.129313 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:16.617786 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:16.617742 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerStarted","Data":"4b93887b6bac147c6eecaac9660eee1e01af32f57787d85c5f1318fd1cd340ee"} Sep 08 06:52:16.617960 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:16.617809 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerStarted","Data":"c30c93667d84d2a5987db2e3a2176f71679caf494e61cc64fd860c0d4d4b96b8"} Sep 08 06:52:17.623590 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:17.623507 2581 generic.go:356] "Generic (PLEG): container finished" podID="96952422-a3ab-4845-b67c-7ad4515770cd" containerID="4b93887b6bac147c6eecaac9660eee1e01af32f57787d85c5f1318fd1cd340ee" exitCode=0 Sep 08 06:52:17.623940 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:17.623608 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerDied","Data":"4b93887b6bac147c6eecaac9660eee1e01af32f57787d85c5f1318fd1cd340ee"} Sep 08 06:52:18.629155 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:18.629116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerStarted","Data":"4290797d25da8b1a2e5a23b99ef3100d6a8bb6f3aacf4f05fa5e6301a2bade21"} Sep 08 06:52:24.656233 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:24.656192 2581 generic.go:356] "Generic (PLEG): container finished" podID="96952422-a3ab-4845-b67c-7ad4515770cd" containerID="4290797d25da8b1a2e5a23b99ef3100d6a8bb6f3aacf4f05fa5e6301a2bade21" exitCode=0 Sep 08 06:52:24.656618 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:24.656236 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerDied","Data":"4290797d25da8b1a2e5a23b99ef3100d6a8bb6f3aacf4f05fa5e6301a2bade21"} Sep 08 06:52:25.663805 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:25.663766 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerStarted","Data":"e535ebc2eac4b8631d076dd7a644e3d5bb25e3666e88118c81161382c9a11096"} Sep 08 06:52:25.664180 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:25.663843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerStarted","Data":"bcd3d9e9c1de760a758babf14e839407f9e41a8c4e7c5f343d07c0b9a455e026"} Sep 08 06:52:25.689999 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:25.689947 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podStartSLOduration=11.689928051999999 podStartE2EDuration="11.689928052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:52:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:52:25.687865291 +0000 UTC m=+1052.638263133" watchObservedRunningTime="2026-09-08 06:52:25.689928052 +0000 UTC m=+1052.640325895" Sep 08 06:52:27.485004 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:27.484955 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:27.485400 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:27.485033 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:27.486645 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:27.486592 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Sep 08 06:52:27.486756 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:27.486622 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 08 06:52:30.484767 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:30.484718 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Sep 08 06:52:30.485235 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:30.485192 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 08 06:52:33.484419 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:33.484372 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.28:6571: connect: connection refused" Sep 08 06:52:33.490389 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:33.490364 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:33.490769 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:33.490747 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:33.493737 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:33.493713 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:35.484362 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:35.484332 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:36.485222 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:36.485190 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:36.724071 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:36.724038 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:52:37.028141 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:37.028110 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:40.623407 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.623371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:40.715569 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.715534 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:40.720782 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.720759 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72"] Sep 08 06:52:40.724483 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.724463 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.728047 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.728020 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 08 06:52:40.728280 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.728263 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 08 06:52:40.728442 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.728423 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-rk867\"" Sep 08 06:52:40.728611 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.728593 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 08 06:52:40.742350 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.742325 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72"] Sep 08 06:52:40.775130 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.775108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf4pz\" (UniqueName: \"kubernetes.io/projected/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-kube-api-access-rf4pz\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.775253 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.775188 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.775253 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.775217 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-online-tls\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.775253 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.775238 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-feast-data\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.875935 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.875873 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf4pz\" (UniqueName: \"kubernetes.io/projected/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-kube-api-access-rf4pz\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.876042 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.875937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.876042 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.875960 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-online-tls\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.876042 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.875981 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-feast-data\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.876220 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:52:40.876084 2581 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found Sep 08 06:52:40.876220 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:52:40.876181 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls podName:db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0 nodeName:}" failed. No retries permitted until 2026-09-08 06:52:41.376160814 +0000 UTC m=+1068.326558636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls") pod "feast-driver-ranking-9bfbc74b6-jmn72" (UID: "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0") : secret "feast-driver-ranking-registry-tls" not found Sep 08 06:52:40.876511 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.876383 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-feast-data\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.878719 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.878701 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-online-tls\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:40.888703 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:40.888683 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf4pz\" (UniqueName: \"kubernetes.io/projected/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-kube-api-access-rf4pz\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:41.010900 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:41.010871 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:41.106395 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:41.106363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:52:41.379805 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:41.379775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:41.382252 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:41.382229 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls\") pod \"feast-driver-ranking-9bfbc74b6-jmn72\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:41.634374 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:41.634297 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:41.917753 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:41.917721 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72"] Sep 08 06:52:41.918672 ip-10-0-135-120 kubenswrapper[2581]: W0908 06:52:41.918647 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e8e8ee112d55b7178ae846117c238ffa8b8a4e3477499f839f914d65914dc96 WatchSource:0}: Error finding container 7e8e8ee112d55b7178ae846117c238ffa8b8a4e3477499f839f914d65914dc96: Status 404 returned error can't find the container with id 7e8e8ee112d55b7178ae846117c238ffa8b8a4e3477499f839f914d65914dc96 Sep 08 06:52:42.744401 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:42.744360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerStarted","Data":"07e272659e74accaf70662838d8fb7baaf42c45de81fd0d32b1797337c12d582"} Sep 08 06:52:42.744901 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:42.744414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerStarted","Data":"7e8e8ee112d55b7178ae846117c238ffa8b8a4e3477499f839f914d65914dc96"} Sep 08 06:52:46.760911 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:46.760876 2581 generic.go:356] "Generic (PLEG): container finished" podID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerID="07e272659e74accaf70662838d8fb7baaf42c45de81fd0d32b1797337c12d582" exitCode=0 Sep 08 06:52:46.761250 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:46.760945 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerDied","Data":"07e272659e74accaf70662838d8fb7baaf42c45de81fd0d32b1797337c12d582"} Sep 08 06:52:47.767773 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:47.767737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerStarted","Data":"7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d"} Sep 08 06:52:53.801804 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:53.801770 2581 generic.go:356] "Generic (PLEG): container finished" podID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerID="7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d" exitCode=0 Sep 08 06:52:53.802152 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:53.801822 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerDied","Data":"7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d"} Sep 08 06:52:53.805819 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:53.805766 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 08 06:52:54.808498 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:54.808453 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerStarted","Data":"f7335b875d0b5801872e73b9a3f5130c0976dfc5bbc7e714ba1fc31555f1fdc0"} Sep 08 06:52:54.808975 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:54.808518 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerStarted","Data":"2bdeea958931593677d97e8b480d8a932aefbc124dfaa758f1e7cc74e1993503"} Sep 08 06:52:54.832159 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:54.832102 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podStartSLOduration=14.832080399 podStartE2EDuration="14.832080399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 06:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 06:52:54.831466982 +0000 UTC m=+1081.781864828" watchObservedRunningTime="2026-09-08 06:52:54.832080399 +0000 UTC m=+1081.782478242" Sep 08 06:52:55.859372 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:52:55.859329 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:52:56.634871 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:56.634836 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:56.635049 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:56.634911 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:52:56.636597 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:56.636566 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused" Sep 08 06:52:56.636597 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:56.636584 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 08 06:52:58.280419 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:52:58.280385 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:52:59.635686 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:59.635619 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 08 06:52:59.636204 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:52:59.635610 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused" Sep 08 06:53:01.634738 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:01.634689 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:53:01.635200 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:01.634757 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:53:02.634813 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:02.634761 2581 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused" Sep 08 06:53:02.641152 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:02.641124 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:53:02.644835 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:02.644805 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:53:05.635389 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:05.635359 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:53:05.636067 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:05.636050 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:53:05.899767 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:05.899691 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:13.281808 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:13.281769 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:15.907762 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:15.907722 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:16.170402 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:16.170303 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:53:25.947123 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:25.947091 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:28.234783 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:28.234744 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:31.903444 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:53:31.903406 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:53:35.995718 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:35.992655 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:43.265153 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:43.265115 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:46.005480 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:46.005441 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:51.880556 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:51.880521 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:53:51.880942 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:53:51.880564 2581 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1dd3b0_c6e9_4de4_88fe_0a4e49c801d0.slice/crio-7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d.scope\": RecentStats: unable to find data in memory cache]" Sep 08 06:54:21.568033 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:21.568000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:23.889896 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:23.889855 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:24.316556 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.316524 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk"] Sep 08 06:54:24.316863 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.316834 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" podUID="2fac86c7-a9c1-4d95-912c-995817f3ada2" containerName="manager" containerID="cri-o://d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef" gracePeriod=10 Sep 08 06:54:24.338084 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.338053 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:24.558752 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.558648 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:54:24.610204 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.610110 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5v5sm\" (UniqueName: \"kubernetes.io/projected/2fac86c7-a9c1-4d95-912c-995817f3ada2-kube-api-access-5v5sm\") pod \"2fac86c7-a9c1-4d95-912c-995817f3ada2\" (UID: \"2fac86c7-a9c1-4d95-912c-995817f3ada2\") " Sep 08 06:54:24.614440 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.614407 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fac86c7-a9c1-4d95-912c-995817f3ada2-kube-api-access-5v5sm" (OuterVolumeSpecName: "kube-api-access-5v5sm") pod "2fac86c7-a9c1-4d95-912c-995817f3ada2" (UID: "2fac86c7-a9c1-4d95-912c-995817f3ada2"). InnerVolumeSpecName "kube-api-access-5v5sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:54:24.649282 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.649247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:24.711352 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.711326 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v5sm\" (UniqueName: \"kubernetes.io/projected/2fac86c7-a9c1-4d95-912c-995817f3ada2-kube-api-access-5v5sm\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:24.736750 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.736721 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw"] Sep 08 06:54:24.736964 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.736929 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="registry" containerID="cri-o://bcd3d9e9c1de760a758babf14e839407f9e41a8c4e7c5f343d07c0b9a455e026" gracePeriod=30 Sep 08 06:54:24.737051 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.736979 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" containerID="cri-o://e535ebc2eac4b8631d076dd7a644e3d5bb25e3666e88118c81161382c9a11096" gracePeriod=30 Sep 08 06:54:24.743315 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.743293 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72"] Sep 08 06:54:24.743529 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.743510 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="registry" containerID="cri-o://2bdeea958931593677d97e8b480d8a932aefbc124dfaa758f1e7cc74e1993503" gracePeriod=30 Sep 08 06:54:24.743610 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.743523 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" containerID="cri-o://f7335b875d0b5801872e73b9a3f5130c0976dfc5bbc7e714ba1fc31555f1fdc0" gracePeriod=30 Sep 08 06:54:24.788146 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.788116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:24.860151 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:24.860120 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:25.188929 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.188893 2581 generic.go:356] "Generic (PLEG): container finished" podID="2fac86c7-a9c1-4d95-912c-995817f3ada2" containerID="d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef" exitCode=0 Sep 08 06:54:25.189368 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.188951 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" Sep 08 06:54:25.189368 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.188982 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" event={"ID":"2fac86c7-a9c1-4d95-912c-995817f3ada2","Type":"ContainerDied","Data":"d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef"} Sep 08 06:54:25.189368 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.189040 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk" event={"ID":"2fac86c7-a9c1-4d95-912c-995817f3ada2","Type":"ContainerDied","Data":"a3a7ed4b8efed4e2c6bc29eb1b28f448cc2482387fa61036cf6c9225c7e52487"} Sep 08 06:54:25.189368 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.189064 2581 scope.go:117] "RemoveContainer" containerID="d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef" Sep 08 06:54:25.197993 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.197973 2581 scope.go:117] "RemoveContainer" containerID="d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef" Sep 08 06:54:25.198373 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:54:25.198350 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef\": container with ID starting with d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef not found: ID does not exist" containerID="d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef" Sep 08 06:54:25.198455 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.198384 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef"} err="failed to get container status \"d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef\": rpc error: code = NotFound desc = could not find container \"d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef\": container with ID starting with d0b269aacbf68c3638aa3cdff37487c767a3137d95ac087f7c3bd7e031c613ef not found: ID does not exist" Sep 08 06:54:25.214704 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.214676 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk"] Sep 08 06:54:25.219625 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.219598 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-777d78558f-wggnk"] Sep 08 06:54:25.534111 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:25.534083 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fac86c7-a9c1-4d95-912c-995817f3ada2" path="/var/lib/kubelet/pods/2fac86c7-a9c1-4d95-912c-995817f3ada2/volumes" Sep 08 06:54:26.196020 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.195990 2581 generic.go:356] "Generic (PLEG): container finished" podID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerID="f7335b875d0b5801872e73b9a3f5130c0976dfc5bbc7e714ba1fc31555f1fdc0" exitCode=0 Sep 08 06:54:26.196421 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.196069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerDied","Data":"f7335b875d0b5801872e73b9a3f5130c0976dfc5bbc7e714ba1fc31555f1fdc0"} Sep 08 06:54:26.198624 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.198604 2581 generic.go:356] "Generic (PLEG): container finished" podID="96952422-a3ab-4845-b67c-7ad4515770cd" containerID="e535ebc2eac4b8631d076dd7a644e3d5bb25e3666e88118c81161382c9a11096" exitCode=0 Sep 08 06:54:26.198751 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.198659 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerDied","Data":"e535ebc2eac4b8631d076dd7a644e3d5bb25e3666e88118c81161382c9a11096"} Sep 08 06:54:26.548574 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.548538 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kjdv2"] Sep 08 06:54:26.548797 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.548731 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" podUID="14582735-f879-4459-9936-c61b0b8aca38" containerName="postgres" containerID="cri-o://088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd" gracePeriod=30 Sep 08 06:54:26.563454 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.563424 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-f5q8n"] Sep 08 06:54:26.563611 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.563592 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" podUID="729102fc-5124-4d7f-a501-538006cb7bbf" containerName="redis" containerID="cri-o://464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8" gracePeriod=30 Sep 08 06:54:26.646828 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.646795 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:26.808480 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.808418 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:54:26.826537 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.826513 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2bqx\" (UniqueName: \"kubernetes.io/projected/14582735-f879-4459-9936-c61b0b8aca38-kube-api-access-n2bqx\") pod \"14582735-f879-4459-9936-c61b0b8aca38\" (UID: \"14582735-f879-4459-9936-c61b0b8aca38\") " Sep 08 06:54:26.826650 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.826559 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/14582735-f879-4459-9936-c61b0b8aca38-postgresdata\") pod \"14582735-f879-4459-9936-c61b0b8aca38\" (UID: \"14582735-f879-4459-9936-c61b0b8aca38\") " Sep 08 06:54:26.828908 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.828886 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14582735-f879-4459-9936-c61b0b8aca38-kube-api-access-n2bqx" (OuterVolumeSpecName: "kube-api-access-n2bqx") pod "14582735-f879-4459-9936-c61b0b8aca38" (UID: "14582735-f879-4459-9936-c61b0b8aca38"). InnerVolumeSpecName "kube-api-access-n2bqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:54:26.829876 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.829860 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" Sep 08 06:54:26.858497 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.858464 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14582735-f879-4459-9936-c61b0b8aca38-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "14582735-f879-4459-9936-c61b0b8aca38" (UID: "14582735-f879-4459-9936-c61b0b8aca38"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:54:26.928084 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.928039 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5vm8\" (UniqueName: \"kubernetes.io/projected/729102fc-5124-4d7f-a501-538006cb7bbf-kube-api-access-n5vm8\") pod \"729102fc-5124-4d7f-a501-538006cb7bbf\" (UID: \"729102fc-5124-4d7f-a501-538006cb7bbf\") " Sep 08 06:54:26.928264 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.928166 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2bqx\" (UniqueName: \"kubernetes.io/projected/14582735-f879-4459-9936-c61b0b8aca38-kube-api-access-n2bqx\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:26.928264 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.928178 2581 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/14582735-f879-4459-9936-c61b0b8aca38-postgresdata\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:26.930171 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:26.930148 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/729102fc-5124-4d7f-a501-538006cb7bbf-kube-api-access-n5vm8" (OuterVolumeSpecName: "kube-api-access-n5vm8") pod "729102fc-5124-4d7f-a501-538006cb7bbf" (UID: "729102fc-5124-4d7f-a501-538006cb7bbf"). InnerVolumeSpecName "kube-api-access-n5vm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:54:27.029172 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.029138 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5vm8\" (UniqueName: \"kubernetes.io/projected/729102fc-5124-4d7f-a501-538006cb7bbf-kube-api-access-n5vm8\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:27.205138 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.205038 2581 generic.go:356] "Generic (PLEG): container finished" podID="14582735-f879-4459-9936-c61b0b8aca38" containerID="088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd" exitCode=0 Sep 08 06:54:27.205138 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.205087 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" Sep 08 06:54:27.205664 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.205137 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" event={"ID":"14582735-f879-4459-9936-c61b0b8aca38","Type":"ContainerDied","Data":"088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd"} Sep 08 06:54:27.205664 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.205192 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-kjdv2" event={"ID":"14582735-f879-4459-9936-c61b0b8aca38","Type":"ContainerDied","Data":"6beda7b070866ba27a9a3e24a247e3619bb02a1adfb69be055f66cd06c6b1ce7"} Sep 08 06:54:27.205664 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.205223 2581 scope.go:117] "RemoveContainer" containerID="088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd" Sep 08 06:54:27.206768 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.206739 2581 generic.go:356] "Generic (PLEG): container finished" podID="729102fc-5124-4d7f-a501-538006cb7bbf" containerID="464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8" exitCode=0 Sep 08 06:54:27.206902 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.206785 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" Sep 08 06:54:27.206902 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.206850 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" event={"ID":"729102fc-5124-4d7f-a501-538006cb7bbf","Type":"ContainerDied","Data":"464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8"} Sep 08 06:54:27.206902 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.206882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-f5q8n" event={"ID":"729102fc-5124-4d7f-a501-538006cb7bbf","Type":"ContainerDied","Data":"e39fb53550b5c34e9bd47ba87cdb586c149791bb2cc06efcfebf936c4e1337b6"} Sep 08 06:54:27.221225 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.221199 2581 scope.go:117] "RemoveContainer" containerID="088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd" Sep 08 06:54:27.221865 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:54:27.221673 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd\": container with ID starting with 088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd not found: ID does not exist" containerID="088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd" Sep 08 06:54:27.221865 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.221719 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd"} err="failed to get container status \"088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd\": rpc error: code = NotFound desc = could not find container \"088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd\": container with ID starting with 088e4aad5ea783643c4f51cd3cd5975ae59ca454f9c57611b6aec0fcb75bfacd not found: ID does not exist" Sep 08 06:54:27.221865 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.221749 2581 scope.go:117] "RemoveContainer" containerID="464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8" Sep 08 06:54:27.231871 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.231848 2581 scope.go:117] "RemoveContainer" containerID="464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8" Sep 08 06:54:27.232249 ip-10-0-135-120 kubenswrapper[2581]: E0908 06:54:27.232224 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8\": container with ID starting with 464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8 not found: ID does not exist" containerID="464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8" Sep 08 06:54:27.232335 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.232268 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8"} err="failed to get container status \"464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8\": rpc error: code = NotFound desc = could not find container \"464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8\": container with ID starting with 464be03cc1525a16a7228cd317197e714532220ad7caeeca51008de73e35aec8 not found: ID does not exist" Sep 08 06:54:27.246920 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.246883 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kjdv2"] Sep 08 06:54:27.254354 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.254312 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-kjdv2"] Sep 08 06:54:27.274147 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.274110 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-f5q8n"] Sep 08 06:54:27.280160 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.280131 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-f5q8n"] Sep 08 06:54:27.532992 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.532951 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14582735-f879-4459-9936-c61b0b8aca38" path="/var/lib/kubelet/pods/14582735-f879-4459-9936-c61b0b8aca38/volumes" Sep 08 06:54:27.533342 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:27.533323 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="729102fc-5124-4d7f-a501-538006cb7bbf" path="/var/lib/kubelet/pods/729102fc-5124-4d7f-a501-538006cb7bbf/volumes" Sep 08 06:54:29.628844 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:29.628811 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:29.728981 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:29.728949 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:32.642462 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:32.642416 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 08 06:54:33.491179 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:33.491139 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 08 06:54:35.077749 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:35.077715 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:35.176234 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:35.176196 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:35.948301 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:35.948260 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:42.642158 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:42.642114 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 08 06:54:43.491327 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:43.491288 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 08 06:54:52.146260 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:52.146224 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:52.246347 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:52.246295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:52.642431 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:52.642399 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused" Sep 08 06:54:52.642616 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:52.642529 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:54:52.728515 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:52.728484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:52.831830 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:52.831791 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:52.929031 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:52.928947 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:53.065091 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:53.065030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:53.165266 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:53.165236 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:53.266268 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:53.266206 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:54:53.491115 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:53.491071 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" probeResult="failure" output="Get \"https://10.134.0.28:6567/health\": dial tcp 10.134.0.28:6567: connect: connection refused" Sep 08 06:54:53.491290 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:53.491189 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:54:53.546720 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:53.546651 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:54:53.547319 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:53.547299 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:54:55.318065 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.318018 2581 generic.go:356] "Generic (PLEG): container finished" podID="96952422-a3ab-4845-b67c-7ad4515770cd" containerID="bcd3d9e9c1de760a758babf14e839407f9e41a8c4e7c5f343d07c0b9a455e026" exitCode=137 Sep 08 06:54:55.318456 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.318107 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerDied","Data":"bcd3d9e9c1de760a758babf14e839407f9e41a8c4e7c5f343d07c0b9a455e026"} Sep 08 06:54:55.320999 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.320971 2581 generic.go:356] "Generic (PLEG): container finished" podID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerID="2bdeea958931593677d97e8b480d8a932aefbc124dfaa758f1e7cc74e1993503" exitCode=137 Sep 08 06:54:55.321093 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.321024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerDied","Data":"2bdeea958931593677d97e8b480d8a932aefbc124dfaa758f1e7cc74e1993503"} Sep 08 06:54:55.408177 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.408155 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:54:55.410816 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.410800 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:54:55.533962 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.533886 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls\") pod \"96952422-a3ab-4845-b67c-7ad4515770cd\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " Sep 08 06:54:55.533962 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.533915 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls\") pod \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " Sep 08 06:54:55.533962 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.533952 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-online-tls\") pod \"96952422-a3ab-4845-b67c-7ad4515770cd\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " Sep 08 06:54:55.534213 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.533975 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96952422-a3ab-4845-b67c-7ad4515770cd-feast-data\") pod \"96952422-a3ab-4845-b67c-7ad4515770cd\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " Sep 08 06:54:55.534213 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.534169 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lb4mt\" (UniqueName: \"kubernetes.io/projected/96952422-a3ab-4845-b67c-7ad4515770cd-kube-api-access-lb4mt\") pod \"96952422-a3ab-4845-b67c-7ad4515770cd\" (UID: \"96952422-a3ab-4845-b67c-7ad4515770cd\") " Sep 08 06:54:55.534318 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.534210 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-online-tls\") pod \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " Sep 08 06:54:55.534318 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.534296 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rf4pz\" (UniqueName: \"kubernetes.io/projected/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-kube-api-access-rf4pz\") pod \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " Sep 08 06:54:55.534427 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.534339 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-feast-data\") pod \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\" (UID: \"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0\") " Sep 08 06:54:55.535306 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.535279 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-feast-data" (OuterVolumeSpecName: "feast-data") pod "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" (UID: "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:54:55.536750 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.536720 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" (UID: "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:54:55.536750 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.536720 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "96952422-a3ab-4845-b67c-7ad4515770cd" (UID: "96952422-a3ab-4845-b67c-7ad4515770cd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:54:55.537122 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.536866 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-online-tls" (OuterVolumeSpecName: "online-tls") pod "96952422-a3ab-4845-b67c-7ad4515770cd" (UID: "96952422-a3ab-4845-b67c-7ad4515770cd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:54:55.537191 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.537129 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-kube-api-access-rf4pz" (OuterVolumeSpecName: "kube-api-access-rf4pz") pod "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" (UID: "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0"). InnerVolumeSpecName "kube-api-access-rf4pz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:54:55.537251 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.537231 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-online-tls" (OuterVolumeSpecName: "online-tls") pod "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" (UID: "db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 06:54:55.538245 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.538225 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96952422-a3ab-4845-b67c-7ad4515770cd-kube-api-access-lb4mt" (OuterVolumeSpecName: "kube-api-access-lb4mt") pod "96952422-a3ab-4845-b67c-7ad4515770cd" (UID: "96952422-a3ab-4845-b67c-7ad4515770cd"). InnerVolumeSpecName "kube-api-access-lb4mt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 06:54:55.543640 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.543607 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96952422-a3ab-4845-b67c-7ad4515770cd-feast-data" (OuterVolumeSpecName: "feast-data") pod "96952422-a3ab-4845-b67c-7ad4515770cd" (UID: "96952422-a3ab-4845-b67c-7ad4515770cd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 06:54:55.635482 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.635451 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rf4pz\" (UniqueName: \"kubernetes.io/projected/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-kube-api-access-rf4pz\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:55.635482 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.635481 2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-feast-data\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:55.635482 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.635490 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-registry-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:55.635482 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.635498 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-registry-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:55.635704 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.635505 2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/96952422-a3ab-4845-b67c-7ad4515770cd-online-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:55.635704 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.635511 2581 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/96952422-a3ab-4845-b67c-7ad4515770cd-feast-data\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:55.635704 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.635518 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lb4mt\" (UniqueName: \"kubernetes.io/projected/96952422-a3ab-4845-b67c-7ad4515770cd-kube-api-access-lb4mt\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:55.635704 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:55.635526 2581 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0-online-tls\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 06:54:56.327307 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.327268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" event={"ID":"db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0","Type":"ContainerDied","Data":"7e8e8ee112d55b7178ae846117c238ffa8b8a4e3477499f839f914d65914dc96"} Sep 08 06:54:56.327307 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.327288 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72" Sep 08 06:54:56.327842 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.327331 2581 scope.go:117] "RemoveContainer" containerID="f7335b875d0b5801872e73b9a3f5130c0976dfc5bbc7e714ba1fc31555f1fdc0" Sep 08 06:54:56.330100 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.330081 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" Sep 08 06:54:56.330226 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.330075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw" event={"ID":"96952422-a3ab-4845-b67c-7ad4515770cd","Type":"ContainerDied","Data":"c30c93667d84d2a5987db2e3a2176f71679caf494e61cc64fd860c0d4d4b96b8"} Sep 08 06:54:56.337006 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.336989 2581 scope.go:117] "RemoveContainer" containerID="2bdeea958931593677d97e8b480d8a932aefbc124dfaa758f1e7cc74e1993503" Sep 08 06:54:56.345079 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.345060 2581 scope.go:117] "RemoveContainer" containerID="7e85f79f877c211700a5019bf33ba3246f9b5b6c0ca4ada25b607427ee8e148d" Sep 08 06:54:56.352116 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.352100 2581 scope.go:117] "RemoveContainer" containerID="07e272659e74accaf70662838d8fb7baaf42c45de81fd0d32b1797337c12d582" Sep 08 06:54:56.354666 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.354646 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72"] Sep 08 06:54:56.359147 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.359125 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-9bfbc74b6-jmn72"] Sep 08 06:54:56.359777 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.359762 2581 scope.go:117] "RemoveContainer" containerID="e535ebc2eac4b8631d076dd7a644e3d5bb25e3666e88118c81161382c9a11096" Sep 08 06:54:56.366914 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.366897 2581 scope.go:117] "RemoveContainer" containerID="bcd3d9e9c1de760a758babf14e839407f9e41a8c4e7c5f343d07c0b9a455e026" Sep 08 06:54:56.371830 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.371807 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw"] Sep 08 06:54:56.374848 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.374833 2581 scope.go:117] "RemoveContainer" containerID="4290797d25da8b1a2e5a23b99ef3100d6a8bb6f3aacf4f05fa5e6301a2bade21" Sep 08 06:54:56.375957 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.375936 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c8ccc4fb5-xcgbw"] Sep 08 06:54:56.382065 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:56.382049 2581 scope.go:117] "RemoveContainer" containerID="4b93887b6bac147c6eecaac9660eee1e01af32f57787d85c5f1318fd1cd340ee" Sep 08 06:54:57.533409 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:57.533376 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" path="/var/lib/kubelet/pods/96952422-a3ab-4845-b67c-7ad4515770cd/volumes" Sep 08 06:54:57.533879 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:54:57.533865 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" path="/var/lib/kubelet/pods/db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0/volumes" Sep 08 06:55:04.211685 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:55:04.211651 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:55:04.311468 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:55:04.311435 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:55:04.412400 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:55:04.412368 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:56:31.253284 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:56:31.253252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:56:31.314964 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:56:31.314920 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:56:31.518620 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:56:31.518586 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:56:31.620604 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:56:31.620576 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:56:31.698349 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:56:31.698315 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:56:31.777479 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:56:31.777373 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:56:31.873134 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:56:31.873097 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:56:32.164339 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:56:32.164242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:57:28.830650 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:57:28.830599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:58:00.070546 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:58:00.070509 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:58:00.172601 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:58:00.172573 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:58:00.571938 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:58:00.571900 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:58:00.669159 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:58:00.669133 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:58:00.912510 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:58:00.912412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:58:01.007967 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:58:01.007935 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:58:01.265444 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:58:01.265408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:59:01.175535 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:01.175449 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:59:14.478843 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:14.478800 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:59:47.312032 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:47.311988 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:59:47.583168 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:47.583060 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:59:47.737836 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:47.737801 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:59:52.600502 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:52.600453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 06:59:53.577621 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:53.577585 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:59:53.578750 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:53.578729 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 06:59:57.360923 ip-10-0-135-120 kubenswrapper[2581]: I0908 06:59:57.360878 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:31.176048 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:31.176001 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:31.232585 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:31.232546 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:35.884361 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:35.884322 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:35.950986 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:35.950951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:59.096441 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:59.096408 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:59.294232 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:59.294195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:59.474984 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:59.474866 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:59.576516 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:59.576475 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:00:59.703478 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:00:59.703436 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:07.182551 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:07.182484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:18.531825 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:18.531770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:23.991409 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:23.991376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:24.091459 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:24.091417 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:24.260306 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:24.260279 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:24.360872 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:24.360840 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:24.521014 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:24.520930 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:24.625135 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:24.625104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:26.215949 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:26.215912 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:55.140548 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:55.140512 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:02:56.312380 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:02:56.312346 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:03:52.568903 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:03:52.568864 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:03:52.666468 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:03:52.666430 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:03:53.013959 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:03:53.013919 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:03:53.119594 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:03:53.119553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:03:53.216040 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:03:53.216009 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:03:53.424705 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:03:53.424572 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:04:52.166400 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:04:52.166359 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:04:52.267020 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:04:52.266979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:04:53.600130 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:04:53.600105 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 07:04:53.602137 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:04:53.602120 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 07:05:35.249603 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:05:35.249568 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:05:35.310729 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:05:35.310684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:05:35.387554 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:05:35.387520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:05:35.487427 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:05:35.487393 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:05:35.586692 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:05:35.586657 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:05:40.549978 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:05:40.549944 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:18.427219 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:18.427179 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:18.546023 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:18.545977 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:24.106935 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.106890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:24.165448 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.165410 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:24.373458 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373380 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hq9lf/must-gather-5lkp6"] Sep 08 07:06:24.373679 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373667 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="feast-init" Sep 08 07:06:24.373732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373681 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="feast-init" Sep 08 07:06:24.373732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373691 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" Sep 08 07:06:24.373732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373697 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" Sep 08 07:06:24.373732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373707 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="feast-init" Sep 08 07:06:24.373732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373712 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="feast-init" Sep 08 07:06:24.373732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373718 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="registry" Sep 08 07:06:24.373732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373723 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="registry" Sep 08 07:06:24.373732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373733 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14582735-f879-4459-9936-c61b0b8aca38" containerName="postgres" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373741 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="14582735-f879-4459-9936-c61b0b8aca38" containerName="postgres" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373755 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fac86c7-a9c1-4d95-912c-995817f3ada2" containerName="manager" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373765 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fac86c7-a9c1-4d95-912c-995817f3ada2" containerName="manager" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373772 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373777 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373782 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="feast-apply" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373788 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="feast-apply" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373793 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="registry" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373798 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="registry" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373808 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="729102fc-5124-4d7f-a501-538006cb7bbf" containerName="redis" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373812 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="729102fc-5124-4d7f-a501-538006cb7bbf" containerName="redis" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373818 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="feast-apply" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373822 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="feast-apply" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373865 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="online" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373873 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="729102fc-5124-4d7f-a501-538006cb7bbf" containerName="redis" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373878 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="registry" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373885 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="db1dd3b0-c6e9-4de4-88fe-0a4e49c801d0" containerName="registry" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373890 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="14582735-f879-4459-9936-c61b0b8aca38" containerName="postgres" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373894 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fac86c7-a9c1-4d95-912c-995817f3ada2" containerName="manager" Sep 08 07:06:24.373969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.373899 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="96952422-a3ab-4845-b67c-7ad4515770cd" containerName="online" Sep 08 07:06:24.377045 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.377029 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:24.380049 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.380025 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hq9lf\"/\"kube-root-ca.crt\"" Sep 08 07:06:24.381173 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.381156 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hq9lf\"/\"openshift-service-ca.crt\"" Sep 08 07:06:24.381230 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.381178 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hq9lf\"/\"default-dockercfg-x64w5\"" Sep 08 07:06:24.386394 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.386366 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hq9lf/must-gather-5lkp6"] Sep 08 07:06:24.392102 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.392077 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:24.432541 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.432500 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cde648a0-2257-428d-b16e-75b6a4674b53-must-gather-output\") pod \"must-gather-5lkp6\" (UID: \"cde648a0-2257-428d-b16e-75b6a4674b53\") " pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:24.432749 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.432561 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srgqv\" (UniqueName: \"kubernetes.io/projected/cde648a0-2257-428d-b16e-75b6a4674b53-kube-api-access-srgqv\") pod \"must-gather-5lkp6\" (UID: \"cde648a0-2257-428d-b16e-75b6a4674b53\") " pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:24.493080 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.493047 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:24.533572 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.533533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cde648a0-2257-428d-b16e-75b6a4674b53-must-gather-output\") pod \"must-gather-5lkp6\" (UID: \"cde648a0-2257-428d-b16e-75b6a4674b53\") " pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:24.533780 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.533673 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srgqv\" (UniqueName: \"kubernetes.io/projected/cde648a0-2257-428d-b16e-75b6a4674b53-kube-api-access-srgqv\") pod \"must-gather-5lkp6\" (UID: \"cde648a0-2257-428d-b16e-75b6a4674b53\") " pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:24.533892 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.533873 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cde648a0-2257-428d-b16e-75b6a4674b53-must-gather-output\") pod \"must-gather-5lkp6\" (UID: \"cde648a0-2257-428d-b16e-75b6a4674b53\") " pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:24.542332 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.542308 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srgqv\" (UniqueName: \"kubernetes.io/projected/cde648a0-2257-428d-b16e-75b6a4674b53-kube-api-access-srgqv\") pod \"must-gather-5lkp6\" (UID: \"cde648a0-2257-428d-b16e-75b6a4674b53\") " pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:24.687463 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.687362 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:24.957300 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.957226 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hq9lf/must-gather-5lkp6"] Sep 08 07:06:24.960395 ip-10-0-135-120 kubenswrapper[2581]: W0908 07:06:24.960364 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcde648a0_2257_428d_b16e_75b6a4674b53.slice/crio-bb2f87f953296037c7b84f6ff66e3cf5273ea7875fef3bfe9dcdd4b07dfeef84 WatchSource:0}: Error finding container bb2f87f953296037c7b84f6ff66e3cf5273ea7875fef3bfe9dcdd4b07dfeef84: Status 404 returned error can't find the container with id bb2f87f953296037c7b84f6ff66e3cf5273ea7875fef3bfe9dcdd4b07dfeef84 Sep 08 07:06:24.962225 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:24.962207 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 07:06:25.833274 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:25.833187 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" event={"ID":"cde648a0-2257-428d-b16e-75b6a4674b53","Type":"ContainerStarted","Data":"bb2f87f953296037c7b84f6ff66e3cf5273ea7875fef3bfe9dcdd4b07dfeef84"} Sep 08 07:06:31.860777 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:31.860731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" event={"ID":"cde648a0-2257-428d-b16e-75b6a4674b53","Type":"ContainerStarted","Data":"2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64"} Sep 08 07:06:31.860777 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:31.860780 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" event={"ID":"cde648a0-2257-428d-b16e-75b6a4674b53","Type":"ContainerStarted","Data":"2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300"} Sep 08 07:06:31.877597 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:31.877542 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" podStartSLOduration=1.6748278989999998 podStartE2EDuration="7.877526545s" totalImagesPullingTime="6.202698646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 07:06:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:06:31.876432828 +0000 UTC m=+1898.826830666" watchObservedRunningTime="2026-09-08 07:06:31.877526545 +0000 UTC m=+1898.827924387" Sep 08 07:06:40.897457 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:40.897412 2581 generic.go:356] "Generic (PLEG): container finished" podID="cde648a0-2257-428d-b16e-75b6a4674b53" containerID="2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300" exitCode=0 Sep 08 07:06:40.897887 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:40.897489 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" event={"ID":"cde648a0-2257-428d-b16e-75b6a4674b53","Type":"ContainerDied","Data":"2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300"} Sep 08 07:06:40.897887 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:40.897808 2581 scope.go:117] "RemoveContainer" containerID="2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300" Sep 08 07:06:41.837871 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:41.837841 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hq9lf_must-gather-5lkp6_cde648a0-2257-428d-b16e-75b6a4674b53/gather/0.log" Sep 08 07:06:42.192041 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:42.191948 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:42.369021 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:42.368979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:42.466555 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:42.466453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:44.860160 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:44.860114 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7s9kb_615a0c26-426f-494b-9296-17a9bda45432/global-pull-secret-syncer/0.log" Sep 08 07:06:45.035202 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:45.035165 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" Sep 08 07:06:45.164818 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:45.164732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-120.ec2.internal_36e6dea94038e71ca8f1f3d66d122f60/haproxy/0.log" Sep 08 07:06:47.172511 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.172475 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-hq9lf/must-gather-5lkp6"] Sep 08 07:06:47.172969 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.172674 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" containerName="copy" containerID="cri-o://2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64" gracePeriod=2 Sep 08 07:06:47.177997 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.177972 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-hq9lf/must-gather-5lkp6"] Sep 08 07:06:47.394976 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.394954 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hq9lf_must-gather-5lkp6_cde648a0-2257-428d-b16e-75b6a4674b53/copy/0.log" Sep 08 07:06:47.396651 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.396620 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:47.399815 ip-10-0-135-120 kubenswrapper[2581]: E0908 07:06:47.399790 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5lkp6\" is forbidden: User \"system:node:ip-10-0-135-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-hq9lf\": no relationship found between node 'ip-10-0-135-120.ec2.internal' and this object" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:47.527013 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.526980 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cde648a0-2257-428d-b16e-75b6a4674b53-must-gather-output\") pod \"cde648a0-2257-428d-b16e-75b6a4674b53\" (UID: \"cde648a0-2257-428d-b16e-75b6a4674b53\") " Sep 08 07:06:47.527198 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.527084 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srgqv\" (UniqueName: \"kubernetes.io/projected/cde648a0-2257-428d-b16e-75b6a4674b53-kube-api-access-srgqv\") pod \"cde648a0-2257-428d-b16e-75b6a4674b53\" (UID: \"cde648a0-2257-428d-b16e-75b6a4674b53\") " Sep 08 07:06:47.527367 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.527334 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cde648a0-2257-428d-b16e-75b6a4674b53-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cde648a0-2257-428d-b16e-75b6a4674b53" (UID: "cde648a0-2257-428d-b16e-75b6a4674b53"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 07:06:47.529370 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.529344 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cde648a0-2257-428d-b16e-75b6a4674b53-kube-api-access-srgqv" (OuterVolumeSpecName: "kube-api-access-srgqv") pod "cde648a0-2257-428d-b16e-75b6a4674b53" (UID: "cde648a0-2257-428d-b16e-75b6a4674b53"). InnerVolumeSpecName "kube-api-access-srgqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 07:06:47.535069 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.535034 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" path="/var/lib/kubelet/pods/cde648a0-2257-428d-b16e-75b6a4674b53/volumes" Sep 08 07:06:47.628026 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.627986 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srgqv\" (UniqueName: \"kubernetes.io/projected/cde648a0-2257-428d-b16e-75b6a4674b53-kube-api-access-srgqv\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 07:06:47.628026 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.628018 2581 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cde648a0-2257-428d-b16e-75b6a4674b53-must-gather-output\") on node \"ip-10-0-135-120.ec2.internal\" DevicePath \"\"" Sep 08 07:06:47.927055 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.926976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hq9lf_must-gather-5lkp6_cde648a0-2257-428d-b16e-75b6a4674b53/copy/0.log" Sep 08 07:06:47.927347 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.927322 2581 generic.go:356] "Generic (PLEG): container finished" podID="cde648a0-2257-428d-b16e-75b6a4674b53" containerID="2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64" exitCode=143 Sep 08 07:06:47.927411 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.927386 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hq9lf/must-gather-5lkp6" Sep 08 07:06:47.927411 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.927392 2581 scope.go:117] "RemoveContainer" containerID="2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64" Sep 08 07:06:47.933696 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.933659 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:47.936882 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.936866 2581 scope.go:117] "RemoveContainer" containerID="2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300" Sep 08 07:06:47.948692 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.948674 2581 scope.go:117] "RemoveContainer" containerID="2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64" Sep 08 07:06:47.948960 ip-10-0-135-120 kubenswrapper[2581]: E0908 07:06:47.948936 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64\": container with ID starting with 2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64 not found: ID does not exist" containerID="2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64" Sep 08 07:06:47.949047 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.948970 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64"} err="failed to get container status \"2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64\": rpc error: code = NotFound desc = could not find container \"2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64\": container with ID starting with 2fc07e2637838cf90c22b250b350ab95db0fc54c874aad35caad874e69fe2b64 not found: ID does not exist" Sep 08 07:06:47.949047 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.948991 2581 scope.go:117] "RemoveContainer" containerID="2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300" Sep 08 07:06:47.949192 ip-10-0-135-120 kubenswrapper[2581]: E0908 07:06:47.949179 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300\": container with ID starting with 2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300 not found: ID does not exist" containerID="2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300" Sep 08 07:06:47.949229 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:47.949196 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300"} err="failed to get container status \"2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300\": rpc error: code = NotFound desc = could not find container \"2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300\": container with ID starting with 2b427b01fd3fd9f048ed362314dfbc094acdd4dce49980ed407220a3d45ee300 not found: ID does not exist" Sep 08 07:06:48.033550 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:48.033519 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gf2tr_f4df9ea7-1d58-410c-bb5a-741db75d7bf2/konnectivity-agent/0.log" limit=1024 Sep 08 07:06:48.877794 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:48.877764 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-sd4ms_bfbcc625-4c68-4958-b8c2-859fdcfb23f4/cluster-monitoring-operator/0.log" Sep 08 07:06:49.072685 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:49.072656 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-xxj2q_f977af7d-cda4-404f-8e12-6a362b2c9645/monitoring-plugin/0.log" Sep 08 07:06:49.215776 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:49.215680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-flfvk_b98fb29e-7831-4a23-be51-3ef86226dbfe/node-exporter/0.log" Sep 08 07:06:49.252897 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:49.252870 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-flfvk_b98fb29e-7831-4a23-be51-3ef86226dbfe/kube-rbac-proxy/0.log" Sep 08 07:06:49.290259 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:49.290232 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-flfvk_b98fb29e-7831-4a23-be51-3ef86226dbfe/init-textfile/0.log" Sep 08 07:06:49.897096 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:49.897033 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-zm8lq_ef895a8a-7517-4ae0-9f69-43c9d6d04638/prometheus-operator/0.log" Sep 08 07:06:49.916377 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:49.916357 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-zm8lq_ef895a8a-7517-4ae0-9f69-43c9d6d04638/kube-rbac-proxy/0.log" Sep 08 07:06:49.939866 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:49.939840 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-9xh5r_c891d28c-a8b0-4edb-a424-2f22e5bd9877/prometheus-operator-admission-webhook/0.log" Sep 08 07:06:50.054199 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:50.054170 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665b7d545b-6x54w_b5fff704-505b-4f6f-8ab1-5f0f86b62e80/thanos-query/0.log" Sep 08 07:06:50.073420 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:50.073391 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665b7d545b-6x54w_b5fff704-505b-4f6f-8ab1-5f0f86b62e80/kube-rbac-proxy-web/0.log" Sep 08 07:06:50.094031 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:50.094007 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665b7d545b-6x54w_b5fff704-505b-4f6f-8ab1-5f0f86b62e80/kube-rbac-proxy/0.log" Sep 08 07:06:50.118357 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:50.118334 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665b7d545b-6x54w_b5fff704-505b-4f6f-8ab1-5f0f86b62e80/prom-label-proxy/0.log" Sep 08 07:06:50.139468 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:50.139447 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665b7d545b-6x54w_b5fff704-505b-4f6f-8ab1-5f0f86b62e80/kube-rbac-proxy-rules/0.log" Sep 08 07:06:50.165424 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:50.165332 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-665b7d545b-6x54w_b5fff704-505b-4f6f-8ab1-5f0f86b62e80/kube-rbac-proxy-metrics/0.log" Sep 08 07:06:52.259804 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.259774 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2"] Sep 08 07:06:52.260193 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.260073 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" containerName="copy" Sep 08 07:06:52.260193 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.260087 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" containerName="copy" Sep 08 07:06:52.260193 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.260101 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" containerName="gather" Sep 08 07:06:52.260193 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.260106 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" containerName="gather" Sep 08 07:06:52.260193 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.260153 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" containerName="gather" Sep 08 07:06:52.260193 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.260161 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cde648a0-2257-428d-b16e-75b6a4674b53" containerName="copy" Sep 08 07:06:52.264340 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.264320 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.266913 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.266889 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fnk5h\"/\"default-dockercfg-ghdj6\"" Sep 08 07:06:52.267014 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.266889 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fnk5h\"/\"kube-root-ca.crt\"" Sep 08 07:06:52.267014 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.266889 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fnk5h\"/\"openshift-service-ca.crt\"" Sep 08 07:06:52.278538 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.278508 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2"] Sep 08 07:06:52.364014 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.363961 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-lib-modules\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.364014 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.364020 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-podres\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.364358 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.364048 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-proc\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.364358 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.364092 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-sys\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.364358 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.364151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r2ms\" (UniqueName: \"kubernetes.io/projected/0d189823-3e63-4d96-8562-febde6c895b2-kube-api-access-6r2ms\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465417 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465365 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-lib-modules\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465417 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465426 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-podres\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465676 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465446 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-proc\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465676 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465470 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-sys\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465676 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r2ms\" (UniqueName: \"kubernetes.io/projected/0d189823-3e63-4d96-8562-febde6c895b2-kube-api-access-6r2ms\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465676 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465544 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-proc\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465676 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465552 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-sys\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465676 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-podres\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.465676 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.465550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0d189823-3e63-4d96-8562-febde6c895b2-lib-modules\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.473500 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.473475 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r2ms\" (UniqueName: \"kubernetes.io/projected/0d189823-3e63-4d96-8562-febde6c895b2-kube-api-access-6r2ms\") pod \"perf-node-gather-daemonset-rrmr2\" (UID: \"0d189823-3e63-4d96-8562-febde6c895b2\") " pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.575080 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.574988 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.842771 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.842693 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2"] Sep 08 07:06:52.846316 ip-10-0-135-120 kubenswrapper[2581]: W0908 07:06:52.846282 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d189823_3e63_4d96_8562_febde6c895b2.slice/crio-caef55299150ec8938666fd3bd7324ac0e5849488a06f6341c0f46c0a99fe878 WatchSource:0}: Error finding container caef55299150ec8938666fd3bd7324ac0e5849488a06f6341c0f46c0a99fe878: Status 404 returned error can't find the container with id caef55299150ec8938666fd3bd7324ac0e5849488a06f6341c0f46c0a99fe878 Sep 08 07:06:52.948434 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.948399 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" event={"ID":"0d189823-3e63-4d96-8562-febde6c895b2","Type":"ContainerStarted","Data":"7ff4839a13983810b20bd5464c93fe80c46957a0a1f67f0e76ed840729d02761"} Sep 08 07:06:52.948678 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.948454 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" event={"ID":"0d189823-3e63-4d96-8562-febde6c895b2","Type":"ContainerStarted","Data":"caef55299150ec8938666fd3bd7324ac0e5849488a06f6341c0f46c0a99fe878"} Sep 08 07:06:52.948678 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.948484 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:06:52.963741 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:52.963694 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" podStartSLOduration=0.963675236 podStartE2EDuration="963.675236ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 07:06:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 07:06:52.963315389 +0000 UTC m=+1919.913713231" watchObservedRunningTime="2026-09-08 07:06:52.963675236 +0000 UTC m=+1919.914073078" Sep 08 07:06:53.676783 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:53.676756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jjwd2_1c3645c6-0b9b-4b40-b51b-5154985cda53/dns/0.log" Sep 08 07:06:53.696204 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:53.696169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jjwd2_1c3645c6-0b9b-4b40-b51b-5154985cda53/kube-rbac-proxy/0.log" Sep 08 07:06:53.760381 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:53.760355 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-57bmd_bde28304-d067-452d-8c76-514bdd952e5c/dns-node-resolver/0.log" Sep 08 07:06:54.206498 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:54.206473 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5pq5q_cf08eff7-23af-470a-8755-3a6ee691b2ae/node-ca/0.log" Sep 08 07:06:55.249489 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:55.249460 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c6ft7_46c4ec53-1e42-4245-8069-87b30a351ca7/serve-healthcheck-canary/0.log" Sep 08 07:06:55.684474 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:55.684421 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpmfp_ad000d3f-b193-46cc-9748-77789f25be04/kube-rbac-proxy/0.log" Sep 08 07:06:55.703852 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:55.703829 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpmfp_ad000d3f-b193-46cc-9748-77789f25be04/exporter/0.log" Sep 08 07:06:55.723554 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:55.723527 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpmfp_ad000d3f-b193-46cc-9748-77789f25be04/extractor/0.log" Sep 08 07:06:58.962692 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:06:58.962665 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fnk5h/perf-node-gather-daemonset-rrmr2" Sep 08 07:07:01.188533 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.188509 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s6cd_6e072f8a-d3d4-4427-b9fb-56503ce678c8/kube-multus-additional-cni-plugins/0.log" Sep 08 07:07:01.213477 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.213443 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s6cd_6e072f8a-d3d4-4427-b9fb-56503ce678c8/egress-router-binary-copy/0.log" Sep 08 07:07:01.239800 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.239719 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s6cd_6e072f8a-d3d4-4427-b9fb-56503ce678c8/cni-plugins/0.log" Sep 08 07:07:01.267345 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.267320 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s6cd_6e072f8a-d3d4-4427-b9fb-56503ce678c8/bond-cni-plugin/0.log" Sep 08 07:07:01.291990 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.291964 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s6cd_6e072f8a-d3d4-4427-b9fb-56503ce678c8/routeoverride-cni/0.log" Sep 08 07:07:01.316389 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.316361 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s6cd_6e072f8a-d3d4-4427-b9fb-56503ce678c8/whereabouts-cni-bincopy/0.log" Sep 08 07:07:01.339113 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.339085 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9s6cd_6e072f8a-d3d4-4427-b9fb-56503ce678c8/whereabouts-cni/0.log" Sep 08 07:07:01.775080 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.775053 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gc7mf_354816ae-ce0a-43bc-bc72-f5dcf1cac013/kube-multus/0.log" Sep 08 07:07:01.975335 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.975262 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wrk2m_f3926a42-8ed3-4688-81da-3867f79e57d6/network-metrics-daemon/0.log" Sep 08 07:07:01.996973 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:01.996939 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wrk2m_f3926a42-8ed3-4688-81da-3867f79e57d6/kube-rbac-proxy/0.log" Sep 08 07:07:02.897190 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:02.897153 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-controller/0.log" Sep 08 07:07:02.917061 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:02.917031 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/0.log" Sep 08 07:07:02.917218 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:02.917031 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovn-acl-logging/1.log" Sep 08 07:07:02.934246 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:02.934214 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/kube-rbac-proxy-node/0.log" Sep 08 07:07:02.956326 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:02.956294 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 07:07:02.976332 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:02.976307 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/northd/0.log" Sep 08 07:07:03.004518 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:03.004450 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/nbdb/0.log" Sep 08 07:07:03.025732 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:03.025709 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/sbdb/0.log" Sep 08 07:07:03.059362 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:03.059329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ht5wl_880c9e35-1d4c-4fad-9ebc-828cbd197bc2/ovnkube-controller/0.log" Sep 08 07:07:04.201622 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:04.201588 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-cqhzt_7351d60e-d131-459f-b79f-91c9d5c161de/network-check-target-container/0.log" Sep 08 07:07:05.191491 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:05.191460 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-f6pr6_2c3eefb3-8419-430a-9dc7-68eb9c326d8d/iptables-alerter/0.log" Sep 08 07:07:05.894504 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:05.894474 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-26nnz_a47c6588-4fa7-40f1-ba73-28705742078e/tuned/0.log" Sep 08 07:07:07.698925 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:07.698900 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-wpgd2_36927311-5eaf-4861-a44f-ce10fcbd0083/cluster-samples-operator/0.log" Sep 08 07:07:07.713953 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:07.713921 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-wpgd2_36927311-5eaf-4861-a44f-ce10fcbd0083/cluster-samples-operator-watch/0.log" Sep 08 07:07:08.645413 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:08.645382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-hnt6j_3b254dbe-e7b3-49b3-baf5-7f15f2dd9714/service-ca-operator/1.log" Sep 08 07:07:08.646407 ip-10-0-135-120 kubenswrapper[2581]: I0908 07:07:08.646391 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-hnt6j_3b254dbe-e7b3-49b3-baf5-7f15f2dd9714/service-ca-operator/0.log"