Sep 11 05:18:29.178117 ip-10-0-138-238 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 11 05:18:29.178128 ip-10-0-138-238 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 11 05:18:29.178135 ip-10-0-138-238 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 11 05:18:29.178285 ip-10-0-138-238 systemd[1]: Failed to start Kubernetes Kubelet. Sep 11 05:18:39.190155 ip-10-0-138-238 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 11 05:18:39.190170 ip-10-0-138-238 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5f1275041e8b47beb0628f169cadb547 -- Sep 11 05:20:10.150861 ip-10-0-138-238 systemd[1]: Starting Kubernetes Kubelet... Sep 11 05:20:10.598760 ip-10-0-138-238 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 05:20:10.598760 ip-10-0-138-238 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 11 05:20:10.598760 ip-10-0-138-238 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 05:20:10.598760 ip-10-0-138-238 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 11 05:20:10.598760 ip-10-0-138-238 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 11 05:20:10.601807 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.601693 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 11 05:20:10.604905 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604890 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 05:20:10.604905 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604905 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604909 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604912 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604915 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604918 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604921 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604924 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604927 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604929 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604933 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604937 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604942 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604946 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604948 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604951 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604954 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604957 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604959 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604962 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604964 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 05:20:10.604973 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604967 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604974 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604978 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604981 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604984 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604987 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604989 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604992 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604994 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.604997 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605000 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605004 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605007 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605010 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605013 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605016 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605019 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605021 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605024 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 05:20:10.605441 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605027 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605029 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605032 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605035 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605037 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605040 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605042 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605045 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605048 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605050 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605052 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605055 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605057 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605060 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605063 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605066 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605068 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605071 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605074 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 05:20:10.605912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605076 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605079 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605081 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605084 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605086 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605089 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605091 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605094 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605096 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605099 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605101 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605105 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605107 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605110 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605112 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605115 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605117 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605120 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605123 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605126 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 05:20:10.606452 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605128 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605130 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605133 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605135 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605138 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605140 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605143 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605147 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605151 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605154 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605157 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605160 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605163 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605166 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605168 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605171 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605174 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605176 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605178 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 05:20:10.606990 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605181 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605887 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605894 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605897 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605899 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605902 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605905 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605908 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605911 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605914 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605917 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605919 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605923 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605925 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605928 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605931 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605934 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605936 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605939 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605942 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 05:20:10.607455 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605945 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605948 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605950 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605953 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605956 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605958 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605961 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605963 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605966 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605969 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605972 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605975 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605977 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605980 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605982 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605985 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605987 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605990 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605993 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605995 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 05:20:10.607979 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.605998 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606000 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606003 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606005 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606009 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606014 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606017 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606020 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606023 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606026 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606028 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606032 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606035 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606039 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606042 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606045 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606048 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606050 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606053 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606056 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 05:20:10.608467 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606058 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606061 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606063 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606066 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606068 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606071 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606073 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606076 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606079 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606081 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606084 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606086 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606091 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606094 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606097 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606100 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606102 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606105 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606108 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 05:20:10.608974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606110 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606113 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606116 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606118 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606121 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606124 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606127 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606129 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606132 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606134 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606138 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606142 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606145 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606147 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606150 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606152 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606155 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606158 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606160 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 05:20:10.609445 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606163 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606165 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606584 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606591 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606594 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606597 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606600 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606604 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606606 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606609 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606612 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606614 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606618 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606620 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606623 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606627 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606630 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606633 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606636 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606638 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 05:20:10.609931 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606641 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606643 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606645 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606648 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606651 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606653 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606656 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606658 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606661 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606664 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606666 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606669 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606672 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606674 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606677 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606679 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606682 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606684 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606687 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606690 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 05:20:10.610424 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606693 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606695 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606698 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606700 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606703 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606706 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606708 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606711 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606714 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606717 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606720 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606722 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606725 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606729 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606733 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606736 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606739 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606742 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606744 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606747 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 05:20:10.610920 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606749 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606752 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606755 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606757 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606760 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606762 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606765 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606767 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606770 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606772 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606775 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606777 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606782 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606785 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606788 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606791 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606794 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606797 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606800 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 05:20:10.611411 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606804 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606807 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606810 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606812 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606815 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606817 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606820 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606824 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606827 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606830 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606833 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606836 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606838 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606841 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606843 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606846 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606848 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606851 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606854 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 05:20:10.611929 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606856 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606859 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.606861 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.606928 2569 flags.go:64] FLAG: --address="0.0.0.0" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.606971 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.606978 2569 flags.go:64] FLAG: --anonymous-auth="true" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.606983 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.606986 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.606989 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.606994 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.606998 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607001 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607004 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607011 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607014 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607018 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607021 2569 flags.go:64] FLAG: --cgroup-root="" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607023 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607026 2569 flags.go:64] FLAG: --client-ca-file="" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607029 2569 flags.go:64] FLAG: --cloud-provider="external" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607032 2569 flags.go:64] FLAG: --cluster-dns="[]" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607037 2569 flags.go:64] FLAG: --cluster-domain="" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607040 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 11 05:20:10.612391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607043 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607046 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607049 2569 flags.go:64] FLAG: --container-log-max-files="5" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607053 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607056 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607059 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607062 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607065 2569 flags.go:64] FLAG: --contention-profiling="false" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607068 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607071 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607074 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607077 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607081 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607084 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607087 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607089 2569 flags.go:64] FLAG: --enable-load-reader="false" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607092 2569 flags.go:64] FLAG: --enable-server="true" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607095 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607099 2569 flags.go:64] FLAG: --event-burst="100" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607102 2569 flags.go:64] FLAG: --event-qps="50" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607105 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607108 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607113 2569 flags.go:64] FLAG: --eviction-hard="" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607117 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 11 05:20:10.612969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607120 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607123 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607126 2569 flags.go:64] FLAG: --eviction-soft="" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607129 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607132 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607135 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607138 2569 flags.go:64] FLAG: --experimental-mounter-path="" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607141 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607144 2569 flags.go:64] FLAG: --fail-swap-on="true" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607147 2569 flags.go:64] FLAG: --feature-gates="" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607150 2569 flags.go:64] FLAG: --file-check-frequency="20s" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607153 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607156 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607160 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607163 2569 flags.go:64] FLAG: --healthz-port="10248" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607166 2569 flags.go:64] FLAG: --help="false" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607168 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607172 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607175 2569 flags.go:64] FLAG: --http-check-frequency="20s" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607178 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607181 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607185 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607187 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 11 05:20:10.613529 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607190 2569 flags.go:64] FLAG: --image-service-endpoint="" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607193 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607196 2569 flags.go:64] FLAG: --kube-api-burst="100" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607199 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607202 2569 flags.go:64] FLAG: --kube-api-qps="50" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607205 2569 flags.go:64] FLAG: --kube-reserved="" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607208 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607213 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607216 2569 flags.go:64] FLAG: --kubelet-cgroups="" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607223 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607226 2569 flags.go:64] FLAG: --lock-file="" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607230 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607233 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607236 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607241 2569 flags.go:64] FLAG: --log-json-split-stream="false" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607244 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607254 2569 flags.go:64] FLAG: --log-text-split-stream="false" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607257 2569 flags.go:64] FLAG: --logging-format="text" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607260 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607264 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607267 2569 flags.go:64] FLAG: --manifest-url="" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607269 2569 flags.go:64] FLAG: --manifest-url-header="" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607274 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607277 2569 flags.go:64] FLAG: --max-open-files="1000000" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607281 2569 flags.go:64] FLAG: --max-pods="110" Sep 11 05:20:10.614123 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607283 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607286 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607289 2569 flags.go:64] FLAG: --memory-manager-policy="None" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607292 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607295 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607298 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607302 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607309 2569 flags.go:64] FLAG: --node-status-max-images="50" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607312 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607315 2569 flags.go:64] FLAG: --oom-score-adj="-999" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607318 2569 flags.go:64] FLAG: --pod-cidr="" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607321 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607326 2569 flags.go:64] FLAG: --pod-manifest-path="" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607329 2569 flags.go:64] FLAG: --pod-max-pids="-1" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607335 2569 flags.go:64] FLAG: --pods-per-core="0" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607339 2569 flags.go:64] FLAG: --port="10250" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607342 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607352 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00691a2f2fd9a631a" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607356 2569 flags.go:64] FLAG: --qos-reserved="" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607359 2569 flags.go:64] FLAG: --read-only-port="10255" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607362 2569 flags.go:64] FLAG: --register-node="true" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607364 2569 flags.go:64] FLAG: --register-with-taints="" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607368 2569 flags.go:64] FLAG: --registry-burst="10" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607371 2569 flags.go:64] FLAG: --registry-qps="5" Sep 11 05:20:10.614745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607374 2569 flags.go:64] FLAG: --reserved-cpus="" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607376 2569 flags.go:64] FLAG: --reserved-memory="" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607384 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607387 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607390 2569 flags.go:64] FLAG: --rotate-certificates="false" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607393 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607396 2569 flags.go:64] FLAG: --runonce="false" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607398 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607401 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607404 2569 flags.go:64] FLAG: --seccomp-default="false" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607407 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607410 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607413 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607416 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607419 2569 flags.go:64] FLAG: --storage-driver-password="root" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607421 2569 flags.go:64] FLAG: --storage-driver-secure="false" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607424 2569 flags.go:64] FLAG: --storage-driver-table="stats" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607427 2569 flags.go:64] FLAG: --storage-driver-user="root" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607430 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607433 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607436 2569 flags.go:64] FLAG: --system-cgroups="" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607438 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607445 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607449 2569 flags.go:64] FLAG: --tls-cert-file="" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607452 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 11 05:20:10.615348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607457 2569 flags.go:64] FLAG: --tls-min-version="" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607460 2569 flags.go:64] FLAG: --tls-private-key-file="" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607463 2569 flags.go:64] FLAG: --topology-manager-policy="none" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607466 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607469 2569 flags.go:64] FLAG: --topology-manager-scope="container" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607472 2569 flags.go:64] FLAG: --v="2" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607476 2569 flags.go:64] FLAG: --version="false" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607480 2569 flags.go:64] FLAG: --vmodule="" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607484 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.607487 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607616 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607620 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607623 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607626 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607628 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607631 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607634 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607636 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607639 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607641 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607644 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 05:20:10.615976 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607647 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607651 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607655 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607658 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607661 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607664 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607667 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607670 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607674 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607679 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607682 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607685 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607688 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607691 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607693 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607696 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607699 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607701 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607704 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 05:20:10.616481 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607707 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607709 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607712 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607715 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607717 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607720 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607722 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607725 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607728 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607730 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607734 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607738 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607741 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607744 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607747 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607749 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607752 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607755 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607758 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 05:20:10.617012 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607760 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607763 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607766 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607771 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607774 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607776 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607779 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607781 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607785 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607788 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607790 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607793 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607797 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607801 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607804 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607807 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607809 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607812 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607814 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607817 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 05:20:10.617477 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607820 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607829 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607832 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607834 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607837 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607840 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607842 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607845 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607848 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607850 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607853 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607856 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607859 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607861 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607864 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607868 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607870 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607873 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607876 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607878 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607881 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 05:20:10.617974 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607884 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607887 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607889 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607897 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607901 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607904 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607907 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607910 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.607912 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.609198 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.616445 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.616460 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.616478 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.616484 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616561 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 05:20:10.618479 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616566 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616570 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616573 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616576 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616579 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616582 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616585 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616588 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616591 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616594 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616596 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616599 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616602 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616605 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616608 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616610 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616613 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616616 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616618 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616621 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 05:20:10.618896 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616623 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616626 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616628 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616631 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616634 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616637 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616639 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616642 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616646 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616648 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616651 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616654 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616657 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616659 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616662 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616664 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616667 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616669 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616672 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616675 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 05:20:10.619377 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616679 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616683 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616686 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616689 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616693 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616696 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616698 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616702 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616704 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616707 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616710 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616713 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616716 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616720 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616723 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616725 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616728 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616731 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616733 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 05:20:10.619867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616736 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616740 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616744 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616747 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616750 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616753 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616756 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616760 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616762 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616765 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616768 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616771 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616774 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616777 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616779 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616782 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616785 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616788 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616790 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 05:20:10.620333 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616793 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616795 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616798 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616800 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616803 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616805 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616808 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616810 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616813 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616816 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616818 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616821 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616823 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616826 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616828 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616831 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616834 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616837 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616839 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 05:20:10.620858 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616842 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.616847 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616954 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616959 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616962 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616965 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616968 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616972 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616977 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616980 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616983 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616986 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616989 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616991 2569 feature_gate.go:328] unrecognized feature gate: Example Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616994 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 11 05:20:10.621316 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616997 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.616999 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617002 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617004 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617007 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617010 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617012 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617015 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617018 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617020 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617023 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617026 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617028 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617031 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617034 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617037 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617039 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617042 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617045 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 11 05:20:10.621697 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617047 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617050 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617052 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617055 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617058 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617060 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617063 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617065 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617068 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617070 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617073 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617075 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617078 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617080 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617083 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617086 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617088 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617091 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617093 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617096 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 11 05:20:10.622146 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617098 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617101 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617103 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617106 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617108 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617111 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617114 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617117 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617119 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617123 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617125 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617128 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617131 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617133 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617136 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617138 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617141 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617144 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617147 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 11 05:20:10.622633 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617149 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617152 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617155 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617157 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617160 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617162 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617164 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617167 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617170 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617172 2569 feature_gate.go:328] unrecognized feature gate: Example2 Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617175 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617177 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617180 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617182 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617185 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617187 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617190 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617192 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617195 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 11 05:20:10.623090 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617199 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617202 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617205 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617208 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617211 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617214 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617217 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617219 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:10.617222 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.617226 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.617322 2569 server.go:962] "Client rotation is on, will bootstrap in background" Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.619688 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.620779 2569 server.go:1019] "Starting client certificate rotation" Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.620870 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 05:20:10.623575 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.620930 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 11 05:20:10.623974 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.623960 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 05:20:10.626113 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.626090 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 11 05:20:10.635471 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.635452 2569 log.go:25] "Validated CRI v1 runtime API" Sep 11 05:20:10.638673 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.638657 2569 log.go:25] "Validated CRI v1 image API" Sep 11 05:20:10.639440 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.639426 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 11 05:20:10.641967 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.641934 2569 fs.go:135] Filesystem UUIDs: map[36be559d-bd52-4fc0-a04a-86ddc9cadf50:/dev/nvme0n1p3 734f28a7-7d23-4bce-b896-d8f2c509eed4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 11 05:20:10.642098 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.641967 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 11 05:20:10.647884 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.647773 2569 manager.go:216] Machine: {Timestamp:2026-09-11 05:20:10.64641695 +0000 UTC m=+0.370596585 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101551 MemoryCapacity:33164464128 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21d8dda3595ae720e1ec6afcb43065 SystemUUID:ec21d8dd-a359-5ae7-20e1-ec6afcb43065 BootID:5f127504-1e8b-47be-b062-8f169cadb547 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582230016 Type:vfs Inodes:4048396 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:eb:0d:da:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:eb:0d:da:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:77:4c:8c:30:64 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164464128 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 11 05:20:10.647884 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.647876 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 11 05:20:10.647999 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.647952 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 11 05:20:10.651443 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.651412 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 11 05:20:10.651666 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.651446 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 11 05:20:10.651750 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.651657 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 05:20:10.652341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.652329 2569 topology_manager.go:138] "Creating topology manager with none policy" Sep 11 05:20:10.652400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.652347 2569 container_manager_linux.go:309] "Creating device plugin manager" Sep 11 05:20:10.652400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.652358 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 05:20:10.653220 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.653208 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 11 05:20:10.654431 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.654420 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 11 05:20:10.659063 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659050 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 11 05:20:10.659191 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659180 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 11 05:20:10.659256 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659222 2569 kubelet.go:486] "Attempting to sync node with API server" Sep 11 05:20:10.659256 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659243 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 11 05:20:10.659348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659257 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 11 05:20:10.659348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659274 2569 kubelet.go:398] "Adding apiserver pod source" Sep 11 05:20:10.659348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659287 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 11 05:20:10.659648 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659634 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 05:20:10.659719 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.659656 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 11 05:20:10.662731 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.662714 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 11 05:20:10.664981 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.664967 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 11 05:20:10.665028 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.665009 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 11 05:20:10.667165 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667152 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667171 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667178 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667183 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667192 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667197 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667210 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667215 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667224 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 11 05:20:10.667227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667230 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 11 05:20:10.667464 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667242 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 11 05:20:10.667464 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.667248 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 11 05:20:10.668196 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.668182 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 11 05:20:10.668235 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.668198 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 11 05:20:10.670868 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.670843 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 11 05:20:10.670868 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.670863 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 11 05:20:10.670964 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.670843 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 11 05:20:10.672213 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.672199 2569 server.go:1268] "Started kubelet" Sep 11 05:20:10.672318 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.672264 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 11 05:20:10.672450 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.672299 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 11 05:20:10.672519 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.672464 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 11 05:20:10.673082 ip-10-0-138-238 systemd[1]: Started Kubernetes Kubelet. Sep 11 05:20:10.679120 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.677580 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 11 05:20:10.679120 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.678318 2569 server.go:310] "Adding debug handlers to kubelet server" Sep 11 05:20:10.680073 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.680053 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 11 05:20:10.685412 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.685394 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 11 05:20:10.686797 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.686779 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 11 05:20:10.686868 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.685759 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-238.ec2.internal.18d42c9e5e575bb5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-238.ec2.internal,UID:ip-10-0-138-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-238.ec2.internal,},FirstTimestamp:2026-09-11 05:20:10.672167861 +0000 UTC m=+0.396347496,LastTimestamp:2026-09-11 05:20:10.672167861 +0000 UTC m=+0.396347496,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-238.ec2.internal,}" Sep 11 05:20:10.686932 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.686871 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:10.687498 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687480 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 11 05:20:10.687498 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687499 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 11 05:20:10.687633 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687481 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 11 05:20:10.687633 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687592 2569 reconstruct.go:97] "Volume reconstruction finished" Sep 11 05:20:10.687633 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687600 2569 reconciler.go:29] "Reconciler: start to sync state" Sep 11 05:20:10.687633 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687611 2569 factory.go:55] Registering systemd factory Sep 11 05:20:10.687633 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687625 2569 factory.go:223] Registration of the systemd container factory successfully Sep 11 05:20:10.687865 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687819 2569 factory.go:153] Registering CRI-O factory Sep 11 05:20:10.687865 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687830 2569 factory.go:223] Registration of the crio container factory successfully Sep 11 05:20:10.687974 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687871 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 11 05:20:10.687974 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687885 2569 factory.go:103] Registering Raw factory Sep 11 05:20:10.687974 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.687905 2569 manager.go:1196] Started watching for new ooms in manager Sep 11 05:20:10.688305 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.688289 2569 manager.go:349] Starting recovery of all containers Sep 11 05:20:10.693636 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.693596 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 11 05:20:10.693735 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.693716 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 11 05:20:10.699074 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.699057 2569 manager.go:354] Recovery completed Sep 11 05:20:10.703668 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.703656 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 05:20:10.704925 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.704906 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6wjlm" Sep 11 05:20:10.705135 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.705121 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientMemory" Sep 11 05:20:10.705211 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.705152 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 05:20:10.705211 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.705167 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientPID" Sep 11 05:20:10.705749 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.705734 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 05:20:10.705812 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.705739 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 11 05:20:10.705812 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.705798 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 11 05:20:10.705901 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.705814 2569 state_mem.go:36] "Initialized new in-memory state store" Sep 11 05:20:10.706407 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.706392 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientMemory" Sep 11 05:20:10.706483 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.706419 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 05:20:10.706483 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.706428 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientPID" Sep 11 05:20:10.706717 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.706660 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-238.ec2.internal.18d42c9e604e6a4a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-238.ec2.internal,UID:ip-10-0-138-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-238.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-238.ec2.internal,},FirstTimestamp:2026-09-11 05:20:10.705136202 +0000 UTC m=+0.429315841,LastTimestamp:2026-09-11 05:20:10.705136202 +0000 UTC m=+0.429315841,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-238.ec2.internal,}" Sep 11 05:20:10.707968 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.707957 2569 policy_none.go:49] "None policy: Start" Sep 11 05:20:10.708017 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.707972 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 11 05:20:10.708017 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.707982 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 11 05:20:10.709914 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.709902 2569 policy_none.go:47] "Start" Sep 11 05:20:10.713154 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.713136 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6wjlm" Sep 11 05:20:10.715227 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.715169 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-238.ec2.internal.18d42c9e604ec57d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-238.ec2.internal,UID:ip-10-0-138-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-238.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-238.ec2.internal,},FirstTimestamp:2026-09-11 05:20:10.705159549 +0000 UTC m=+0.429339190,LastTimestamp:2026-09-11 05:20:10.705159549 +0000 UTC m=+0.429339190,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-238.ec2.internal,}" Sep 11 05:20:10.718931 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.716940 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-238.ec2.internal.18d42c9e604ef7a0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-238.ec2.internal,UID:ip-10-0-138-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-238.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-238.ec2.internal,},FirstTimestamp:2026-09-11 05:20:10.705172384 +0000 UTC m=+0.429352025,LastTimestamp:2026-09-11 05:20:10.705172384 +0000 UTC m=+0.429352025,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-238.ec2.internal,}" Sep 11 05:20:10.735080 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.735067 2569 manager.go:337] "Starting Device Plugin manager" Sep 11 05:20:10.735154 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.735104 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 11 05:20:10.735154 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.735113 2569 server.go:87] "Starting device plugin registration server" Sep 11 05:20:10.735401 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.735391 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 11 05:20:10.735466 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.735403 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 11 05:20:10.735623 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.735536 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 11 05:20:10.735623 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.735614 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 11 05:20:10.735623 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.735623 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 11 05:20:10.737553 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.737520 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 11 05:20:10.737626 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.737604 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:10.755383 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.755354 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 11 05:20:10.766454 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.756619 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 11 05:20:10.766454 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.756673 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 11 05:20:10.766454 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.756695 2569 kubelet.go:2448] "Starting kubelet main sync loop" Sep 11 05:20:10.766454 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.756734 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 11 05:20:10.766454 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.758369 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 05:20:10.835526 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.835507 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 05:20:10.836336 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.836320 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientMemory" Sep 11 05:20:10.836406 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.836349 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 05:20:10.836406 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.836358 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientPID" Sep 11 05:20:10.836406 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.836378 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.846395 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.846379 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.846461 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.846398 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-238.ec2.internal\": node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:10.857427 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.857366 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal"] Sep 11 05:20:10.857427 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.857424 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 05:20:10.858857 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.858843 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientMemory" Sep 11 05:20:10.858930 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.858871 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 05:20:10.858930 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.858882 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientPID" Sep 11 05:20:10.861141 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861129 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 05:20:10.861251 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861239 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.861291 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861265 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 05:20:10.861795 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861781 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientMemory" Sep 11 05:20:10.861869 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861801 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 05:20:10.861869 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861814 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientPID" Sep 11 05:20:10.861932 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861814 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientMemory" Sep 11 05:20:10.861969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861950 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 05:20:10.861969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.861963 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientPID" Sep 11 05:20:10.864012 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.863996 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.864066 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.864027 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 05:20:10.864757 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.864743 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientMemory" Sep 11 05:20:10.864839 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.864770 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 05:20:10.864839 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.864784 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientPID" Sep 11 05:20:10.871312 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.871295 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:10.888801 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.888780 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad58f719ce68c03137c90aff08168b70-config\") pod \"kube-apiserver-proxy-ip-10-0-138-238.ec2.internal\" (UID: \"ad58f719ce68c03137c90aff08168b70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.888890 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.888804 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a07c4d36ebae0da0db7a784f8d1c502-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal\" (UID: \"9a07c4d36ebae0da0db7a784f8d1c502\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.888890 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.888822 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a07c4d36ebae0da0db7a784f8d1c502-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal\" (UID: \"9a07c4d36ebae0da0db7a784f8d1c502\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.895198 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.895182 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-238.ec2.internal\" not found" node="ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.899588 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.899574 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-238.ec2.internal\" not found" node="ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.972253 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:10.972231 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:10.989637 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.989616 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad58f719ce68c03137c90aff08168b70-config\") pod \"kube-apiserver-proxy-ip-10-0-138-238.ec2.internal\" (UID: \"ad58f719ce68c03137c90aff08168b70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.989637 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.989576 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad58f719ce68c03137c90aff08168b70-config\") pod \"kube-apiserver-proxy-ip-10-0-138-238.ec2.internal\" (UID: \"ad58f719ce68c03137c90aff08168b70\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.989740 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.989691 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a07c4d36ebae0da0db7a784f8d1c502-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal\" (UID: \"9a07c4d36ebae0da0db7a784f8d1c502\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.989740 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.989709 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9a07c4d36ebae0da0db7a784f8d1c502-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal\" (UID: \"9a07c4d36ebae0da0db7a784f8d1c502\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.989805 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.989737 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a07c4d36ebae0da0db7a784f8d1c502-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal\" (UID: \"9a07c4d36ebae0da0db7a784f8d1c502\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:10.989805 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:10.989764 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a07c4d36ebae0da0db7a784f8d1c502-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal\" (UID: \"9a07c4d36ebae0da0db7a784f8d1c502\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:11.072757 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.072716 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.173564 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.173489 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.197871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.197842 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:11.204170 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.204156 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" Sep 11 05:20:11.274472 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.274447 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.374957 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.374936 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.479253 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.479188 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.580330 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.580294 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.620181 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.620160 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 11 05:20:11.620591 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.620296 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 11 05:20:11.680883 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.680860 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.720928 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.720883 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 05:15:11 +0000 UTC" deadline="2028-04-05 12:55:16.327950964 +0000 UTC" Sep 11 05:20:11.720928 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.720916 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13735h35m4.60703849s" Sep 11 05:20:11.781712 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.781683 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.783762 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:11.783732 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad58f719ce68c03137c90aff08168b70.slice/crio-b9dbec981f275c40e6b1c9a30dbe2c824e3877d5954fb2597cc2f75c9cf07c80 WatchSource:0}: Error finding container b9dbec981f275c40e6b1c9a30dbe2c824e3877d5954fb2597cc2f75c9cf07c80: Status 404 returned error can't find the container with id b9dbec981f275c40e6b1c9a30dbe2c824e3877d5954fb2597cc2f75c9cf07c80 Sep 11 05:20:11.784337 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:11.784313 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a07c4d36ebae0da0db7a784f8d1c502.slice/crio-55bc66dd593f3f3eaf37fd979cc4f00af6ae82371b16b013f29b6f595c288e1f WatchSource:0}: Error finding container 55bc66dd593f3f3eaf37fd979cc4f00af6ae82371b16b013f29b6f595c288e1f: Status 404 returned error can't find the container with id 55bc66dd593f3f3eaf37fd979cc4f00af6ae82371b16b013f29b6f595c288e1f Sep 11 05:20:11.789031 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.789016 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 05:20:11.801386 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.801360 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 05:20:11.825753 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.825730 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 11 05:20:11.826647 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.826629 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientMemory" Sep 11 05:20:11.826711 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.826658 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasNoDiskPressure" Sep 11 05:20:11.826711 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.826668 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeHasSufficientPID" Sep 11 05:20:11.842763 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.842745 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 05:20:11.884471 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:11.884445 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-238.ec2.internal\" not found" Sep 11 05:20:11.940703 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.940679 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 05:20:11.987151 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.986979 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" Sep 11 05:20:11.997952 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.997932 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 05:20:11.999164 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:11.999151 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" Sep 11 05:20:12.011187 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.011166 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 11 05:20:12.660266 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.660239 2569 apiserver.go:52] "Watching apiserver" Sep 11 05:20:12.667796 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.667768 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 11 05:20:12.668685 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.668657 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-78lkv","kube-system/global-pull-secret-syncer-l5k7k","kube-system/konnectivity-agent-ww299","openshift-cluster-node-tuning-operator/tuned-c2tv8","openshift-image-registry/node-ca-sh49c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal","openshift-multus/multus-5hvsr","kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx","openshift-dns/node-resolver-cnvp6","openshift-multus/multus-additional-cni-plugins-9f4bx","openshift-multus/network-metrics-daemon-4lj77","openshift-network-diagnostics/network-check-target-vcbgt","openshift-network-operator/iptables-alerter-dpzl5"] Sep 11 05:20:12.671834 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.671811 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.674185 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.674164 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 11 05:20:12.674279 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.674216 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wsvbc\"" Sep 11 05:20:12.674695 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.674482 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 11 05:20:12.674695 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.674497 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 11 05:20:12.674867 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.674724 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:12.674867 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.674745 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 11 05:20:12.674867 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.674803 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:12.677423 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.677002 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:12.679049 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.678852 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p6wfc\"" Sep 11 05:20:12.679154 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.679080 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 11 05:20:12.679409 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.679387 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 11 05:20:12.679642 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.679621 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.682107 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.681889 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 11 05:20:12.682240 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.682218 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 11 05:20:12.682326 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.682273 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.682434 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.682417 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6nbn2\"" Sep 11 05:20:12.684694 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.684286 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 11 05:20:12.684694 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.684389 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-25bhs\"" Sep 11 05:20:12.684861 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.684782 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.685406 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.685386 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 11 05:20:12.685665 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.685600 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 11 05:20:12.685818 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.685800 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 11 05:20:12.687039 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.687016 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 11 05:20:12.687134 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.687056 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 11 05:20:12.687379 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.687361 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 11 05:20:12.687456 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.687406 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mllwz\"" Sep 11 05:20:12.687456 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.687429 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.689210 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.689190 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d5l68\"" Sep 11 05:20:12.689839 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.689570 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 11 05:20:12.689839 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.689624 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 11 05:20:12.689839 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.689689 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 11 05:20:12.691809 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.691784 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.694001 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.693981 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 11 05:20:12.694215 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.694199 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 11 05:20:12.695192 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.695173 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 11 05:20:12.695682 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.695418 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 11 05:20:12.695682 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.695508 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 11 05:20:12.695828 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.695789 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8vkv5\"" Sep 11 05:20:12.695915 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.695894 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 11 05:20:12.696226 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.696209 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.696310 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.696277 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:12.698663 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.698303 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 11 05:20:12.698663 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.698340 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.700654 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.700635 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jxvgs\"" Sep 11 05:20:12.700800 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.700778 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 11 05:20:12.701141 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701091 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.701687 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701664 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 11 05:20:12.701768 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701755 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-hostroot\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.701810 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701783 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysconfig\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.701810 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701807 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-cni-netd\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.701872 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701823 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-systemd-units\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.701872 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701839 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovn-node-metrics-cert\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.701872 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701861 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-kubelet\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.701964 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701880 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-device-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.701964 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701896 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-kubelet\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.701964 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701932 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e013f606-d92b-4a85-acf4-09d132bce1e5-host-slash\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.702092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701966 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-kubernetes\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.702092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.701994 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-var-lib-kubelet\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.702092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702017 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-host\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.702092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702057 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-var-lib-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.702092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702080 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-system-cni-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.702341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702103 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysctl-d\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.702341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702134 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5850659d-ad02-4261-ae58-8a547785ec32-host\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.702341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702158 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-run-netns\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.702341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702230 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-etc-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.702341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702255 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-netns\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.702341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702303 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e013f606-d92b-4a85-acf4-09d132bce1e5-iptables-alerter-script\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.702341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702339 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-sys\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.702708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702383 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkfpk\" (UniqueName: \"kubernetes.io/projected/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-kube-api-access-vkfpk\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.702708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702419 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-cni-multus\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.702708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702449 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db6b5a4e-5ed2-40f7-af21-222e80b573f9-konnectivity-ca\") pod \"konnectivity-agent-ww299\" (UID: \"db6b5a4e-5ed2-40f7-af21-222e80b573f9\") " pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:12.702708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702475 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-env-overrides\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.702708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702558 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-cnibin\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.702708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-conf-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.702708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702678 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-564v9\" (UniqueName: \"kubernetes.io/projected/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-kube-api-access-564v9\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.702708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702702 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovnkube-script-lib\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702727 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gv6w\" (UniqueName: \"kubernetes.io/projected/3266632a-286d-48ef-a7be-e5b0b4581b0b-kube-api-access-8gv6w\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702793 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-lib-modules\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3266632a-286d-48ef-a7be-e5b0b4581b0b-cni-binary-copy\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-daemon-config\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702933 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-sys-fs\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.702970 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190d908a-3215-4b00-9d3c-da12e9fb574c-tmp\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703001 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-multus-certs\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703027 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703063 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlprw\" (UniqueName: \"kubernetes.io/projected/5850659d-ad02-4261-ae58-8a547785ec32-kube-api-access-mlprw\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.703119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703107 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703137 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703174 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj4q9\" (UniqueName: \"kubernetes.io/projected/e013f606-d92b-4a85-acf4-09d132bce1e5-kube-api-access-sj4q9\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703196 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-run\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703238 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-slash\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703277 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-log-socket\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703303 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-k8s-cni-cncf-io\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703358 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-socket-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703389 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703401 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysctl-conf\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.703445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703424 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-systemd\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.703922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703448 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-cni-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.703922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703514 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.703922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703575 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-socket-dir-parent\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.703922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-cni-bin\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.703922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703653 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 11 05:20:12.704284 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.704266 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:12.704415 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.704359 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:12.704504 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.703706 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-etc-kubernetes\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.704670 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.704640 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-registration-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.704798 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.704783 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db6b5a4e-5ed2-40f7-af21-222e80b573f9-agent-certs\") pod \"konnectivity-agent-ww299\" (UID: \"db6b5a4e-5ed2-40f7-af21-222e80b573f9\") " pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:12.704902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.704886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-modprobe-d\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.705008 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.704994 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-cni-bin\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.705181 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705158 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k5h7m\"" Sep 11 05:20:12.705581 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705397 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovnkube-config\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.705674 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705617 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-systemd\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.705674 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-tuned\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.705784 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705713 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d27b8\" (UniqueName: \"kubernetes.io/projected/190d908a-3215-4b00-9d3c-da12e9fb574c-kube-api-access-d27b8\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.705784 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705779 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5850659d-ad02-4261-ae58-8a547785ec32-serviceca\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.705884 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705808 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-ovn\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.705884 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705860 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.705981 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.705902 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-node-log\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.706066 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.706039 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.723898 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.723880 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ds9bf" Sep 11 05:20:12.732449 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.732428 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ds9bf" Sep 11 05:20:12.761211 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.761158 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" event={"ID":"9a07c4d36ebae0da0db7a784f8d1c502","Type":"ContainerStarted","Data":"55bc66dd593f3f3eaf37fd979cc4f00af6ae82371b16b013f29b6f595c288e1f"} Sep 11 05:20:12.762530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.762508 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" event={"ID":"ad58f719ce68c03137c90aff08168b70","Type":"ContainerStarted","Data":"b9dbec981f275c40e6b1c9a30dbe2c824e3877d5954fb2597cc2f75c9cf07c80"} Sep 11 05:20:12.788880 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.788842 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 11 05:20:12.806234 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806204 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-kubelet\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806242 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e013f606-d92b-4a85-acf4-09d132bce1e5-host-slash\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806271 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-kubernetes\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806295 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-var-lib-kubelet\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806317 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-kubelet\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806322 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-host\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806379 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-var-lib-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806408 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-system-cni-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806425 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-host\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806432 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysctl-d\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806460 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5850659d-ad02-4261-ae58-8a547785ec32-host\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.806487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806490 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-cnibin\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806519 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806545 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00440703-718d-4501-9ff5-1d00f39b4ec3-kubelet-config\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806382 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e013f606-d92b-4a85-acf4-09d132bce1e5-host-slash\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806546 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-kubernetes\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806626 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-system-cni-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806630 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-var-lib-kubelet\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806632 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5850659d-ad02-4261-ae58-8a547785ec32-host\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806678 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-var-lib-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806696 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-run-netns\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806724 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-etc-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806748 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-netns\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806775 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e013f606-d92b-4a85-acf4-09d132bce1e5-iptables-alerter-script\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806787 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-run-netns\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806804 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysctl-d\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806812 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-sys\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806838 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfpk\" (UniqueName: \"kubernetes.io/projected/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-kube-api-access-vkfpk\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.807131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806843 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-etc-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806866 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-cni-binary-copy\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806942 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-cni-multus\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806969 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db6b5a4e-5ed2-40f7-af21-222e80b573f9-konnectivity-ca\") pod \"konnectivity-agent-ww299\" (UID: \"db6b5a4e-5ed2-40f7-af21-222e80b573f9\") " pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807005 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-env-overrides\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807033 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807061 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-cnibin\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807103 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-conf-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807130 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-564v9\" (UniqueName: \"kubernetes.io/projected/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-kube-api-access-564v9\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807171 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovnkube-script-lib\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807192 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-sys\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807197 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e41e0543-6109-4304-baaf-2f5c1ef80e11-tmp-dir\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.806875 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-netns\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807239 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gv6w\" (UniqueName: \"kubernetes.io/projected/3266632a-286d-48ef-a7be-e5b0b4581b0b-kube-api-access-8gv6w\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807269 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-lib-modules\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807294 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-cni-multus\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.808193 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807328 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3266632a-286d-48ef-a7be-e5b0b4581b0b-cni-binary-copy\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807376 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-cnibin\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807434 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-conf-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807442 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e013f606-d92b-4a85-acf4-09d132bce1e5-iptables-alerter-script\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807535 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-daemon-config\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807567 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-sys-fs\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807600 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190d908a-3215-4b00-9d3c-da12e9fb574c-tmp\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807639 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-multus-certs\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807689 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807736 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-openvswitch\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807772 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-multus-certs\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807844 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5www\" (UniqueName: \"kubernetes.io/projected/e41e0543-6109-4304-baaf-2f5c1ef80e11-kube-api-access-r5www\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlprw\" (UniqueName: \"kubernetes.io/projected/5850659d-ad02-4261-ae58-8a547785ec32-kube-api-access-mlprw\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.807959 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3266632a-286d-48ef-a7be-e5b0b4581b0b-cni-binary-copy\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808010 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-sys-fs\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808097 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808099 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovnkube-script-lib\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.809262 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808105 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/db6b5a4e-5ed2-40f7-af21-222e80b573f9-konnectivity-ca\") pod \"konnectivity-agent-ww299\" (UID: \"db6b5a4e-5ed2-40f7-af21-222e80b573f9\") " pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808144 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-lib-modules\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808146 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj4q9\" (UniqueName: \"kubernetes.io/projected/e013f606-d92b-4a85-acf4-09d132bce1e5-kube-api-access-sj4q9\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808169 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-run\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808219 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-slash\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808234 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-etc-selinux\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808249 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-log-socket\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-k8s-cni-cncf-io\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808315 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-socket-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808335 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-slash\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808342 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysctl-conf\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808347 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-run\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808373 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfwqd\" (UniqueName: \"kubernetes.io/projected/64063deb-08d8-43d4-9cfb-446b3496652e-kube-api-access-nfwqd\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808379 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-run-k8s-cni-cncf-io\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808400 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-log-socket\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808370 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808397 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-daemon-config\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.810150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808402 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808449 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00440703-718d-4501-9ff5-1d00f39b4ec3-dbus\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808481 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-systemd\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808485 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysctl-conf\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808507 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-socket-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808511 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-cni-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808556 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808570 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-cni-dir\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808574 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-systemd\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808583 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-socket-dir-parent\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808630 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-cni-bin\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808638 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808660 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-etc-kubernetes\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808682 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-registration-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808686 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-multus-socket-dir-parent\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808695 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-host-var-lib-cni-bin\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808715 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db6b5a4e-5ed2-40f7-af21-222e80b573f9-agent-certs\") pod \"konnectivity-agent-ww299\" (UID: \"db6b5a4e-5ed2-40f7-af21-222e80b573f9\") " pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:12.811278 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808723 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-env-overrides\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808744 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-modprobe-d\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808753 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-etc-kubernetes\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808760 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-registration-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-cni-bin\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808794 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovnkube-config\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808817 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-systemd\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808822 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-cni-bin\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808837 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-tuned\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-modprobe-d\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808860 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d27b8\" (UniqueName: \"kubernetes.io/projected/190d908a-3215-4b00-9d3c-da12e9fb574c-kube-api-access-d27b8\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808883 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5850659d-ad02-4261-ae58-8a547785ec32-serviceca\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808906 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-ovn\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808915 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-systemd\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808950 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808972 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-node-log\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.808995 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.812150 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809020 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-system-cni-dir\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809049 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-hostroot\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809070 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysconfig\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809093 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-cni-netd\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809116 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-systemd-units\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809139 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovn-node-metrics-cert\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809163 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e41e0543-6109-4304-baaf-2f5c1ef80e11-hosts-file\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809185 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-node-log\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809199 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3266632a-286d-48ef-a7be-e5b0b4581b0b-hostroot\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809238 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-cni-netd\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809190 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809293 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-sysconfig\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809284 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhzv4\" (UniqueName: \"kubernetes.io/projected/b9079d0d-8a44-4c4e-ba0d-43284c60f675-kube-api-access-hhzv4\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809334 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809335 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-kubelet\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809375 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-device-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809445 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-run-ovn\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809507 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-device-dir\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809532 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovnkube-config\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809547 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-systemd-units\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809590 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-run-ovn-kubernetes\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809589 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-host-kubelet\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.809742 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5850659d-ad02-4261-ae58-8a547785ec32-serviceca\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.813381 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-ovn-node-metrics-cert\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.813525 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/db6b5a4e-5ed2-40f7-af21-222e80b573f9-agent-certs\") pod \"konnectivity-agent-ww299\" (UID: \"db6b5a4e-5ed2-40f7-af21-222e80b573f9\") " pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.813784 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/190d908a-3215-4b00-9d3c-da12e9fb574c-tmp\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.813943 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.813963 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 05:20:12.813980 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.813976 2569 projected.go:196] Error preparing data for projected volume kube-api-access-m5t9p for pod openshift-network-diagnostics/network-check-target-vcbgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:12.814525 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.814056 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p podName:a176acf4-1745-4e19-86f9-e6721082ea17 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:13.314037114 +0000 UTC m=+3.038216761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m5t9p" (UniqueName: "kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p") pod "network-check-target-vcbgt" (UID: "a176acf4-1745-4e19-86f9-e6721082ea17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:12.815039 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.815013 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/190d908a-3215-4b00-9d3c-da12e9fb574c-etc-tuned\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.817271 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.817142 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-564v9\" (UniqueName: \"kubernetes.io/projected/f87542f5-1cab-4c8a-80aa-230a0ac86c0a-kube-api-access-564v9\") pod \"aws-ebs-csi-driver-node-r6frx\" (UID: \"f87542f5-1cab-4c8a-80aa-230a0ac86c0a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:12.817271 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.817225 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkfpk\" (UniqueName: \"kubernetes.io/projected/c9204d9f-ef6c-49a0-b474-1167b59f0e7c-kube-api-access-vkfpk\") pod \"ovnkube-node-78lkv\" (UID: \"c9204d9f-ef6c-49a0-b474-1167b59f0e7c\") " pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:12.817510 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.817487 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj4q9\" (UniqueName: \"kubernetes.io/projected/e013f606-d92b-4a85-acf4-09d132bce1e5-kube-api-access-sj4q9\") pod \"iptables-alerter-dpzl5\" (UID: \"e013f606-d92b-4a85-acf4-09d132bce1e5\") " pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:12.817871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.817847 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gv6w\" (UniqueName: \"kubernetes.io/projected/3266632a-286d-48ef-a7be-e5b0b4581b0b-kube-api-access-8gv6w\") pod \"multus-5hvsr\" (UID: \"3266632a-286d-48ef-a7be-e5b0b4581b0b\") " pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.819250 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.819137 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d27b8\" (UniqueName: \"kubernetes.io/projected/190d908a-3215-4b00-9d3c-da12e9fb574c-kube-api-access-d27b8\") pod \"tuned-c2tv8\" (UID: \"190d908a-3215-4b00-9d3c-da12e9fb574c\") " pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:12.819738 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.819714 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlprw\" (UniqueName: \"kubernetes.io/projected/5850659d-ad02-4261-ae58-8a547785ec32-kube-api-access-mlprw\") pod \"node-ca-sh49c\" (UID: \"5850659d-ad02-4261-ae58-8a547785ec32\") " pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:12.909671 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-cnibin\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.909858 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909683 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.909858 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909704 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00440703-718d-4501-9ff5-1d00f39b4ec3-kubelet-config\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.909858 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909703 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-cnibin\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.909858 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909722 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-cni-binary-copy\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.909858 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909803 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.909858 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909853 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909891 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e41e0543-6109-4304-baaf-2f5c1ef80e11-tmp-dir\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.909895 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909814 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00440703-718d-4501-9ff5-1d00f39b4ec3-kubelet-config\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909927 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5www\" (UniqueName: \"kubernetes.io/projected/e41e0543-6109-4304-baaf-2f5c1ef80e11-kube-api-access-r5www\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.909979 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret podName:00440703-718d-4501-9ff5-1d00f39b4ec3 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:13.409958462 +0000 UTC m=+3.134138118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret") pod "global-pull-secret-syncer-l5k7k" (UID: "00440703-718d-4501-9ff5-1d00f39b4ec3") : object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.909899 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910035 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfwqd\" (UniqueName: \"kubernetes.io/projected/64063deb-08d8-43d4-9cfb-446b3496652e-kube-api-access-nfwqd\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910071 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910100 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00440703-718d-4501-9ff5-1d00f39b4ec3-dbus\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.910158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910150 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-system-cni-dir\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e41e0543-6109-4304-baaf-2f5c1ef80e11-hosts-file\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910211 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910239 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhzv4\" (UniqueName: \"kubernetes.io/projected/b9079d0d-8a44-4c4e-ba0d-43284c60f675-kube-api-access-hhzv4\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910321 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e41e0543-6109-4304-baaf-2f5c1ef80e11-tmp-dir\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910322 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-cni-binary-copy\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910341 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00440703-718d-4501-9ff5-1d00f39b4ec3-dbus\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910373 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e41e0543-6109-4304-baaf-2f5c1ef80e11-hosts-file\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910378 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910386 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/64063deb-08d8-43d4-9cfb-446b3496652e-system-cni-dir\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.910461 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:12.910653 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:12.910507 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs podName:b9079d0d-8a44-4c4e-ba0d-43284c60f675 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:13.410491486 +0000 UTC m=+3.134671125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs") pod "network-metrics-daemon-4lj77" (UID: "b9079d0d-8a44-4c4e-ba0d-43284c60f675") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:12.911071 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.910814 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/64063deb-08d8-43d4-9cfb-446b3496652e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.922103 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.922065 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfwqd\" (UniqueName: \"kubernetes.io/projected/64063deb-08d8-43d4-9cfb-446b3496652e-kube-api-access-nfwqd\") pod \"multus-additional-cni-plugins-9f4bx\" (UID: \"64063deb-08d8-43d4-9cfb-446b3496652e\") " pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:12.922250 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.922121 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhzv4\" (UniqueName: \"kubernetes.io/projected/b9079d0d-8a44-4c4e-ba0d-43284c60f675-kube-api-access-hhzv4\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:12.922783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.922764 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5www\" (UniqueName: \"kubernetes.io/projected/e41e0543-6109-4304-baaf-2f5c1ef80e11-kube-api-access-r5www\") pod \"node-resolver-cnvp6\" (UID: \"e41e0543-6109-4304-baaf-2f5c1ef80e11\") " pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:12.985565 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.985530 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5hvsr" Sep 11 05:20:12.995263 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:12.995238 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:13.008157 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.008134 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" Sep 11 05:20:13.014000 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.013980 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 11 05:20:13.015040 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.015016 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sh49c" Sep 11 05:20:13.021841 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.021819 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dpzl5" Sep 11 05:20:13.028649 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.028631 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" Sep 11 05:20:13.036702 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.036671 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:13.043505 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.043481 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cnvp6" Sep 11 05:20:13.049338 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.049320 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" Sep 11 05:20:13.414171 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.414134 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:13.414357 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.414191 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:13.414357 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.414225 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:13.414357 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:13.414317 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:13.414357 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:13.414327 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:13.414617 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:13.414329 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 05:20:13.414617 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:13.414385 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret podName:00440703-718d-4501-9ff5-1d00f39b4ec3 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:14.414363773 +0000 UTC m=+4.138543399 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret") pod "global-pull-secret-syncer-l5k7k" (UID: "00440703-718d-4501-9ff5-1d00f39b4ec3") : object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:13.414617 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:13.414396 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 05:20:13.414617 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:13.414405 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs podName:b9079d0d-8a44-4c4e-ba0d-43284c60f675 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:14.414394214 +0000 UTC m=+4.138573843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs") pod "network-metrics-daemon-4lj77" (UID: "b9079d0d-8a44-4c4e-ba0d-43284c60f675") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:13.414617 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:13.414411 2569 projected.go:196] Error preparing data for projected volume kube-api-access-m5t9p for pod openshift-network-diagnostics/network-check-target-vcbgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:13.414617 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:13.414453 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p podName:a176acf4-1745-4e19-86f9-e6721082ea17 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:14.414434861 +0000 UTC m=+4.138614501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5t9p" (UniqueName: "kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p") pod "network-check-target-vcbgt" (UID: "a176acf4-1745-4e19-86f9-e6721082ea17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:13.736471 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.736384 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 05:15:13 +0000 UTC" deadline="2028-04-20 11:13:56.856426405 +0000 UTC" Sep 11 05:20:13.736471 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:13.736416 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14093h53m43.120013519s" Sep 11 05:20:13.996757 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:13.996717 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41e0543_6109_4304_baaf_2f5c1ef80e11.slice/crio-417e2ae26953aa3561a6f0d49f96c2f49b1c4cd930e40d5bc2dd90c1bb85c6a0 WatchSource:0}: Error finding container 417e2ae26953aa3561a6f0d49f96c2f49b1c4cd930e40d5bc2dd90c1bb85c6a0: Status 404 returned error can't find the container with id 417e2ae26953aa3561a6f0d49f96c2f49b1c4cd930e40d5bc2dd90c1bb85c6a0 Sep 11 05:20:13.999098 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:13.999070 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87542f5_1cab_4c8a_80aa_230a0ac86c0a.slice/crio-f9215018b1daf961997babe99b488796d49fcac7d91ac090a378aa4f83855d0e WatchSource:0}: Error finding container f9215018b1daf961997babe99b488796d49fcac7d91ac090a378aa4f83855d0e: Status 404 returned error can't find the container with id f9215018b1daf961997babe99b488796d49fcac7d91ac090a378aa4f83855d0e Sep 11 05:20:14.000082 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:14.000055 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5850659d_ad02_4261_ae58_8a547785ec32.slice/crio-75901a585f2d8f57dea54b30349de0f9380ecf4cc8cdd8d1e4ddd3f3cfca2f5d WatchSource:0}: Error finding container 75901a585f2d8f57dea54b30349de0f9380ecf4cc8cdd8d1e4ddd3f3cfca2f5d: Status 404 returned error can't find the container with id 75901a585f2d8f57dea54b30349de0f9380ecf4cc8cdd8d1e4ddd3f3cfca2f5d Sep 11 05:20:14.025487 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:14.025463 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode013f606_d92b_4a85_acf4_09d132bce1e5.slice/crio-1a263ab097aeef0744d577a2ea02ea3a771cdb0407c2606da57f0b42336ef890 WatchSource:0}: Error finding container 1a263ab097aeef0744d577a2ea02ea3a771cdb0407c2606da57f0b42336ef890: Status 404 returned error can't find the container with id 1a263ab097aeef0744d577a2ea02ea3a771cdb0407c2606da57f0b42336ef890 Sep 11 05:20:14.026380 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:14.026360 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64063deb_08d8_43d4_9cfb_446b3496652e.slice/crio-e23cf48c4d3a80bc6aad4cf3788be2282588a1e568f7d02c79b0f1f3d77797e8 WatchSource:0}: Error finding container e23cf48c4d3a80bc6aad4cf3788be2282588a1e568f7d02c79b0f1f3d77797e8: Status 404 returned error can't find the container with id e23cf48c4d3a80bc6aad4cf3788be2282588a1e568f7d02c79b0f1f3d77797e8 Sep 11 05:20:14.027192 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:14.027128 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190d908a_3215_4b00_9d3c_da12e9fb574c.slice/crio-579b9e1411d26e5ea72f170461f570a9f933cebffbe745b8114471c4301bb7a0 WatchSource:0}: Error finding container 579b9e1411d26e5ea72f170461f570a9f933cebffbe745b8114471c4301bb7a0: Status 404 returned error can't find the container with id 579b9e1411d26e5ea72f170461f570a9f933cebffbe745b8114471c4301bb7a0 Sep 11 05:20:14.028466 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:14.028444 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3266632a_286d_48ef_a7be_e5b0b4581b0b.slice/crio-6782d631745cda6d0a51deda3db4193729c0645f101774761b35487ebc74f42d WatchSource:0}: Error finding container 6782d631745cda6d0a51deda3db4193729c0645f101774761b35487ebc74f42d: Status 404 returned error can't find the container with id 6782d631745cda6d0a51deda3db4193729c0645f101774761b35487ebc74f42d Sep 11 05:20:14.029212 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:14.029183 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb6b5a4e_5ed2_40f7_af21_222e80b573f9.slice/crio-035c9d99b971b7c08da10e3f49e751af3080f761561812a96404b3db486a8800 WatchSource:0}: Error finding container 035c9d99b971b7c08da10e3f49e751af3080f761561812a96404b3db486a8800: Status 404 returned error can't find the container with id 035c9d99b971b7c08da10e3f49e751af3080f761561812a96404b3db486a8800 Sep 11 05:20:14.029899 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:14.029883 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9204d9f_ef6c_49a0_b474_1167b59f0e7c.slice/crio-8ffe6d9c48393e726ccc2f0ff20f44f75756dbfb4fb40cebd0a31a16874ab967 WatchSource:0}: Error finding container 8ffe6d9c48393e726ccc2f0ff20f44f75756dbfb4fb40cebd0a31a16874ab967: Status 404 returned error can't find the container with id 8ffe6d9c48393e726ccc2f0ff20f44f75756dbfb4fb40cebd0a31a16874ab967 Sep 11 05:20:14.422703 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.422667 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:14.422847 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.422716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:14.422847 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.422747 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:14.422978 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.422854 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:14.422978 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.422897 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 05:20:14.422978 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.422923 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret podName:00440703-718d-4501-9ff5-1d00f39b4ec3 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:16.422897992 +0000 UTC m=+6.147077621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret") pod "global-pull-secret-syncer-l5k7k" (UID: "00440703-718d-4501-9ff5-1d00f39b4ec3") : object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:14.422978 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.422923 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 05:20:14.422978 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.422854 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:14.422978 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.422941 2569 projected.go:196] Error preparing data for projected volume kube-api-access-m5t9p for pod openshift-network-diagnostics/network-check-target-vcbgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:14.423198 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.422996 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs podName:b9079d0d-8a44-4c4e-ba0d-43284c60f675 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:16.422961881 +0000 UTC m=+6.147141517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs") pod "network-metrics-daemon-4lj77" (UID: "b9079d0d-8a44-4c4e-ba0d-43284c60f675") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:14.423198 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.423016 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p podName:a176acf4-1745-4e19-86f9-e6721082ea17 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:16.423007282 +0000 UTC m=+6.147186925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5t9p" (UniqueName: "kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p") pod "network-check-target-vcbgt" (UID: "a176acf4-1745-4e19-86f9-e6721082ea17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:14.736876 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.736776 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 05:15:13 +0000 UTC" deadline="2028-04-15 23:27:19.390112976 +0000 UTC" Sep 11 05:20:14.736876 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.736814 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13986h7m4.653303726s" Sep 11 05:20:14.761099 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.760327 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:14.761099 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.760455 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:14.761099 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.760882 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:14.761099 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.760991 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:14.761099 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.761063 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:14.761446 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:14.761133 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:14.779153 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.779104 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" event={"ID":"f87542f5-1cab-4c8a-80aa-230a0ac86c0a","Type":"ContainerStarted","Data":"f9215018b1daf961997babe99b488796d49fcac7d91ac090a378aa4f83855d0e"} Sep 11 05:20:14.782486 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.782456 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hvsr" event={"ID":"3266632a-286d-48ef-a7be-e5b0b4581b0b","Type":"ContainerStarted","Data":"6782d631745cda6d0a51deda3db4193729c0645f101774761b35487ebc74f42d"} Sep 11 05:20:14.785980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.785952 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" event={"ID":"190d908a-3215-4b00-9d3c-da12e9fb574c","Type":"ContainerStarted","Data":"579b9e1411d26e5ea72f170461f570a9f933cebffbe745b8114471c4301bb7a0"} Sep 11 05:20:14.802264 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.802211 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerStarted","Data":"e23cf48c4d3a80bc6aad4cf3788be2282588a1e568f7d02c79b0f1f3d77797e8"} Sep 11 05:20:14.809821 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.809755 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpzl5" event={"ID":"e013f606-d92b-4a85-acf4-09d132bce1e5","Type":"ContainerStarted","Data":"1a263ab097aeef0744d577a2ea02ea3a771cdb0407c2606da57f0b42336ef890"} Sep 11 05:20:14.813951 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.813905 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cnvp6" event={"ID":"e41e0543-6109-4304-baaf-2f5c1ef80e11","Type":"ContainerStarted","Data":"417e2ae26953aa3561a6f0d49f96c2f49b1c4cd930e40d5bc2dd90c1bb85c6a0"} Sep 11 05:20:14.824689 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.823818 2569 generic.go:356] "Generic (PLEG): container finished" podID="9a07c4d36ebae0da0db7a784f8d1c502" containerID="a4e5821e5b193176b3896394f4c1f88f87e26f9c9b67757b520f8ac9fb4a1718" exitCode=0 Sep 11 05:20:14.824689 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.823899 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" event={"ID":"9a07c4d36ebae0da0db7a784f8d1c502","Type":"ContainerDied","Data":"a4e5821e5b193176b3896394f4c1f88f87e26f9c9b67757b520f8ac9fb4a1718"} Sep 11 05:20:14.833536 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.833211 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" event={"ID":"ad58f719ce68c03137c90aff08168b70","Type":"ContainerStarted","Data":"9083db499cd980b10b4cf0a9d5c79634bbfaca04fe68cb6d7e7ddebabde723d1"} Sep 11 05:20:14.843859 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.843832 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"8ffe6d9c48393e726ccc2f0ff20f44f75756dbfb4fb40cebd0a31a16874ab967"} Sep 11 05:20:14.848314 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.848281 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ww299" event={"ID":"db6b5a4e-5ed2-40f7-af21-222e80b573f9","Type":"ContainerStarted","Data":"035c9d99b971b7c08da10e3f49e751af3080f761561812a96404b3db486a8800"} Sep 11 05:20:14.850936 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:14.850911 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sh49c" event={"ID":"5850659d-ad02-4261-ae58-8a547785ec32","Type":"ContainerStarted","Data":"75901a585f2d8f57dea54b30349de0f9380ecf4cc8cdd8d1e4ddd3f3cfca2f5d"} Sep 11 05:20:15.880009 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:15.879689 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" event={"ID":"9a07c4d36ebae0da0db7a784f8d1c502","Type":"ContainerStarted","Data":"60ac430ec6b914ff4c0ab2c9570cf6ab8deccff26fe1e91a9506f27641826bad"} Sep 11 05:20:15.896219 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:15.894913 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-238.ec2.internal" podStartSLOduration=3.89489136 podStartE2EDuration="3.89489136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:14.859310567 +0000 UTC m=+4.583490215" watchObservedRunningTime="2026-09-11 05:20:15.89489136 +0000 UTC m=+5.619071009" Sep 11 05:20:16.438036 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:16.437993 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:16.438238 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:16.438064 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:16.438238 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:16.438136 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:16.438363 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.438280 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:16.438363 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.438349 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret podName:00440703-718d-4501-9ff5-1d00f39b4ec3 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:20.438328049 +0000 UTC m=+10.162507689 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret") pod "global-pull-secret-syncer-l5k7k" (UID: "00440703-718d-4501-9ff5-1d00f39b4ec3") : object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:16.438833 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.438811 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 05:20:16.438950 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.438839 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 05:20:16.438950 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.438852 2569 projected.go:196] Error preparing data for projected volume kube-api-access-m5t9p for pod openshift-network-diagnostics/network-check-target-vcbgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:16.438950 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.438942 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p podName:a176acf4-1745-4e19-86f9-e6721082ea17 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:20.438924214 +0000 UTC m=+10.163103841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5t9p" (UniqueName: "kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p") pod "network-check-target-vcbgt" (UID: "a176acf4-1745-4e19-86f9-e6721082ea17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:16.439136 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.438961 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:16.439136 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.439019 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs podName:b9079d0d-8a44-4c4e-ba0d-43284c60f675 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:20.439000707 +0000 UTC m=+10.163180341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs") pod "network-metrics-daemon-4lj77" (UID: "b9079d0d-8a44-4c4e-ba0d-43284c60f675") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:16.759812 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:16.759605 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:16.759812 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:16.759777 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:16.760040 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:16.759701 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:16.760040 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.759892 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:16.760040 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.759993 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:16.760205 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:16.760064 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:18.757381 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:18.757319 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:18.759773 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:18.759715 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:18.759946 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:18.759901 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:18.760156 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:18.760079 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:18.760260 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:18.760162 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:18.760311 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:18.760278 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:20.474490 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:20.474455 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:20.474524 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:20.474569 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.474673 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.474694 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.474699 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.474725 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.474738 2569 projected.go:196] Error preparing data for projected volume kube-api-access-m5t9p for pod openshift-network-diagnostics/network-check-target-vcbgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.474753 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret podName:00440703-718d-4501-9ff5-1d00f39b4ec3 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:28.474732191 +0000 UTC m=+18.198911826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret") pod "global-pull-secret-syncer-l5k7k" (UID: "00440703-718d-4501-9ff5-1d00f39b4ec3") : object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.474777 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs podName:b9079d0d-8a44-4c4e-ba0d-43284c60f675 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:28.474765477 +0000 UTC m=+18.198945100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs") pod "network-metrics-daemon-4lj77" (UID: "b9079d0d-8a44-4c4e-ba0d-43284c60f675") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:20.474958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.474793 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p podName:a176acf4-1745-4e19-86f9-e6721082ea17 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:28.474783429 +0000 UTC m=+18.198963056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5t9p" (UniqueName: "kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p") pod "network-check-target-vcbgt" (UID: "a176acf4-1745-4e19-86f9-e6721082ea17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:20.758566 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:20.758437 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:20.758720 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.758565 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:20.759158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:20.758898 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:20.759158 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.758998 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:20.759158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:20.759050 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:20.759158 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:20.759130 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:22.758131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:22.757296 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:22.758131 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:22.757425 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:22.758131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:22.757828 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:22.758131 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:22.757942 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:22.758131 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:22.758013 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:22.758131 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:22.758097 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:24.757369 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:24.757289 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:24.757369 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:24.757336 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:24.757369 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:24.757289 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:24.757937 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:24.757421 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:24.757937 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:24.757917 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:24.758056 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:24.758016 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:26.757689 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:26.757653 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:26.758146 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:26.757655 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:26.758146 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:26.757785 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:26.758146 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:26.757776 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:26.758146 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:26.757899 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:26.758146 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:26.757956 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:28.531023 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:28.530980 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:28.531038 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:28.531071 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.531096 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.531170 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret podName:00440703-718d-4501-9ff5-1d00f39b4ec3 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:44.531151602 +0000 UTC m=+34.255331235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret") pod "global-pull-secret-syncer-l5k7k" (UID: "00440703-718d-4501-9ff5-1d00f39b4ec3") : object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.531190 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.531225 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.531243 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs podName:b9079d0d-8a44-4c4e-ba0d-43284c60f675 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:44.531226448 +0000 UTC m=+34.255406087 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs") pod "network-metrics-daemon-4lj77" (UID: "b9079d0d-8a44-4c4e-ba0d-43284c60f675") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.531247 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.531258 2569 projected.go:196] Error preparing data for projected volume kube-api-access-m5t9p for pod openshift-network-diagnostics/network-check-target-vcbgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:28.531513 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.531302 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p podName:a176acf4-1745-4e19-86f9-e6721082ea17 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:44.53128795 +0000 UTC m=+34.255467578 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5t9p" (UniqueName: "kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p") pod "network-check-target-vcbgt" (UID: "a176acf4-1745-4e19-86f9-e6721082ea17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:28.758008 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:28.757973 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:28.758203 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:28.757973 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:28.758203 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.758125 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:28.758203 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:28.758133 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:28.758365 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.758254 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:28.758365 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:28.758333 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:30.757846 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:30.757814 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:30.758299 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:30.757911 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:30.758299 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:30.757967 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:30.758299 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:30.758005 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:30.758299 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:30.757989 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:30.758299 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:30.758083 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:31.914891 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.914859 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"d129e28449824824e134df8241fe57f83989b71fddff0fbb175869165be24a76"} Sep 11 05:20:31.918915 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.918127 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ww299" event={"ID":"db6b5a4e-5ed2-40f7-af21-222e80b573f9","Type":"ContainerStarted","Data":"8709ff044f581428afeec227b46068708b756293c204d7518610dc1f29345ef6"} Sep 11 05:20:31.920706 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.920677 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5hvsr" event={"ID":"3266632a-286d-48ef-a7be-e5b0b4581b0b","Type":"ContainerStarted","Data":"66bb1de8d3788dfb4cb0ae4d04d3fe4ebf8f174eb0dfe44334aa03abe728cbd5"} Sep 11 05:20:31.926242 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.925944 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" event={"ID":"190d908a-3215-4b00-9d3c-da12e9fb574c","Type":"ContainerStarted","Data":"5da4f487cc5f757590c1c58611e7b01701b27739163dfd3a45c99701d144e86c"} Sep 11 05:20:31.933425 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.933013 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerStarted","Data":"d326418eb152ce7a63cfaf117196d799360ae002af311aeee0b9da97f06e0df3"} Sep 11 05:20:31.933592 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.933524 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ww299" podStartSLOduration=7.042188017 podStartE2EDuration="20.933507083s" totalImagesPullingTime="13.891319066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:31.93314324 +0000 UTC m=+21.657322885" watchObservedRunningTime="2026-09-11 05:20:31.933507083 +0000 UTC m=+21.657686728" Sep 11 05:20:31.933865 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.933828 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-238.ec2.internal" podStartSLOduration=19.933816116 podStartE2EDuration="19.933816116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:15.896200867 +0000 UTC m=+5.620380506" watchObservedRunningTime="2026-09-11 05:20:31.933816116 +0000 UTC m=+21.657995761" Sep 11 05:20:31.966982 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.966873 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c2tv8" podStartSLOduration=3.27913163 podStartE2EDuration="20.966856478s" totalImagesPullingTime="17.687724848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:31.966637569 +0000 UTC m=+21.690817213" watchObservedRunningTime="2026-09-11 05:20:31.966856478 +0000 UTC m=+21.691036122" Sep 11 05:20:31.967318 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:31.967192 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5hvsr" podStartSLOduration=3.232433781 podStartE2EDuration="20.967179212s" totalImagesPullingTime="17.734745431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:31.950664792 +0000 UTC m=+21.674844438" watchObservedRunningTime="2026-09-11 05:20:31.967179212 +0000 UTC m=+21.691358860" Sep 11 05:20:32.757518 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.757486 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:32.757809 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.757486 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:32.757809 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.757601 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:32.757809 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:32.757613 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:32.757809 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:32.757690 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:32.757809 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:32.757768 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:32.935932 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.935891 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sh49c" event={"ID":"5850659d-ad02-4261-ae58-8a547785ec32","Type":"ContainerStarted","Data":"c6a9a2cdbc2e9c2fae95b724a5fafb21a04d22d5e04d078d2987afb7d88b0454"} Sep 11 05:20:32.937476 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.937303 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" event={"ID":"f87542f5-1cab-4c8a-80aa-230a0ac86c0a","Type":"ContainerStarted","Data":"5b23155efa8560c604340588aba45700b88a2858a2cb87390ae6599a3eddec39"} Sep 11 05:20:32.938646 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.938622 2569 generic.go:356] "Generic (PLEG): container finished" podID="64063deb-08d8-43d4-9cfb-446b3496652e" containerID="d326418eb152ce7a63cfaf117196d799360ae002af311aeee0b9da97f06e0df3" exitCode=0 Sep 11 05:20:32.938709 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.938667 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerDied","Data":"d326418eb152ce7a63cfaf117196d799360ae002af311aeee0b9da97f06e0df3"} Sep 11 05:20:32.940180 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.940163 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cnvp6" event={"ID":"e41e0543-6109-4304-baaf-2f5c1ef80e11","Type":"ContainerStarted","Data":"702ba34b7acbf05634c30216a402d3582409478328ce59f75aefdfd87a395a33"} Sep 11 05:20:32.945002 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.944954 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"32b9614f6153d064ac4f71b2e04d8e096f3f55d28699147e75b30986b69154ea"} Sep 11 05:20:32.945094 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.945082 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"20d9c5267b0f8ab9406ceee8d7bbfd13258912838abeb15890378d2d2906a3f6"} Sep 11 05:20:32.945161 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.945137 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"3719b9a9cb81f66ea3b0f8684318d813ffc92f845e3f2fe8421bb650c788cbfd"} Sep 11 05:20:32.945216 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.945197 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"5c0077584d70df6741a927dee3134c61d9a0b77b96c2ea138b1b3e15a6106e19"} Sep 11 05:20:32.945268 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.945247 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"79d05b1706d7ce00c2bb974b5425b3f8379282f0404a38c60bb93306a327667e"} Sep 11 05:20:32.949609 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.949574 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sh49c" podStartSLOduration=4.289197649 podStartE2EDuration="21.949535319s" totalImagesPullingTime="17.66033767s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:32.949251899 +0000 UTC m=+22.673431543" watchObservedRunningTime="2026-09-11 05:20:32.949535319 +0000 UTC m=+22.673714963" Sep 11 05:20:32.961484 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:32.961444 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cnvp6" podStartSLOduration=4.24309425 podStartE2EDuration="21.96143216s" totalImagesPullingTime="17.71833791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:32.961339799 +0000 UTC m=+22.685519446" watchObservedRunningTime="2026-09-11 05:20:32.96143216 +0000 UTC m=+22.685611804" Sep 11 05:20:33.359060 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:33.359035 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 11 05:20:33.748004 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:33.747892 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T05:20:33.359054338Z","UUID":"9ba1a428-c746-4358-9954-dd07aa408ee6","Handler":null,"Name":"","Endpoint":""} Sep 11 05:20:33.749440 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:33.749415 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 11 05:20:33.749440 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:33.749452 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 11 05:20:33.950826 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:33.950789 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" event={"ID":"f87542f5-1cab-4c8a-80aa-230a0ac86c0a","Type":"ContainerStarted","Data":"5041e891c73365bf271a63999bc969017e305a5fb2aa60a46ece35d579355aba"} Sep 11 05:20:33.952707 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:33.952654 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dpzl5" event={"ID":"e013f606-d92b-4a85-acf4-09d132bce1e5","Type":"ContainerStarted","Data":"92f7ff75769dfcfe21859f5ab7084292cb0605341c00d64a787d7449adc74123"} Sep 11 05:20:33.966861 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:33.966821 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dpzl5" podStartSLOduration=5.274717756 podStartE2EDuration="22.966807898s" totalImagesPullingTime="17.692090142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:33.966580287 +0000 UTC m=+23.690759930" watchObservedRunningTime="2026-09-11 05:20:33.966807898 +0000 UTC m=+23.690987542" Sep 11 05:20:34.757175 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:34.757093 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:34.757175 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:34.757139 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:34.757175 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:34.757143 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:34.757434 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:34.757232 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:34.757434 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:34.757284 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:34.757434 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:34.757374 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:34.957698 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:34.957669 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"f5b69d804e88a5ecb2c28e06a51bccc85def9b8618439b22860484782115736a"} Sep 11 05:20:34.959738 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:34.959712 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" event={"ID":"f87542f5-1cab-4c8a-80aa-230a0ac86c0a","Type":"ContainerStarted","Data":"9f8122bfcaf0d376642164f0d5548eb539d7908d483b33ddecfd30edc3762d5e"} Sep 11 05:20:35.450090 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:35.450056 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:35.450880 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:35.450859 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:35.466552 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:35.466481 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r6frx" podStartSLOduration=4.5232739760000005 podStartE2EDuration="24.466466744s" totalImagesPullingTime="19.943192768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:34.975702417 +0000 UTC m=+24.699882061" watchObservedRunningTime="2026-09-11 05:20:35.466466744 +0000 UTC m=+25.190646387" Sep 11 05:20:35.963012 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:35.962939 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:35.963682 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:35.963253 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ww299" Sep 11 05:20:36.757955 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:36.757875 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:36.758116 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:36.757877 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:36.758116 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:36.758009 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:36.758116 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:36.757875 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:36.758264 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:36.758110 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:36.758264 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:36.758237 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:38.758130 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.757894 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:38.758709 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.757900 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:38.758709 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:38.758228 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:38.758709 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.757929 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:38.758709 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:38.758286 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:38.758709 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:38.758357 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:38.969799 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.969718 2569 generic.go:356] "Generic (PLEG): container finished" podID="64063deb-08d8-43d4-9cfb-446b3496652e" containerID="85c3fd66c6a33e1bcb517cab90c75c75d7f7c8d2088fd460ac48a37f7785f785" exitCode=0 Sep 11 05:20:38.969932 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.969792 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerDied","Data":"85c3fd66c6a33e1bcb517cab90c75c75d7f7c8d2088fd460ac48a37f7785f785"} Sep 11 05:20:38.973650 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.973630 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" event={"ID":"c9204d9f-ef6c-49a0-b474-1167b59f0e7c","Type":"ContainerStarted","Data":"d6b681c5f3815169717ba5ac471c1039d1319670eba61160efac97181f1d2770"} Sep 11 05:20:38.973918 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.973898 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:38.974016 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.973967 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:38.974070 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.974016 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:38.988712 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.988691 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:38.988873 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:38.988849 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:20:39.950508 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:39.950444 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" podStartSLOduration=11.207335193 podStartE2EDuration="28.950423669s" totalImagesPullingTime="17.743088476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:39.016219163 +0000 UTC m=+28.740398812" watchObservedRunningTime="2026-09-11 05:20:39.950423669 +0000 UTC m=+29.674603313" Sep 11 05:20:39.950999 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:39.950979 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4lj77"] Sep 11 05:20:39.951169 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:39.951147 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:39.951287 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:39.951265 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:39.953736 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:39.953706 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5k7k"] Sep 11 05:20:39.953845 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:39.953801 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:39.953918 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:39.953895 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:39.954344 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:39.954320 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vcbgt"] Sep 11 05:20:39.954423 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:39.954410 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:39.954520 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:39.954499 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:40.979750 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:40.979472 2569 generic.go:356] "Generic (PLEG): container finished" podID="64063deb-08d8-43d4-9cfb-446b3496652e" containerID="2fb87f32397e4f0bb643787df2c2da48b93c29ca3ba668dd80e429b9c8998ab1" exitCode=0 Sep 11 05:20:40.980106 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:40.979570 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerDied","Data":"2fb87f32397e4f0bb643787df2c2da48b93c29ca3ba668dd80e429b9c8998ab1"} Sep 11 05:20:41.757572 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:41.757528 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:41.757736 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:41.757581 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:41.757736 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:41.757656 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:41.757736 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:41.757672 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:41.757859 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:41.757736 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:41.757859 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:41.757814 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:42.986315 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:42.986282 2569 generic.go:356] "Generic (PLEG): container finished" podID="64063deb-08d8-43d4-9cfb-446b3496652e" containerID="7327887bfa82cc05fdde4745430769dd0676bdb75207987e018fc5db091d509e" exitCode=0 Sep 11 05:20:42.986761 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:42.986324 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerDied","Data":"7327887bfa82cc05fdde4745430769dd0676bdb75207987e018fc5db091d509e"} Sep 11 05:20:43.757043 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:43.757003 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:43.757043 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:43.757043 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:43.757361 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:43.757106 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:43.757361 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:43.757121 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vcbgt" podUID="a176acf4-1745-4e19-86f9-e6721082ea17" Sep 11 05:20:43.757361 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:43.757181 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l5k7k" podUID="00440703-718d-4501-9ff5-1d00f39b4ec3" Sep 11 05:20:43.757361 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:43.757270 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4lj77" podUID="b9079d0d-8a44-4c4e-ba0d-43284c60f675" Sep 11 05:20:44.548818 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.548731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:44.548818 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.548771 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:44.548818 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.548815 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:44.549338 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.548900 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 11 05:20:44.549338 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.548911 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:44.549338 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.548929 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 11 05:20:44.549338 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.548943 2569 projected.go:196] Error preparing data for projected volume kube-api-access-m5t9p for pod openshift-network-diagnostics/network-check-target-vcbgt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:44.549338 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.548972 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs podName:b9079d0d-8a44-4c4e-ba0d-43284c60f675 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.548953519 +0000 UTC m=+66.273133146 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs") pod "network-metrics-daemon-4lj77" (UID: "b9079d0d-8a44-4c4e-ba0d-43284c60f675") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 11 05:20:44.549338 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.548996 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p podName:a176acf4-1745-4e19-86f9-e6721082ea17 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.548978966 +0000 UTC m=+66.273158605 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m5t9p" (UniqueName: "kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p") pod "network-check-target-vcbgt" (UID: "a176acf4-1745-4e19-86f9-e6721082ea17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 11 05:20:44.549338 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.548910 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:44.549338 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.549051 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret podName:00440703-718d-4501-9ff5-1d00f39b4ec3 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.549036744 +0000 UTC m=+66.273216371 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret") pod "global-pull-secret-syncer-l5k7k" (UID: "00440703-718d-4501-9ff5-1d00f39b4ec3") : object "kube-system"/"original-pull-secret" not registered Sep 11 05:20:44.625808 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.625780 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-238.ec2.internal" event="NodeReady" Sep 11 05:20:44.625950 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.625931 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 11 05:20:44.659999 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.659966 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq"] Sep 11 05:20:44.665686 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.665664 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-v6wtq"] Sep 11 05:20:44.666048 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.666023 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq" Sep 11 05:20:44.668307 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.668110 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.668407 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.668210 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.668647 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.668622 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-49p6g\"" Sep 11 05:20:44.670046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.670024 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8679779578-x7w2s"] Sep 11 05:20:44.670046 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.670042 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.672291 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.672273 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.672291 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.672286 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 11 05:20:44.672429 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.672276 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 11 05:20:44.672830 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.672812 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.672927 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.672841 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jr5wz\"" Sep 11 05:20:44.674171 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.674156 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2"] Sep 11 05:20:44.674572 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.674254 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.677427 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.677408 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 11 05:20:44.677980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.677940 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 11 05:20:44.677980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.678029 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 11 05:20:44.677980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.678068 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-drtnm\"" Sep 11 05:20:44.678569 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.678316 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-zrtx2"] Sep 11 05:20:44.678569 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.678428 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.681760 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.681735 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.682350 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.682297 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng"] Sep 11 05:20:44.682588 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.682390 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 11 05:20:44.682647 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.682638 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 11 05:20:44.683122 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.683075 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.683309 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.683292 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cl9l5\"" Sep 11 05:20:44.684440 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.683799 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 11 05:20:44.684440 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.684228 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.688353 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.688329 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq"] Sep 11 05:20:44.688459 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.688375 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng"] Sep 11 05:20:44.688459 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.688402 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2"] Sep 11 05:20:44.688459 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.688428 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-v6wtq"] Sep 11 05:20:44.688758 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.688708 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:44.689401 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.689383 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 11 05:20:44.691937 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.691918 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rh6tw"] Sep 11 05:20:44.692050 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.692032 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.692618 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.692598 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.692988 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.692972 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 11 05:20:44.693596 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.693571 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 11 05:20:44.694346 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.694321 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-2qvs8\"" Sep 11 05:20:44.694941 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.694922 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 11 05:20:44.695026 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.694989 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.696280 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.696263 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.696611 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.696597 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hxvnb\"" Sep 11 05:20:44.697711 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.697694 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf"] Sep 11 05:20:44.697855 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.697840 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.699943 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.699920 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 11 05:20:44.700935 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.700917 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 11 05:20:44.701087 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.700917 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 11 05:20:44.701192 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.701168 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7z8t4\"" Sep 11 05:20:44.701863 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.701844 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv"] Sep 11 05:20:44.702453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.702142 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.705506 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.705487 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 11 05:20:44.706326 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.705715 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p8mpb\"" Sep 11 05:20:44.706326 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.705975 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 11 05:20:44.706326 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.706002 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.706326 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.706187 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.706581 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.706562 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-zrtx2"] Sep 11 05:20:44.706632 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.706601 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd"] Sep 11 05:20:44.706781 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.706716 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.708911 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.708892 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.709985 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.709405 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.709985 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.709679 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 11 05:20:44.709985 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.709935 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-l2t9r\"" Sep 11 05:20:44.710145 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.710117 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 11 05:20:44.711291 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.711273 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n29fh"] Sep 11 05:20:44.711503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.711484 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd" Sep 11 05:20:44.713862 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.713839 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.715332 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.715315 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7666854f74-b8zpj"] Sep 11 05:20:44.715537 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.715408 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n29fh" Sep 11 05:20:44.715685 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.715666 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.715776 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.715758 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-72kmh\"" Sep 11 05:20:44.717700 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.717684 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.718018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.718000 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.718392 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.718371 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 11 05:20:44.718486 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.718400 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-skmld\"" Sep 11 05:20:44.719074 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.719057 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8679779578-x7w2s"] Sep 11 05:20:44.719156 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.719094 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf"] Sep 11 05:20:44.719156 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.719111 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rh6tw"] Sep 11 05:20:44.719156 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.719127 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv"] Sep 11 05:20:44.719156 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.719144 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd"] Sep 11 05:20:44.719156 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.719158 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n29fh"] Sep 11 05:20:44.719497 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.719170 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7666854f74-b8zpj"] Sep 11 05:20:44.720101 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.720082 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.721910 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.721894 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 11 05:20:44.722132 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.722113 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gzzwv\"" Sep 11 05:20:44.722218 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.722175 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 11 05:20:44.722312 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.722296 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 11 05:20:44.722429 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.722414 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 11 05:20:44.722469 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.722430 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 11 05:20:44.722469 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.722456 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 11 05:20:44.750767 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.750731 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f933e7e1-994e-453c-a52a-74349bdc41d3-config\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.750935 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.750915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nlwq\" (UniqueName: \"kubernetes.io/projected/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-kube-api-access-2nlwq\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:44.751061 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751048 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc957ed2-08b1-4e47-a8fb-e7cf25902179-tmp\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.751169 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751149 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-ca-trust-extracted\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.751261 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751187 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:44.751261 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751217 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f933e7e1-994e-453c-a52a-74349bdc41d3-serving-cert\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.751261 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751253 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f933e7e1-994e-453c-a52a-74349bdc41d3-trusted-ca\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.751384 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751279 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-trusted-ca\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.751384 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751312 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns8bl\" (UniqueName: \"kubernetes.io/projected/f933e7e1-994e-453c-a52a-74349bdc41d3-kube-api-access-ns8bl\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.751384 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751341 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc957ed2-08b1-4e47-a8fb-e7cf25902179-serving-cert\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.751384 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751370 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-bound-sa-token\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.751593 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751439 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2xzp\" (UniqueName: \"kubernetes.io/projected/fc957ed2-08b1-4e47-a8fb-e7cf25902179-kube-api-access-t2xzp\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.751593 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751468 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-certificates\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.751593 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751497 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-image-registry-private-configuration\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.751593 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751528 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-installation-pull-secrets\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.751593 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751580 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgrnx\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-kube-api-access-sgrnx\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.751844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751611 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.751844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff2j4\" (UniqueName: \"kubernetes.io/projected/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-kube-api-access-ff2j4\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.751844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751688 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcgd9\" (UniqueName: \"kubernetes.io/projected/a478863e-495d-4f6d-9500-770a4eea85bd-kube-api-access-vcgd9\") pod \"volume-data-source-validator-86695b7cc7-vnfwq\" (UID: \"a478863e-495d-4f6d-9500-770a4eea85bd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq" Sep 11 05:20:44.751844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751721 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc957ed2-08b1-4e47-a8fb-e7cf25902179-snapshots\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.751844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751749 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc957ed2-08b1-4e47-a8fb-e7cf25902179-trusted-ca-bundle\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.751844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751781 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc957ed2-08b1-4e47-a8fb-e7cf25902179-service-ca-bundle\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.751844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751804 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.751844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.751838 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.852760 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.852679 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc89r\" (UniqueName: \"kubernetes.io/projected/70c2394a-6f61-412b-ab38-08390abfa53e-kube-api-access-wc89r\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.852760 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.852730 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2xzp\" (UniqueName: \"kubernetes.io/projected/fc957ed2-08b1-4e47-a8fb-e7cf25902179-kube-api-access-t2xzp\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.852760 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.852755 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgrnx\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-kube-api-access-sgrnx\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.853018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.852783 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.853018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.852812 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/682454e1-5ba2-4c02-b92d-8c2b66c59a66-config-volume\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.853018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.852835 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c12aa7da-3ae4-4d26-bb5a-787feddaa9f2-cert\") pod \"ingress-canary-n29fh\" (UID: \"c12aa7da-3ae4-4d26-bb5a-787feddaa9f2\") " pod="openshift-ingress-canary/ingress-canary-n29fh" Sep 11 05:20:44.853018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.852859 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc957ed2-08b1-4e47-a8fb-e7cf25902179-service-ca-bundle\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.853018 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.852920 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:44.853018 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.853009 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls podName:97bc18e9-1612-4bc1-acc2-1e0bcc5394b8 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:45.352988247 +0000 UTC m=+35.077167876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g95w2" (UID: "97bc18e9-1612-4bc1-acc2-1e0bcc5394b8") : secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853046 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7fnr\" (UniqueName: \"kubernetes.io/projected/4dea7e44-25b3-4c8b-8f36-80ddf7026505-kube-api-access-d7fnr\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853085 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853110 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/682454e1-5ba2-4c02-b92d-8c2b66c59a66-tmp-dir\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853146 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-ca-trust-extracted\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853171 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hl8\" (UniqueName: \"kubernetes.io/projected/c12aa7da-3ae4-4d26-bb5a-787feddaa9f2-kube-api-access-w6hl8\") pod \"ingress-canary-n29fh\" (UID: \"c12aa7da-3ae4-4d26-bb5a-787feddaa9f2\") " pod="openshift-ingress-canary/ingress-canary-n29fh" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853211 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f933e7e1-994e-453c-a52a-74349bdc41d3-trusted-ca\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853239 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc957ed2-08b1-4e47-a8fb-e7cf25902179-serving-cert\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853268 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-bound-sa-token\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853292 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-default-certificate\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.853321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fgp2\" (UniqueName: \"kubernetes.io/projected/682454e1-5ba2-4c02-b92d-8c2b66c59a66-kube-api-access-6fgp2\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.853807 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853341 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.853807 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853379 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-certificates\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.853807 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853442 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-installation-pull-secrets\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.853807 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853479 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-image-registry-private-configuration\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.853807 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853491 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc957ed2-08b1-4e47-a8fb-e7cf25902179-service-ca-bundle\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.853807 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853512 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ptw\" (UniqueName: \"kubernetes.io/projected/9a374b1f-83c6-454b-8161-4a46d45f6139-kube-api-access-j7ptw\") pod \"network-check-source-6f8b768455-9jnhd\" (UID: \"9a374b1f-83c6-454b-8161-4a46d45f6139\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd" Sep 11 05:20:44.853807 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.853562 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff2j4\" (UniqueName: \"kubernetes.io/projected/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-kube-api-access-ff2j4\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.854143 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854000 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-certificates\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.854717 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854524 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-ca-trust-extracted\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.854717 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854674 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70c2394a-6f61-412b-ab38-08390abfa53e-config\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.854883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcgd9\" (UniqueName: \"kubernetes.io/projected/a478863e-495d-4f6d-9500-770a4eea85bd-kube-api-access-vcgd9\") pod \"volume-data-source-validator-86695b7cc7-vnfwq\" (UID: \"a478863e-495d-4f6d-9500-770a4eea85bd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq" Sep 11 05:20:44.854883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854745 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70c2394a-6f61-412b-ab38-08390abfa53e-serving-cert\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.854883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dea7e44-25b3-4c8b-8f36-80ddf7026505-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.854883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854805 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc957ed2-08b1-4e47-a8fb-e7cf25902179-snapshots\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.854883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854833 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc957ed2-08b1-4e47-a8fb-e7cf25902179-trusted-ca-bundle\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.854883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854860 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854884 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4dea7e44-25b3-4c8b-8f36-80ddf7026505-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854913 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854941 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f933e7e1-994e-453c-a52a-74349bdc41d3-config\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854967 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f933e7e1-994e-453c-a52a-74349bdc41d3-serving-cert\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854967 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.854992 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-stats-auth\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855021 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nlwq\" (UniqueName: \"kubernetes.io/projected/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-kube-api-access-2nlwq\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855049 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5h58\" (UniqueName: \"kubernetes.io/projected/6da37175-6b47-4105-ba72-c2644ada4fff-kube-api-access-z5h58\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855092 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc957ed2-08b1-4e47-a8fb-e7cf25902179-tmp\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855125 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:44.855176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855150 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.855746 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855182 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-trusted-ca\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.855746 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855212 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns8bl\" (UniqueName: \"kubernetes.io/projected/f933e7e1-994e-453c-a52a-74349bdc41d3-kube-api-access-ns8bl\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.855746 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855246 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f933e7e1-994e-453c-a52a-74349bdc41d3-trusted-ca\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.855746 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.855343 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 05:20:44.855746 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.855353 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679779578-x7w2s: secret "image-registry-tls" not found Sep 11 05:20:44.855746 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.855396 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls podName:d5a02ec5-fc69-40a2-b2c8-2077afe83d97 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:45.355384634 +0000 UTC m=+35.079564256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls") pod "image-registry-8679779578-x7w2s" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97") : secret "image-registry-tls" not found Sep 11 05:20:44.855964 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855916 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f933e7e1-994e-453c-a52a-74349bdc41d3-config\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.856016 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.855996 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 05:20:44.856016 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.855992 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc957ed2-08b1-4e47-a8fb-e7cf25902179-trusted-ca-bundle\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.856110 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.856035 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls podName:0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e nodeName:}" failed. No retries permitted until 2026-09-11 05:20:45.356022386 +0000 UTC m=+35.080202008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zjhng" (UID: "0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e") : secret "samples-operator-tls" not found Sep 11 05:20:44.856318 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.856296 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fc957ed2-08b1-4e47-a8fb-e7cf25902179-snapshots\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.856400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.856374 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc957ed2-08b1-4e47-a8fb-e7cf25902179-tmp\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.856965 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.856910 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-trusted-ca\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.858652 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.858633 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc957ed2-08b1-4e47-a8fb-e7cf25902179-serving-cert\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.858773 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.858648 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f933e7e1-994e-453c-a52a-74349bdc41d3-serving-cert\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.858773 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.858665 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-installation-pull-secrets\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.858773 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.858654 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-image-registry-private-configuration\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.866729 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.866685 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-bound-sa-token\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.867365 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.867342 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff2j4\" (UniqueName: \"kubernetes.io/projected/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-kube-api-access-ff2j4\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:44.867465 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.867444 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2xzp\" (UniqueName: \"kubernetes.io/projected/fc957ed2-08b1-4e47-a8fb-e7cf25902179-kube-api-access-t2xzp\") pod \"insights-operator-5844b856db-v6wtq\" (UID: \"fc957ed2-08b1-4e47-a8fb-e7cf25902179\") " pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:44.867538 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.867521 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgrnx\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-kube-api-access-sgrnx\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:44.870035 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.869936 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nlwq\" (UniqueName: \"kubernetes.io/projected/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-kube-api-access-2nlwq\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:44.870035 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.869995 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns8bl\" (UniqueName: \"kubernetes.io/projected/f933e7e1-994e-453c-a52a-74349bdc41d3-kube-api-access-ns8bl\") pod \"console-operator-696884fb9c-zrtx2\" (UID: \"f933e7e1-994e-453c-a52a-74349bdc41d3\") " pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:44.870364 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.870339 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcgd9\" (UniqueName: \"kubernetes.io/projected/a478863e-495d-4f6d-9500-770a4eea85bd-kube-api-access-vcgd9\") pod \"volume-data-source-validator-86695b7cc7-vnfwq\" (UID: \"a478863e-495d-4f6d-9500-770a4eea85bd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq" Sep 11 05:20:44.955579 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.955528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ptw\" (UniqueName: \"kubernetes.io/projected/9a374b1f-83c6-454b-8161-4a46d45f6139-kube-api-access-j7ptw\") pod \"network-check-source-6f8b768455-9jnhd\" (UID: \"9a374b1f-83c6-454b-8161-4a46d45f6139\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd" Sep 11 05:20:44.955757 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.955585 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70c2394a-6f61-412b-ab38-08390abfa53e-config\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.955757 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.955613 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70c2394a-6f61-412b-ab38-08390abfa53e-serving-cert\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.955757 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.955636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dea7e44-25b3-4c8b-8f36-80ddf7026505-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.955757 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.955661 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.955757 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.955731 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 05:20:44.955979 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.955783 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls podName:682454e1-5ba2-4c02-b92d-8c2b66c59a66 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:45.455765556 +0000 UTC m=+35.179945180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls") pod "dns-default-rh6tw" (UID: "682454e1-5ba2-4c02-b92d-8c2b66c59a66") : secret "dns-default-metrics-tls" not found Sep 11 05:20:44.956055 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956031 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4dea7e44-25b3-4c8b-8f36-80ddf7026505-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.956115 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-stats-auth\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.956167 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956133 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5h58\" (UniqueName: \"kubernetes.io/projected/6da37175-6b47-4105-ba72-c2644ada4fff-kube-api-access-z5h58\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.956219 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956188 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.956269 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956224 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70c2394a-6f61-412b-ab38-08390abfa53e-config\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.956269 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956227 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc89r\" (UniqueName: \"kubernetes.io/projected/70c2394a-6f61-412b-ab38-08390abfa53e-kube-api-access-wc89r\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.956367 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/682454e1-5ba2-4c02-b92d-8c2b66c59a66-config-volume\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.956367 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956354 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c12aa7da-3ae4-4d26-bb5a-787feddaa9f2-cert\") pod \"ingress-canary-n29fh\" (UID: \"c12aa7da-3ae4-4d26-bb5a-787feddaa9f2\") " pod="openshift-ingress-canary/ingress-canary-n29fh" Sep 11 05:20:44.956457 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956378 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7fnr\" (UniqueName: \"kubernetes.io/projected/4dea7e44-25b3-4c8b-8f36-80ddf7026505-kube-api-access-d7fnr\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.956457 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956399 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.956457 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956415 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/682454e1-5ba2-4c02-b92d-8c2b66c59a66-tmp-dir\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.956635 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.956568 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:20:45.456529892 +0000 UTC m=+35.180709531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : configmap references non-existent config key: service-ca.crt Sep 11 05:20:44.956635 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956607 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4dea7e44-25b3-4c8b-8f36-80ddf7026505-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.956735 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956687 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hl8\" (UniqueName: \"kubernetes.io/projected/c12aa7da-3ae4-4d26-bb5a-787feddaa9f2-kube-api-access-w6hl8\") pod \"ingress-canary-n29fh\" (UID: \"c12aa7da-3ae4-4d26-bb5a-787feddaa9f2\") " pod="openshift-ingress-canary/ingress-canary-n29fh" Sep 11 05:20:44.956788 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956734 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-default-certificate\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.956788 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.956760 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fgp2\" (UniqueName: \"kubernetes.io/projected/682454e1-5ba2-4c02-b92d-8c2b66c59a66-kube-api-access-6fgp2\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.956894 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.956880 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 05:20:44.957117 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:44.956939 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:20:45.456924084 +0000 UTC m=+35.181103709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : secret "router-metrics-certs-default" not found Sep 11 05:20:44.957117 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.957026 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/682454e1-5ba2-4c02-b92d-8c2b66c59a66-tmp-dir\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.957117 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.957070 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/682454e1-5ba2-4c02-b92d-8c2b66c59a66-config-volume\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.958427 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.958383 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4dea7e44-25b3-4c8b-8f36-80ddf7026505-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.958756 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.958715 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70c2394a-6f61-412b-ab38-08390abfa53e-serving-cert\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.959572 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.959516 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-default-certificate\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.959657 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.959633 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c12aa7da-3ae4-4d26-bb5a-787feddaa9f2-cert\") pod \"ingress-canary-n29fh\" (UID: \"c12aa7da-3ae4-4d26-bb5a-787feddaa9f2\") " pod="openshift-ingress-canary/ingress-canary-n29fh" Sep 11 05:20:44.959958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.959937 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-stats-auth\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.969719 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.969673 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fgp2\" (UniqueName: \"kubernetes.io/projected/682454e1-5ba2-4c02-b92d-8c2b66c59a66-kube-api-access-6fgp2\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:44.970456 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.970413 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ptw\" (UniqueName: \"kubernetes.io/projected/9a374b1f-83c6-454b-8161-4a46d45f6139-kube-api-access-j7ptw\") pod \"network-check-source-6f8b768455-9jnhd\" (UID: \"9a374b1f-83c6-454b-8161-4a46d45f6139\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd" Sep 11 05:20:44.971006 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.970946 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7fnr\" (UniqueName: \"kubernetes.io/projected/4dea7e44-25b3-4c8b-8f36-80ddf7026505-kube-api-access-d7fnr\") pod \"kube-storage-version-migrator-operator-6c8f84f897-dwtwv\" (UID: \"4dea7e44-25b3-4c8b-8f36-80ddf7026505\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:44.971160 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.971131 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc89r\" (UniqueName: \"kubernetes.io/projected/70c2394a-6f61-412b-ab38-08390abfa53e-kube-api-access-wc89r\") pod \"service-ca-operator-cf7c776b7-rb5cf\" (UID: \"70c2394a-6f61-412b-ab38-08390abfa53e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:44.971293 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.971269 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5h58\" (UniqueName: \"kubernetes.io/projected/6da37175-6b47-4105-ba72-c2644ada4fff-kube-api-access-z5h58\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:44.971847 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.971828 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hl8\" (UniqueName: \"kubernetes.io/projected/c12aa7da-3ae4-4d26-bb5a-787feddaa9f2-kube-api-access-w6hl8\") pod \"ingress-canary-n29fh\" (UID: \"c12aa7da-3ae4-4d26-bb5a-787feddaa9f2\") " pod="openshift-ingress-canary/ingress-canary-n29fh" Sep 11 05:20:44.978801 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:44.978782 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq" Sep 11 05:20:45.001237 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.001142 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-v6wtq" Sep 11 05:20:45.023416 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.023381 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:20:45.042651 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.042528 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" Sep 11 05:20:45.050984 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.050638 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" Sep 11 05:20:45.063912 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.063872 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd" Sep 11 05:20:45.070137 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.069165 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n29fh" Sep 11 05:20:45.276410 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.276337 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq"] Sep 11 05:20:45.280213 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:45.280164 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda478863e_495d_4f6d_9500_770a4eea85bd.slice/crio-47689db08b870f1739a7979f588a3598df69a36fb7a2d176a89fb49b1ae6cb28 WatchSource:0}: Error finding container 47689db08b870f1739a7979f588a3598df69a36fb7a2d176a89fb49b1ae6cb28: Status 404 returned error can't find the container with id 47689db08b870f1739a7979f588a3598df69a36fb7a2d176a89fb49b1ae6cb28 Sep 11 05:20:45.292208 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.292179 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-v6wtq"] Sep 11 05:20:45.295029 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:45.295011 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc957ed2_08b1_4e47_a8fb_e7cf25902179.slice/crio-ec2d9e84339eab796e7a16384e4836bc2ce1bdf014a839f22c2eb3140eb6c688 WatchSource:0}: Error finding container ec2d9e84339eab796e7a16384e4836bc2ce1bdf014a839f22c2eb3140eb6c688: Status 404 returned error can't find the container with id ec2d9e84339eab796e7a16384e4836bc2ce1bdf014a839f22c2eb3140eb6c688 Sep 11 05:20:45.333443 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.333393 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-zrtx2"] Sep 11 05:20:45.335717 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:45.335691 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf933e7e1_994e_453c_a52a_74349bdc41d3.slice/crio-8366119740c683f9375d5f42a013e477ff6de55f06a5c93fcc24336c7e035cf0 WatchSource:0}: Error finding container 8366119740c683f9375d5f42a013e477ff6de55f06a5c93fcc24336c7e035cf0: Status 404 returned error can't find the container with id 8366119740c683f9375d5f42a013e477ff6de55f06a5c93fcc24336c7e035cf0 Sep 11 05:20:45.355338 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.355289 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf"] Sep 11 05:20:45.358281 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:45.358260 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c2394a_6f61_412b_ab38_08390abfa53e.slice/crio-1b5320eb002c20b5bb81c4e14f1ade9076570200b29003d37c419c4b12321fc9 WatchSource:0}: Error finding container 1b5320eb002c20b5bb81c4e14f1ade9076570200b29003d37c419c4b12321fc9: Status 404 returned error can't find the container with id 1b5320eb002c20b5bb81c4e14f1ade9076570200b29003d37c419c4b12321fc9 Sep 11 05:20:45.365328 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.365299 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:45.365422 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.365368 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:45.365422 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.365418 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:45.365518 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.365458 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 05:20:45.365518 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.365478 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679779578-x7w2s: secret "image-registry-tls" not found Sep 11 05:20:45.365518 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.365508 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:45.365666 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.365532 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls podName:d5a02ec5-fc69-40a2-b2c8-2077afe83d97 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:46.365512282 +0000 UTC m=+36.089691924 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls") pod "image-registry-8679779578-x7w2s" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97") : secret "image-registry-tls" not found Sep 11 05:20:45.365666 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.365575 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls podName:97bc18e9-1612-4bc1-acc2-1e0bcc5394b8 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:46.365560047 +0000 UTC m=+36.089739701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g95w2" (UID: "97bc18e9-1612-4bc1-acc2-1e0bcc5394b8") : secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:45.365666 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.365635 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 05:20:45.365666 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.365663 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls podName:0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e nodeName:}" failed. No retries permitted until 2026-09-11 05:20:46.365655434 +0000 UTC m=+36.089835057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zjhng" (UID: "0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e") : secret "samples-operator-tls" not found Sep 11 05:20:45.379230 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.379165 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd"] Sep 11 05:20:45.380530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.380487 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n29fh"] Sep 11 05:20:45.381987 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.381963 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv"] Sep 11 05:20:45.383209 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:45.383179 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a374b1f_83c6_454b_8161_4a46d45f6139.slice/crio-7230cc2df168c007035399a495c5e9531500784801d72ebddcf38c58ae58a311 WatchSource:0}: Error finding container 7230cc2df168c007035399a495c5e9531500784801d72ebddcf38c58ae58a311: Status 404 returned error can't find the container with id 7230cc2df168c007035399a495c5e9531500784801d72ebddcf38c58ae58a311 Sep 11 05:20:45.383899 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:45.383868 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc12aa7da_3ae4_4d26_bb5a_787feddaa9f2.slice/crio-4079daf334959157306cf5226f83bff577161c513cc1e0b164d200251985af67 WatchSource:0}: Error finding container 4079daf334959157306cf5226f83bff577161c513cc1e0b164d200251985af67: Status 404 returned error can't find the container with id 4079daf334959157306cf5226f83bff577161c513cc1e0b164d200251985af67 Sep 11 05:20:45.384987 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:20:45.384965 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dea7e44_25b3_4c8b_8f36_80ddf7026505.slice/crio-9dec7f4b94f7c003a2297b0086b104e7c60bf2e34b549af1d38fa291499a0046 WatchSource:0}: Error finding container 9dec7f4b94f7c003a2297b0086b104e7c60bf2e34b549af1d38fa291499a0046: Status 404 returned error can't find the container with id 9dec7f4b94f7c003a2297b0086b104e7c60bf2e34b549af1d38fa291499a0046 Sep 11 05:20:45.466067 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.466038 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:45.466232 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.466127 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:45.466232 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.466200 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 05:20:45.466341 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.466265 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls podName:682454e1-5ba2-4c02-b92d-8c2b66c59a66 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:46.466249972 +0000 UTC m=+36.190429613 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls") pod "dns-default-rh6tw" (UID: "682454e1-5ba2-4c02-b92d-8c2b66c59a66") : secret "dns-default-metrics-tls" not found Sep 11 05:20:45.466341 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.466200 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 05:20:45.466341 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.466203 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:45.466341 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.466283 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:20:46.466274577 +0000 UTC m=+36.190454202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : configmap references non-existent config key: service-ca.crt Sep 11 05:20:45.466341 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:45.466310 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:20:46.466294352 +0000 UTC m=+36.190473976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : secret "router-metrics-certs-default" not found Sep 11 05:20:45.757958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.757576 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:20:45.757958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.757600 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:20:45.757958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.757576 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:20:45.760961 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.760937 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 05:20:45.761210 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.761191 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g92vd\"" Sep 11 05:20:45.761210 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.761206 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 05:20:45.761395 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.761207 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dpzsh\"" Sep 11 05:20:45.996280 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.996240 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" event={"ID":"4dea7e44-25b3-4c8b-8f36-80ddf7026505","Type":"ContainerStarted","Data":"9dec7f4b94f7c003a2297b0086b104e7c60bf2e34b549af1d38fa291499a0046"} Sep 11 05:20:45.997880 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.997849 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" event={"ID":"70c2394a-6f61-412b-ab38-08390abfa53e","Type":"ContainerStarted","Data":"1b5320eb002c20b5bb81c4e14f1ade9076570200b29003d37c419c4b12321fc9"} Sep 11 05:20:45.999282 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:45.999212 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n29fh" event={"ID":"c12aa7da-3ae4-4d26-bb5a-787feddaa9f2","Type":"ContainerStarted","Data":"4079daf334959157306cf5226f83bff577161c513cc1e0b164d200251985af67"} Sep 11 05:20:46.001003 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.000919 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" event={"ID":"f933e7e1-994e-453c-a52a-74349bdc41d3","Type":"ContainerStarted","Data":"8366119740c683f9375d5f42a013e477ff6de55f06a5c93fcc24336c7e035cf0"} Sep 11 05:20:46.002940 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.002913 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq" event={"ID":"a478863e-495d-4f6d-9500-770a4eea85bd","Type":"ContainerStarted","Data":"47689db08b870f1739a7979f588a3598df69a36fb7a2d176a89fb49b1ae6cb28"} Sep 11 05:20:46.004400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.004344 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd" event={"ID":"9a374b1f-83c6-454b-8161-4a46d45f6139","Type":"ContainerStarted","Data":"7230cc2df168c007035399a495c5e9531500784801d72ebddcf38c58ae58a311"} Sep 11 05:20:46.005844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.005823 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-v6wtq" event={"ID":"fc957ed2-08b1-4e47-a8fb-e7cf25902179","Type":"ContainerStarted","Data":"ec2d9e84339eab796e7a16384e4836bc2ce1bdf014a839f22c2eb3140eb6c688"} Sep 11 05:20:46.377126 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.376763 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:46.377126 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.376846 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:46.377126 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.376914 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:46.377126 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.377099 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 05:20:46.377126 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.377119 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 05:20:46.377126 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.377136 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679779578-x7w2s: secret "image-registry-tls" not found Sep 11 05:20:46.377595 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.377108 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:46.377595 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.377177 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls podName:0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e nodeName:}" failed. No retries permitted until 2026-09-11 05:20:48.377154605 +0000 UTC m=+38.101334253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zjhng" (UID: "0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e") : secret "samples-operator-tls" not found Sep 11 05:20:46.377595 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.377197 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls podName:d5a02ec5-fc69-40a2-b2c8-2077afe83d97 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:48.377186129 +0000 UTC m=+38.101365755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls") pod "image-registry-8679779578-x7w2s" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97") : secret "image-registry-tls" not found Sep 11 05:20:46.377595 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.377212 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls podName:97bc18e9-1612-4bc1-acc2-1e0bcc5394b8 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:48.377203607 +0000 UTC m=+38.101383236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g95w2" (UID: "97bc18e9-1612-4bc1-acc2-1e0bcc5394b8") : secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:46.477924 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.477884 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:46.478092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.477961 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:46.478092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:46.478016 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:46.478216 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.478148 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 05:20:46.478216 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.478203 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls podName:682454e1-5ba2-4c02-b92d-8c2b66c59a66 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:48.478188775 +0000 UTC m=+38.202368401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls") pod "dns-default-rh6tw" (UID: "682454e1-5ba2-4c02-b92d-8c2b66c59a66") : secret "dns-default-metrics-tls" not found Sep 11 05:20:46.478632 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.478615 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:20:48.478598542 +0000 UTC m=+38.202778170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : configmap references non-existent config key: service-ca.crt Sep 11 05:20:46.478715 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.478692 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 05:20:46.478766 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:46.478727 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:20:48.478714607 +0000 UTC m=+38.202894235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : secret "router-metrics-certs-default" not found Sep 11 05:20:48.395621 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:48.395401 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:48.395667 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.395584 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.395712 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679779578-x7w2s: secret "image-registry-tls" not found Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:48.395737 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.395777 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls podName:d5a02ec5-fc69-40a2-b2c8-2077afe83d97 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:52.395757856 +0000 UTC m=+42.119937482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls") pod "image-registry-8679779578-x7w2s" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97") : secret "image-registry-tls" not found Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.395835 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.395856 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.395880 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls podName:97bc18e9-1612-4bc1-acc2-1e0bcc5394b8 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:52.395863283 +0000 UTC m=+42.120042920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g95w2" (UID: "97bc18e9-1612-4bc1-acc2-1e0bcc5394b8") : secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:48.396074 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.395920 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls podName:0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e nodeName:}" failed. No retries permitted until 2026-09-11 05:20:52.39590201 +0000 UTC m=+42.120081636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zjhng" (UID: "0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e") : secret "samples-operator-tls" not found Sep 11 05:20:48.497199 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:48.496334 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:48.497199 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:48.496441 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:48.497199 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:48.496528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:48.497199 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.496721 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 05:20:48.497199 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.496789 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:20:52.49677114 +0000 UTC m=+42.220950768 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : secret "router-metrics-certs-default" not found Sep 11 05:20:48.499320 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.498040 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 05:20:48.499320 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.498120 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls podName:682454e1-5ba2-4c02-b92d-8c2b66c59a66 nodeName:}" failed. No retries permitted until 2026-09-11 05:20:52.498101619 +0000 UTC m=+42.222281260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls") pod "dns-default-rh6tw" (UID: "682454e1-5ba2-4c02-b92d-8c2b66c59a66") : secret "dns-default-metrics-tls" not found Sep 11 05:20:48.499320 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:48.498230 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:20:52.498218141 +0000 UTC m=+42.222397777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : configmap references non-existent config key: service-ca.crt Sep 11 05:20:52.431049 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:52.431010 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:52.431070 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:52.431140 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.431187 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.431225 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.431236 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679779578-x7w2s: secret "image-registry-tls" not found Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.431254 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls podName:0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e nodeName:}" failed. No retries permitted until 2026-09-11 05:21:00.431238482 +0000 UTC m=+50.155418106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zjhng" (UID: "0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e") : secret "samples-operator-tls" not found Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.431272 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls podName:d5a02ec5-fc69-40a2-b2c8-2077afe83d97 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:00.431261388 +0000 UTC m=+50.155441013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls") pod "image-registry-8679779578-x7w2s" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97") : secret "image-registry-tls" not found Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.431225 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:52.431440 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.431297 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls podName:97bc18e9-1612-4bc1-acc2-1e0bcc5394b8 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:00.431291624 +0000 UTC m=+50.155471245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g95w2" (UID: "97bc18e9-1612-4bc1-acc2-1e0bcc5394b8") : secret "cluster-monitoring-operator-tls" not found Sep 11 05:20:52.531604 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:52.531575 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:20:52.531737 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:52.531633 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:52.531737 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.531701 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 05:20:52.531809 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.531712 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:21:00.531700825 +0000 UTC m=+50.255880446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : configmap references non-existent config key: service-ca.crt Sep 11 05:20:52.531809 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.531762 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls podName:682454e1-5ba2-4c02-b92d-8c2b66c59a66 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:00.531749951 +0000 UTC m=+50.255929572 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls") pod "dns-default-rh6tw" (UID: "682454e1-5ba2-4c02-b92d-8c2b66c59a66") : secret "dns-default-metrics-tls" not found Sep 11 05:20:52.531881 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:52.531813 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:20:52.531913 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.531903 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 05:20:52.531947 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:52.531928 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:21:00.531920701 +0000 UTC m=+50.256100322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : secret "router-metrics-certs-default" not found Sep 11 05:20:54.032293 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:54.032066 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerStarted","Data":"7952f332088347d3570e37d8628b99b521f2b34ee1efe37e0308d17588e0579d"} Sep 11 05:20:54.034995 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:54.034924 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" event={"ID":"f933e7e1-994e-453c-a52a-74349bdc41d3","Type":"ContainerStarted","Data":"fef001242f09cee651deda53a05c25068a244a5e8e282014c6cc9ea01b67fd8c"} Sep 11 05:20:55.048862 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.048290 2569 generic.go:356] "Generic (PLEG): container finished" podID="64063deb-08d8-43d4-9cfb-446b3496652e" containerID="7952f332088347d3570e37d8628b99b521f2b34ee1efe37e0308d17588e0579d" exitCode=0 Sep 11 05:20:55.048862 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.048380 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerDied","Data":"7952f332088347d3570e37d8628b99b521f2b34ee1efe37e0308d17588e0579d"} Sep 11 05:20:55.050570 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.050526 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n29fh" event={"ID":"c12aa7da-3ae4-4d26-bb5a-787feddaa9f2","Type":"ContainerStarted","Data":"52bfb8891b583882e50573d82b2708b2e46e2ecb2ece87308202cba6fd6718c6"} Sep 11 05:20:55.053824 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.053804 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/0.log" Sep 11 05:20:55.053901 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.053845 2569 generic.go:356] "Generic (PLEG): container finished" podID="f933e7e1-994e-453c-a52a-74349bdc41d3" containerID="fef001242f09cee651deda53a05c25068a244a5e8e282014c6cc9ea01b67fd8c" exitCode=255 Sep 11 05:20:55.054014 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.053994 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" event={"ID":"f933e7e1-994e-453c-a52a-74349bdc41d3","Type":"ContainerDied","Data":"fef001242f09cee651deda53a05c25068a244a5e8e282014c6cc9ea01b67fd8c"} Sep 11 05:20:55.054149 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.054135 2569 scope.go:117] "RemoveContainer" containerID="fef001242f09cee651deda53a05c25068a244a5e8e282014c6cc9ea01b67fd8c" Sep 11 05:20:55.056901 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.056877 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq" event={"ID":"a478863e-495d-4f6d-9500-770a4eea85bd","Type":"ContainerStarted","Data":"22566337c272869ff2a531e45d0e578481c4115204ff185c31980893a5a55e01"} Sep 11 05:20:55.058632 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.058602 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd" event={"ID":"9a374b1f-83c6-454b-8161-4a46d45f6139","Type":"ContainerStarted","Data":"3c1c07af3565c31d69c81201e719f48d29d1d0d039f721eebd4254e1cf003edb"} Sep 11 05:20:55.060876 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.060852 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-v6wtq" event={"ID":"fc957ed2-08b1-4e47-a8fb-e7cf25902179","Type":"ContainerStarted","Data":"8d15bc9a67316371f180a24ba322b572265a73580a6c75f94bae225bf03dd66e"} Sep 11 05:20:55.062425 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.062401 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" event={"ID":"4dea7e44-25b3-4c8b-8f36-80ddf7026505","Type":"ContainerStarted","Data":"fe370201947b835d69edf5b7a4099e8ae42736eff6795b025ba1ff3e8bd0e786"} Sep 11 05:20:55.063934 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.063911 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" event={"ID":"70c2394a-6f61-412b-ab38-08390abfa53e","Type":"ContainerStarted","Data":"ce8df17d380f42bc1510b656ee613fc15ed8a78b6bac318e943e957236843a95"} Sep 11 05:20:55.113265 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.110207 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-v6wtq" podStartSLOduration=31.62803674 podStartE2EDuration="40.110173019s" totalImagesPullingTime="8.482136279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:55.08817105 +0000 UTC m=+44.812350695" watchObservedRunningTime="2026-09-11 05:20:55.110173019 +0000 UTC m=+44.834352661" Sep 11 05:20:55.113265 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.110758 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" podStartSLOduration=31.616306397 podStartE2EDuration="40.110745498s" totalImagesPullingTime="8.494439101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:55.109925986 +0000 UTC m=+44.834105631" watchObservedRunningTime="2026-09-11 05:20:55.110745498 +0000 UTC m=+44.834925143" Sep 11 05:20:55.162162 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.160889 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-9jnhd" podStartSLOduration=26.69005268 podStartE2EDuration="35.160867799s" totalImagesPullingTime="8.470815119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:55.145910381 +0000 UTC m=+44.870090028" watchObservedRunningTime="2026-09-11 05:20:55.160867799 +0000 UTC m=+44.885047445" Sep 11 05:20:55.178778 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.178725 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n29fh" podStartSLOduration=2.702912501 podStartE2EDuration="11.17870479s" totalImagesPullingTime="8.475792289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:55.162018136 +0000 UTC m=+44.886197781" watchObservedRunningTime="2026-09-11 05:20:55.17870479 +0000 UTC m=+44.902884414" Sep 11 05:20:55.180190 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.180153 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-vnfwq" podStartSLOduration=31.683841246 podStartE2EDuration="40.180139668s" totalImagesPullingTime="8.496298422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:55.178852359 +0000 UTC m=+44.903032194" watchObservedRunningTime="2026-09-11 05:20:55.180139668 +0000 UTC m=+44.904319313" Sep 11 05:20:55.197667 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.197367 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" podStartSLOduration=31.729583007 podStartE2EDuration="40.197346193s" totalImagesPullingTime="8.467763186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:55.196487425 +0000 UTC m=+44.920667070" watchObservedRunningTime="2026-09-11 05:20:55.197346193 +0000 UTC m=+44.921525865" Sep 11 05:20:55.359071 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.359032 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rxb5g"] Sep 11 05:20:55.370680 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.370655 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.374509 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.373810 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 11 05:20:55.374509 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.374171 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rpvwz\"" Sep 11 05:20:55.374509 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.374348 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 11 05:20:55.374509 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.374501 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rxb5g"] Sep 11 05:20:55.558484 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.558445 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.558654 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.558497 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d81c499-6929-467a-983f-64090a6b231c-crio-socket\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.558654 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.558530 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f85zh\" (UniqueName: \"kubernetes.io/projected/6d81c499-6929-467a-983f-64090a6b231c-kube-api-access-f85zh\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.558777 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.558707 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d81c499-6929-467a-983f-64090a6b231c-data-volume\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.558777 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.558747 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.660067 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.660029 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.660210 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.660077 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d81c499-6929-467a-983f-64090a6b231c-crio-socket\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.660210 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.660116 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f85zh\" (UniqueName: \"kubernetes.io/projected/6d81c499-6929-467a-983f-64090a6b231c-kube-api-access-f85zh\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.660210 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:55.660191 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 05:20:55.660318 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.660293 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6d81c499-6929-467a-983f-64090a6b231c-crio-socket\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.660371 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.660314 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d81c499-6929-467a-983f-64090a6b231c-data-volume\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.660371 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:55.660355 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:20:56.160326638 +0000 UTC m=+45.884506265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : secret "insights-runtime-extractor-tls" not found Sep 11 05:20:55.660470 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.660391 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.660519 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:55.660508 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 05:20:55.660598 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:55.660583 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:20:56.160567708 +0000 UTC m=+45.884747352 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : configmap "kube-rbac-proxy" not found Sep 11 05:20:55.660748 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.660726 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d81c499-6929-467a-983f-64090a6b231c-data-volume\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:55.668885 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:55.668864 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f85zh\" (UniqueName: \"kubernetes.io/projected/6d81c499-6929-467a-983f-64090a6b231c-kube-api-access-f85zh\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:56.070939 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.070908 2569 generic.go:356] "Generic (PLEG): container finished" podID="64063deb-08d8-43d4-9cfb-446b3496652e" containerID="9cd65f462ca571f3aeaad90454eae0f50f6acb1b05548732d277e3a431d5d623" exitCode=0 Sep 11 05:20:56.071387 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.070952 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerDied","Data":"9cd65f462ca571f3aeaad90454eae0f50f6acb1b05548732d277e3a431d5d623"} Sep 11 05:20:56.072631 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.072614 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:20:56.072997 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.072984 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/0.log" Sep 11 05:20:56.073070 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.073013 2569 generic.go:356] "Generic (PLEG): container finished" podID="f933e7e1-994e-453c-a52a-74349bdc41d3" containerID="4a1c318fbbbda0a2e621a812752ecac347ad1a5717d5438d327e6de96cc319c2" exitCode=255 Sep 11 05:20:56.073111 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.073086 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" event={"ID":"f933e7e1-994e-453c-a52a-74349bdc41d3","Type":"ContainerDied","Data":"4a1c318fbbbda0a2e621a812752ecac347ad1a5717d5438d327e6de96cc319c2"} Sep 11 05:20:56.073157 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.073132 2569 scope.go:117] "RemoveContainer" containerID="fef001242f09cee651deda53a05c25068a244a5e8e282014c6cc9ea01b67fd8c" Sep 11 05:20:56.073281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.073263 2569 scope.go:117] "RemoveContainer" containerID="4a1c318fbbbda0a2e621a812752ecac347ad1a5717d5438d327e6de96cc319c2" Sep 11 05:20:56.073465 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:56.073442 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-zrtx2_openshift-console-operator(f933e7e1-994e-453c-a52a-74349bdc41d3)\"" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" podUID="f933e7e1-994e-453c-a52a-74349bdc41d3" Sep 11 05:20:56.166574 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.165878 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:56.166574 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:56.166429 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 05:20:56.166574 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:56.166497 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:20:57.166469965 +0000 UTC m=+46.890649587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : configmap "kube-rbac-proxy" not found Sep 11 05:20:56.166574 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.166496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:56.166803 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:56.166689 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 05:20:56.166803 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:56.166787 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:20:57.166766945 +0000 UTC m=+46.890946579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : secret "insights-runtime-extractor-tls" not found Sep 11 05:20:56.849146 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:56.849079 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cnvp6_e41e0543-6109-4304-baaf-2f5c1ef80e11/dns-node-resolver/0.log" Sep 11 05:20:57.080090 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:57.080050 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" event={"ID":"64063deb-08d8-43d4-9cfb-446b3496652e","Type":"ContainerStarted","Data":"8d0a56bb6655c9443a0ff9d7f11fc922f885bcac3d7d31414febe6095bca87cc"} Sep 11 05:20:57.081455 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:57.081435 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:20:57.081783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:57.081765 2569 scope.go:117] "RemoveContainer" containerID="4a1c318fbbbda0a2e621a812752ecac347ad1a5717d5438d327e6de96cc319c2" Sep 11 05:20:57.081958 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:57.081925 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-zrtx2_openshift-console-operator(f933e7e1-994e-453c-a52a-74349bdc41d3)\"" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" podUID="f933e7e1-994e-453c-a52a-74349bdc41d3" Sep 11 05:20:57.103213 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:57.103124 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9f4bx" podStartSLOduration=10.360646958 podStartE2EDuration="46.103108086s" totalImagesPullingTime="35.742461128s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:20:57.10131238 +0000 UTC m=+46.825492024" watchObservedRunningTime="2026-09-11 05:20:57.103108086 +0000 UTC m=+46.827287730" Sep 11 05:20:57.174330 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:57.174285 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:57.174521 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:57.174371 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 05:20:57.174521 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:57.174450 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:20:59.174431701 +0000 UTC m=+48.898611329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : configmap "kube-rbac-proxy" not found Sep 11 05:20:57.174675 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:57.174615 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:57.174827 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:57.174804 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 05:20:57.174891 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:57.174874 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:20:59.174855551 +0000 UTC m=+48.899035188 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : secret "insights-runtime-extractor-tls" not found Sep 11 05:20:58.248582 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:58.248556 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sh49c_5850659d-ad02-4261-ae58-8a547785ec32/node-ca/0.log" Sep 11 05:20:58.848986 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:58.848958 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n29fh_c12aa7da-3ae4-4d26-bb5a-787feddaa9f2/serve-healthcheck-canary/0.log" Sep 11 05:20:59.192532 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:59.192451 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:59.192706 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:20:59.192596 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:20:59.192706 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:59.192628 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 05:20:59.192706 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:59.192694 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:21:03.192675695 +0000 UTC m=+52.916855328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : secret "insights-runtime-extractor-tls" not found Sep 11 05:20:59.192865 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:59.192726 2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 11 05:20:59.192865 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:20:59.192808 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:21:03.192788394 +0000 UTC m=+52.916968019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : configmap "kube-rbac-proxy" not found Sep 11 05:21:00.504060 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:00.504027 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:21:00.504431 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:00.504154 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:21:00.504431 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:00.504219 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:21:00.504431 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.504302 2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 11 05:21:00.504431 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.504329 2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679779578-x7w2s: secret "image-registry-tls" not found Sep 11 05:21:00.504431 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.504307 2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 11 05:21:00.504431 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.504382 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls podName:d5a02ec5-fc69-40a2-b2c8-2077afe83d97 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.504367708 +0000 UTC m=+66.228547330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls") pod "image-registry-8679779578-x7w2s" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97") : secret "image-registry-tls" not found Sep 11 05:21:00.504431 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.504397 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls podName:0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.504389057 +0000 UTC m=+66.228568680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zjhng" (UID: "0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e") : secret "samples-operator-tls" not found Sep 11 05:21:00.504744 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.504729 2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 11 05:21:00.504788 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.504779 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls podName:97bc18e9-1612-4bc1-acc2-1e0bcc5394b8 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.504766999 +0000 UTC m=+66.228946625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-g95w2" (UID: "97bc18e9-1612-4bc1-acc2-1e0bcc5394b8") : secret "cluster-monitoring-operator-tls" not found Sep 11 05:21:00.604910 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:00.604879 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:21:00.605056 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:00.604968 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:00.605056 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.605020 2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 11 05:21:00.605177 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:00.605068 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:00.605177 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.605076 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls podName:682454e1-5ba2-4c02-b92d-8c2b66c59a66 nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.605063611 +0000 UTC m=+66.329243234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls") pod "dns-default-rh6tw" (UID: "682454e1-5ba2-4c02-b92d-8c2b66c59a66") : secret "dns-default-metrics-tls" not found Sep 11 05:21:00.605177 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.605114 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.605087524 +0000 UTC m=+66.329267146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : configmap references non-existent config key: service-ca.crt Sep 11 05:21:00.605177 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.605148 2569 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 11 05:21:00.605332 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:00.605204 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs podName:6da37175-6b47-4105-ba72-c2644ada4fff nodeName:}" failed. No retries permitted until 2026-09-11 05:21:16.605190774 +0000 UTC m=+66.329370410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs") pod "router-default-7666854f74-b8zpj" (UID: "6da37175-6b47-4105-ba72-c2644ada4fff") : secret "router-metrics-certs-default" not found Sep 11 05:21:03.228797 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:03.228749 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:21:03.229372 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:03.228873 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:21:03.229372 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:03.228921 2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 11 05:21:03.229372 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:03.229016 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls podName:6d81c499-6929-467a-983f-64090a6b231c nodeName:}" failed. No retries permitted until 2026-09-11 05:21:11.228995782 +0000 UTC m=+60.953175407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rxb5g" (UID: "6d81c499-6929-467a-983f-64090a6b231c") : secret "insights-runtime-extractor-tls" not found Sep 11 05:21:03.229507 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:03.229384 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6d81c499-6929-467a-983f-64090a6b231c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:21:05.023861 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:05.023831 2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:21:05.024270 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:05.023879 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:21:05.024270 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:05.024168 2569 scope.go:117] "RemoveContainer" containerID="4a1c318fbbbda0a2e621a812752ecac347ad1a5717d5438d327e6de96cc319c2" Sep 11 05:21:05.024344 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:21:05.024310 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-zrtx2_openshift-console-operator(f933e7e1-994e-453c-a52a-74349bdc41d3)\"" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" podUID="f933e7e1-994e-453c-a52a-74349bdc41d3" Sep 11 05:21:10.989881 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:10.989854 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78lkv" Sep 11 05:21:11.294119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:11.294047 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:21:11.296113 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:11.296096 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6d81c499-6929-467a-983f-64090a6b231c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rxb5g\" (UID: \"6d81c499-6929-467a-983f-64090a6b231c\") " pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:21:11.585246 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:11.585160 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rpvwz\"" Sep 11 05:21:11.593921 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:11.593903 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rxb5g" Sep 11 05:21:11.868728 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:11.868654 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rxb5g"] Sep 11 05:21:11.872152 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:11.872127 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d81c499_6929_467a_983f_64090a6b231c.slice/crio-3012283c8db2521a3dbe1d41719c7231391bc2f2895baa755168e3f7c83981f9 WatchSource:0}: Error finding container 3012283c8db2521a3dbe1d41719c7231391bc2f2895baa755168e3f7c83981f9: Status 404 returned error can't find the container with id 3012283c8db2521a3dbe1d41719c7231391bc2f2895baa755168e3f7c83981f9 Sep 11 05:21:12.133039 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:12.132960 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxb5g" event={"ID":"6d81c499-6929-467a-983f-64090a6b231c","Type":"ContainerStarted","Data":"3603104992a7100ec256c71929907d31a17e1ae4bb9cb79f4cf88f84d369d2fe"} Sep 11 05:21:12.133039 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:12.133016 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxb5g" event={"ID":"6d81c499-6929-467a-983f-64090a6b231c","Type":"ContainerStarted","Data":"3012283c8db2521a3dbe1d41719c7231391bc2f2895baa755168e3f7c83981f9"} Sep 11 05:21:15.144654 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:15.144618 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxb5g" event={"ID":"6d81c499-6929-467a-983f-64090a6b231c","Type":"ContainerStarted","Data":"9d27b1f2b8a26f5dd7aab05978e6a83a6a82985d7372f388967a2a50f326f71e"} Sep 11 05:21:15.757554 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:15.757506 2569 scope.go:117] "RemoveContainer" containerID="4a1c318fbbbda0a2e621a812752ecac347ad1a5717d5438d327e6de96cc319c2" Sep 11 05:21:16.149844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.149761 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:21:16.150229 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.149873 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" event={"ID":"f933e7e1-994e-453c-a52a-74349bdc41d3","Type":"ContainerStarted","Data":"655503da8e0fa5e4d709bd7b400fec61e0fc4f3b9b8c201cd20ffceb76d52887"} Sep 11 05:21:16.150229 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.150194 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:21:16.152296 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.152270 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rxb5g" event={"ID":"6d81c499-6929-467a-983f-64090a6b231c","Type":"ContainerStarted","Data":"ea8e1269b40e4f6bba88d013ba95dbe7dd41f1ec3ce9185e03d0c80fd1cd6ea8"} Sep 11 05:21:16.166310 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.166273 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" podStartSLOduration=52.725312932 podStartE2EDuration="1m1.166260943s" totalImagesPullingTime="8.440948011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:16.165024154 +0000 UTC m=+65.889203798" watchObservedRunningTime="2026-09-11 05:21:16.166260943 +0000 UTC m=+65.890440627" Sep 11 05:21:16.179977 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.179936 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rxb5g" podStartSLOduration=17.248840439 podStartE2EDuration="21.179924413s" totalImagesPullingTime="3.931083974s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:16.179460162 +0000 UTC m=+65.903639807" watchObservedRunningTime="2026-09-11 05:21:16.179924413 +0000 UTC m=+65.904104058" Sep 11 05:21:16.541408 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.541372 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:21:16.541646 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.541492 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:21:16.541646 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.541561 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:21:16.543904 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.543872 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"image-registry-8679779578-x7w2s\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:21:16.544031 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.543991 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zjhng\" (UID: \"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:21:16.544031 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.543991 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97bc18e9-1612-4bc1-acc2-1e0bcc5394b8-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-g95w2\" (UID: \"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:21:16.612274 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.612239 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-zrtx2" Sep 11 05:21:16.643836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.642406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:21:16.643836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.642472 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:21:16.643836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.642528 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:21:16.643836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.642579 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:16.643836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.642618 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:21:16.643836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.642659 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:16.644252 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.643901 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6da37175-6b47-4105-ba72-c2644ada4fff-service-ca-bundle\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:16.646464 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.646035 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 11 05:21:16.646464 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.646234 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6da37175-6b47-4105-ba72-c2644ada4fff-metrics-certs\") pod \"router-default-7666854f74-b8zpj\" (UID: \"6da37175-6b47-4105-ba72-c2644ada4fff\") " pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:16.646464 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.646361 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 11 05:21:16.647518 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.647451 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5t9p\" (UniqueName: \"kubernetes.io/projected/a176acf4-1745-4e19-86f9-e6721082ea17-kube-api-access-m5t9p\") pod \"network-check-target-vcbgt\" (UID: \"a176acf4-1745-4e19-86f9-e6721082ea17\") " pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:21:16.648154 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.648129 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/682454e1-5ba2-4c02-b92d-8c2b66c59a66-metrics-tls\") pod \"dns-default-rh6tw\" (UID: \"682454e1-5ba2-4c02-b92d-8c2b66c59a66\") " pod="openshift-dns/dns-default-rh6tw" Sep 11 05:21:16.656189 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.656160 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00440703-718d-4501-9ff5-1d00f39b4ec3-original-pull-secret\") pod \"global-pull-secret-syncer-l5k7k\" (UID: \"00440703-718d-4501-9ff5-1d00f39b4ec3\") " pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:21:16.656321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.656273 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9079d0d-8a44-4c4e-ba0d-43284c60f675-metrics-certs\") pod \"network-metrics-daemon-4lj77\" (UID: \"b9079d0d-8a44-4c4e-ba0d-43284c60f675\") " pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:21:16.674429 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.674394 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g92vd\"" Sep 11 05:21:16.681100 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.681081 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l5k7k" Sep 11 05:21:16.683197 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.683178 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4lj77" Sep 11 05:21:16.688921 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.688903 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dpzsh\"" Sep 11 05:21:16.697794 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.697774 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:21:16.809582 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.809407 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-drtnm\"" Sep 11 05:21:16.816204 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.816179 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cl9l5\"" Sep 11 05:21:16.817148 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.817115 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:21:16.824392 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.824368 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" Sep 11 05:21:16.831472 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.831453 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hxvnb\"" Sep 11 05:21:16.838229 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.838207 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7z8t4\"" Sep 11 05:21:16.840090 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.840016 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" Sep 11 05:21:16.847342 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.847304 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rh6tw" Sep 11 05:21:16.878345 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.877629 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gzzwv\"" Sep 11 05:21:16.885830 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.885344 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:16.955652 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.955582 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l5k7k"] Sep 11 05:21:16.959054 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.959005 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4lj77"] Sep 11 05:21:16.971237 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:16.969199 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00440703_718d_4501_9ff5_1d00f39b4ec3.slice/crio-e4a011e928f7aaef50640bad6b2a7895e75486c696586c3faa891e775c8cf7d2 WatchSource:0}: Error finding container e4a011e928f7aaef50640bad6b2a7895e75486c696586c3faa891e775c8cf7d2: Status 404 returned error can't find the container with id e4a011e928f7aaef50640bad6b2a7895e75486c696586c3faa891e775c8cf7d2 Sep 11 05:21:16.996117 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:16.996089 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vcbgt"] Sep 11 05:21:16.998912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:16.998886 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda176acf4_1745_4e19_86f9_e6721082ea17.slice/crio-ccd2cf7b8b14d6db08b4673d51373bf617a92a0f70da4154404f2213b430f5f0 WatchSource:0}: Error finding container ccd2cf7b8b14d6db08b4673d51373bf617a92a0f70da4154404f2213b430f5f0: Status 404 returned error can't find the container with id ccd2cf7b8b14d6db08b4673d51373bf617a92a0f70da4154404f2213b430f5f0 Sep 11 05:21:17.100747 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.100723 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8679779578-x7w2s"] Sep 11 05:21:17.103448 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:17.103387 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a02ec5_fc69_40a2_b2c8_2077afe83d97.slice/crio-930335cae1a63476d90d5543f35dc7c33316e23beda944eda6443f055467c4d3 WatchSource:0}: Error finding container 930335cae1a63476d90d5543f35dc7c33316e23beda944eda6443f055467c4d3: Status 404 returned error can't find the container with id 930335cae1a63476d90d5543f35dc7c33316e23beda944eda6443f055467c4d3 Sep 11 05:21:17.104668 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.104649 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2"] Sep 11 05:21:17.108193 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:17.108172 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bc18e9_1612_4bc1_acc2_1e0bcc5394b8.slice/crio-bc50555d23a1e23014a1aa709a3eb6ffc2f96ad2f4f043452a92767c841f1d6d WatchSource:0}: Error finding container bc50555d23a1e23014a1aa709a3eb6ffc2f96ad2f4f043452a92767c841f1d6d: Status 404 returned error can't find the container with id bc50555d23a1e23014a1aa709a3eb6ffc2f96ad2f4f043452a92767c841f1d6d Sep 11 05:21:17.137121 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.137098 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng"] Sep 11 05:21:17.151480 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.151454 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rh6tw"] Sep 11 05:21:17.162275 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.162209 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8679779578-x7w2s" event={"ID":"d5a02ec5-fc69-40a2-b2c8-2077afe83d97","Type":"ContainerStarted","Data":"930335cae1a63476d90d5543f35dc7c33316e23beda944eda6443f055467c4d3"} Sep 11 05:21:17.163943 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.163919 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lj77" event={"ID":"b9079d0d-8a44-4c4e-ba0d-43284c60f675","Type":"ContainerStarted","Data":"06a7c60db080ed52c3b23f968ededa5dc44ec48e21bbb4e53e754de80ccaf66a"} Sep 11 05:21:17.165112 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.165088 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" event={"ID":"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8","Type":"ContainerStarted","Data":"bc50555d23a1e23014a1aa709a3eb6ffc2f96ad2f4f043452a92767c841f1d6d"} Sep 11 05:21:17.166694 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.166667 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vcbgt" event={"ID":"a176acf4-1745-4e19-86f9-e6721082ea17","Type":"ContainerStarted","Data":"04f662f84240b3ca196cdb08887009f34f8c5356d1e7181a4ae31f6969a38e3c"} Sep 11 05:21:17.166776 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.166714 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vcbgt" event={"ID":"a176acf4-1745-4e19-86f9-e6721082ea17","Type":"ContainerStarted","Data":"ccd2cf7b8b14d6db08b4673d51373bf617a92a0f70da4154404f2213b430f5f0"} Sep 11 05:21:17.166841 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.166792 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:21:17.168017 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.167995 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5k7k" event={"ID":"00440703-718d-4501-9ff5-1d00f39b4ec3","Type":"ContainerStarted","Data":"e4a011e928f7aaef50640bad6b2a7895e75486c696586c3faa891e775c8cf7d2"} Sep 11 05:21:17.181745 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.181475 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vcbgt" podStartSLOduration=66.181457838 podStartE2EDuration="1m6.181457838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:17.181158627 +0000 UTC m=+66.905338286" watchObservedRunningTime="2026-09-11 05:21:17.181457838 +0000 UTC m=+66.905637482" Sep 11 05:21:17.196798 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:17.196743 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7666854f74-b8zpj"] Sep 11 05:21:17.200427 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:17.200405 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da37175_6b47_4105_ba72_c2644ada4fff.slice/crio-a0ff83c721bdc1799aa35a1ce123f921431c81c51eb9aa9fdbc7e84fd8fed724 WatchSource:0}: Error finding container a0ff83c721bdc1799aa35a1ce123f921431c81c51eb9aa9fdbc7e84fd8fed724: Status 404 returned error can't find the container with id a0ff83c721bdc1799aa35a1ce123f921431c81c51eb9aa9fdbc7e84fd8fed724 Sep 11 05:21:18.178495 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.177585 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8679779578-x7w2s" event={"ID":"d5a02ec5-fc69-40a2-b2c8-2077afe83d97","Type":"ContainerStarted","Data":"3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac"} Sep 11 05:21:18.178495 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.178423 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:21:18.182155 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.181632 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7666854f74-b8zpj" event={"ID":"6da37175-6b47-4105-ba72-c2644ada4fff","Type":"ContainerStarted","Data":"c78868eabbdade5eb069f807a09e2a942c5ccd921d7874d9d084e1e9e0772c27"} Sep 11 05:21:18.182155 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.181673 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7666854f74-b8zpj" event={"ID":"6da37175-6b47-4105-ba72-c2644ada4fff","Type":"ContainerStarted","Data":"a0ff83c721bdc1799aa35a1ce123f921431c81c51eb9aa9fdbc7e84fd8fed724"} Sep 11 05:21:18.185702 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.185653 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rh6tw" event={"ID":"682454e1-5ba2-4c02-b92d-8c2b66c59a66","Type":"ContainerStarted","Data":"c74c2df98e51962a87845b363de776f13b6f7c241d6b34c208a43e4d54a3bb33"} Sep 11 05:21:18.188347 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.187899 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" event={"ID":"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e","Type":"ContainerStarted","Data":"e5daa6a9eccd7cce2a9bd49ad68df4b9e1ba10c57c007f4ba972045b9b5843e8"} Sep 11 05:21:18.217887 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.217824 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8679779578-x7w2s" podStartSLOduration=67.217801849 podStartE2EDuration="1m7.217801849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:18.200565041 +0000 UTC m=+67.924744667" watchObservedRunningTime="2026-09-11 05:21:18.217801849 +0000 UTC m=+67.941981493" Sep 11 05:21:18.886302 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.886263 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:18.889412 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.889384 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:18.907295 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:18.907236 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7666854f74-b8zpj" podStartSLOduration=63.907212888 podStartE2EDuration="1m3.907212888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:18.218972383 +0000 UTC m=+67.943152031" watchObservedRunningTime="2026-09-11 05:21:18.907212888 +0000 UTC m=+68.631392534" Sep 11 05:21:19.195711 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:19.195620 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lj77" event={"ID":"b9079d0d-8a44-4c4e-ba0d-43284c60f675","Type":"ContainerStarted","Data":"2397767c01e5f577b1a3e1dc4e6830be2c2b045d4b847be1f1561d5562931a57"} Sep 11 05:21:19.195711 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:19.195695 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4lj77" event={"ID":"b9079d0d-8a44-4c4e-ba0d-43284c60f675","Type":"ContainerStarted","Data":"1a7af5810b69cc5110de858d77b9d2ac7104b8c15d55049d37dbb897bc59a83c"} Sep 11 05:21:19.196237 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:19.196155 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:19.197241 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:19.197218 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7666854f74-b8zpj" Sep 11 05:21:19.212041 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:19.211622 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4lj77" podStartSLOduration=66.875298243 podStartE2EDuration="1m8.211609268s" totalImagesPullingTime="1.336311025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:19.211090295 +0000 UTC m=+68.935269941" watchObservedRunningTime="2026-09-11 05:21:19.211609268 +0000 UTC m=+68.935788927" Sep 11 05:21:20.012186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.012152 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z"] Sep 11 05:21:20.024927 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.024714 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9"] Sep 11 05:21:20.025957 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.025932 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" Sep 11 05:21:20.029914 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.029739 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 11 05:21:20.029914 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.029781 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 11 05:21:20.029914 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.029894 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z"] Sep 11 05:21:20.030095 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.029987 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.033396 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.031751 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 11 05:21:20.033396 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.031773 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-96gff\"" Sep 11 05:21:20.033396 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.032003 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 11 05:21:20.033396 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.032905 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 11 05:21:20.033396 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.033207 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9"] Sep 11 05:21:20.175156 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.175106 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrxxj\" (UniqueName: \"kubernetes.io/projected/330b4cea-2999-4e7b-ba18-21f43639f02b-kube-api-access-vrxxj\") pod \"managed-serviceaccount-addon-agent-dfd7849f4-r6h6z\" (UID: \"330b4cea-2999-4e7b-ba18-21f43639f02b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" Sep 11 05:21:20.175342 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.175169 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.175342 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.175259 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/330b4cea-2999-4e7b-ba18-21f43639f02b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dfd7849f4-r6h6z\" (UID: \"330b4cea-2999-4e7b-ba18-21f43639f02b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" Sep 11 05:21:20.175342 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.175318 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-tmp\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.175486 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.175399 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4jnm\" (UniqueName: \"kubernetes.io/projected/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-kube-api-access-p4jnm\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.277656 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.276716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrxxj\" (UniqueName: \"kubernetes.io/projected/330b4cea-2999-4e7b-ba18-21f43639f02b-kube-api-access-vrxxj\") pod \"managed-serviceaccount-addon-agent-dfd7849f4-r6h6z\" (UID: \"330b4cea-2999-4e7b-ba18-21f43639f02b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" Sep 11 05:21:20.277656 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.276826 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.277656 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.276910 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/330b4cea-2999-4e7b-ba18-21f43639f02b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dfd7849f4-r6h6z\" (UID: \"330b4cea-2999-4e7b-ba18-21f43639f02b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" Sep 11 05:21:20.277656 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.276988 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-tmp\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.277656 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.277109 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jnm\" (UniqueName: \"kubernetes.io/projected/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-kube-api-access-p4jnm\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.278346 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.277767 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-tmp\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.280502 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.280476 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.280648 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.280474 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/330b4cea-2999-4e7b-ba18-21f43639f02b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-dfd7849f4-r6h6z\" (UID: \"330b4cea-2999-4e7b-ba18-21f43639f02b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" Sep 11 05:21:20.285288 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.285262 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4jnm\" (UniqueName: \"kubernetes.io/projected/a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d-kube-api-access-p4jnm\") pod \"klusterlet-addon-workmgr-7f66c54d79-qt5h9\" (UID: \"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.285610 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.285572 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrxxj\" (UniqueName: \"kubernetes.io/projected/330b4cea-2999-4e7b-ba18-21f43639f02b-kube-api-access-vrxxj\") pod \"managed-serviceaccount-addon-agent-dfd7849f4-r6h6z\" (UID: \"330b4cea-2999-4e7b-ba18-21f43639f02b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" Sep 11 05:21:20.364300 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.364270 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" Sep 11 05:21:20.369852 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.369822 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:20.738577 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.738365 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z"] Sep 11 05:21:20.741572 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:20.741499 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9"] Sep 11 05:21:21.206342 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.206295 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" event={"ID":"97bc18e9-1612-4bc1-acc2-1e0bcc5394b8","Type":"ContainerStarted","Data":"772770dc05bde6a134a9286f57f1efc7bd912dcad5e9d9fa3593b75836886010"} Sep 11 05:21:21.208588 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.208559 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rh6tw" event={"ID":"682454e1-5ba2-4c02-b92d-8c2b66c59a66","Type":"ContainerStarted","Data":"b569f519e12e0236ee5356c6442740e03d5a3dd13351f532525fd74c8cfe5a7f"} Sep 11 05:21:21.208731 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.208607 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rh6tw" event={"ID":"682454e1-5ba2-4c02-b92d-8c2b66c59a66","Type":"ContainerStarted","Data":"67cbefb8aa34b8d4319454ecb1bfd845842bae444e20b5efae456c4d3802d52e"} Sep 11 05:21:21.208731 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.208657 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rh6tw" Sep 11 05:21:21.210601 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.210574 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" event={"ID":"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e","Type":"ContainerStarted","Data":"907a5fec31a4ad2d85bba99472d0d7a8a08d46a57553035bc5c8421091fa2f8e"} Sep 11 05:21:21.210730 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.210624 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" event={"ID":"0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e","Type":"ContainerStarted","Data":"71cfc86e140dd1369d7084b2e272a25b8e2fe6aa8b5bf5b155a30917e6bd1a6c"} Sep 11 05:21:21.223981 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.223929 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-g95w2" podStartSLOduration=62.890313333 podStartE2EDuration="1m6.223909876s" totalImagesPullingTime="3.333596543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:21.222422447 +0000 UTC m=+70.946602092" watchObservedRunningTime="2026-09-11 05:21:21.223909876 +0000 UTC m=+70.948089522" Sep 11 05:21:21.240455 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.240402 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zjhng" podStartSLOduration=62.974551931 podStartE2EDuration="1m6.240383072s" totalImagesPullingTime="3.265831141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:21.239447957 +0000 UTC m=+70.963627604" watchObservedRunningTime="2026-09-11 05:21:21.240383072 +0000 UTC m=+70.964562718" Sep 11 05:21:21.264475 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:21.264417 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rh6tw" podStartSLOduration=33.981443839 podStartE2EDuration="37.26439634s" totalImagesPullingTime="3.282952501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:21.262575478 +0000 UTC m=+70.986755122" watchObservedRunningTime="2026-09-11 05:21:21.26439634 +0000 UTC m=+70.988575985" Sep 11 05:21:22.207045 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:22.207011 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod330b4cea_2999_4e7b_ba18_21f43639f02b.slice/crio-79f0efe601ec3236b4a134930efae3719093f6bfc8c53491519241191258d59d WatchSource:0}: Error finding container 79f0efe601ec3236b4a134930efae3719093f6bfc8c53491519241191258d59d: Status 404 returned error can't find the container with id 79f0efe601ec3236b4a134930efae3719093f6bfc8c53491519241191258d59d Sep 11 05:21:22.207427 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:22.207324 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0dc5c1d_00db_4fb3_8839_c0a1db0afe4d.slice/crio-8095a58ee5cc8bc43bc04548767bcef827cc0b7e7ad04d3246aa8506601561c9 WatchSource:0}: Error finding container 8095a58ee5cc8bc43bc04548767bcef827cc0b7e7ad04d3246aa8506601561c9: Status 404 returned error can't find the container with id 8095a58ee5cc8bc43bc04548767bcef827cc0b7e7ad04d3246aa8506601561c9 Sep 11 05:21:22.215243 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:22.215216 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" event={"ID":"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d","Type":"ContainerStarted","Data":"8095a58ee5cc8bc43bc04548767bcef827cc0b7e7ad04d3246aa8506601561c9"} Sep 11 05:21:22.216785 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:22.216758 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" event={"ID":"330b4cea-2999-4e7b-ba18-21f43639f02b","Type":"ContainerStarted","Data":"79f0efe601ec3236b4a134930efae3719093f6bfc8c53491519241191258d59d"} Sep 11 05:21:23.223208 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:23.223159 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l5k7k" event={"ID":"00440703-718d-4501-9ff5-1d00f39b4ec3","Type":"ContainerStarted","Data":"e30785fb67ea8073f039055151b01b282aaf4fc3ea39d0d8e37f80921b6ea86f"} Sep 11 05:21:23.238623 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:23.238574 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-l5k7k" podStartSLOduration=66.625806697 podStartE2EDuration="1m12.238555684s" totalImagesPullingTime="5.612748987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:23.23716415 +0000 UTC m=+72.961343794" watchObservedRunningTime="2026-09-11 05:21:23.238555684 +0000 UTC m=+72.962735338" Sep 11 05:21:28.245376 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:28.245341 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" event={"ID":"330b4cea-2999-4e7b-ba18-21f43639f02b","Type":"ContainerStarted","Data":"3e9341e6d5a1b400f76a7f5d1e0cf42648ca0c8c46bcdcdcb6dd1b8cd31e0f0b"} Sep 11 05:21:28.246805 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:28.246784 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" event={"ID":"a0dc5c1d-00db-4fb3-8839-c0a1db0afe4d","Type":"ContainerStarted","Data":"b689f8f239e5eb06d6aeaa24b196d7d0c36970207753a4f84ecb84dd309045fd"} Sep 11 05:21:28.246887 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:28.246827 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:28.248376 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:28.248353 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" Sep 11 05:21:28.259736 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:28.259694 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-dfd7849f4-r6h6z" podStartSLOduration=3.965124948 podStartE2EDuration="9.259679969s" totalImagesPullingTime="5.294555021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:28.259134667 +0000 UTC m=+77.983314313" watchObservedRunningTime="2026-09-11 05:21:28.259679969 +0000 UTC m=+77.983859614" Sep 11 05:21:28.273733 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:28.273689 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f66c54d79-qt5h9" podStartSLOduration=3.9650532910000003 podStartE2EDuration="9.273675077s" totalImagesPullingTime="5.308621786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:28.272958222 +0000 UTC m=+77.997137865" watchObservedRunningTime="2026-09-11 05:21:28.273675077 +0000 UTC m=+77.997854720" Sep 11 05:21:30.501880 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.501842 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gn94f"] Sep 11 05:21:30.505668 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.505649 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.508305 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.508283 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 11 05:21:30.508479 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.508460 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 11 05:21:30.508537 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.508461 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4z67m\"" Sep 11 05:21:30.509157 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.509139 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 11 05:21:30.509210 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.509146 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 11 05:21:30.673485 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673448 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-tls\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.673691 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673499 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-textfile\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.673691 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673534 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zhw8\" (UniqueName: \"kubernetes.io/projected/1d5cdec0-76e5-4a22-b488-e509a63877d6-kube-api-access-5zhw8\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.673691 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673630 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-sys\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.673816 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673699 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.673816 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673723 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.673816 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673763 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-root\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.673816 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673781 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-wtmp\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.673816 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.673800 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d5cdec0-76e5-4a22-b488-e509a63877d6-metrics-client-ca\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775174 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775097 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775174 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775130 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775174 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775148 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-root\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775174 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775164 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-wtmp\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775189 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d5cdec0-76e5-4a22-b488-e509a63877d6-metrics-client-ca\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775232 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-root\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775245 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-tls\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775283 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-textfile\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775305 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-wtmp\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775320 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zhw8\" (UniqueName: \"kubernetes.io/projected/1d5cdec0-76e5-4a22-b488-e509a63877d6-kube-api-access-5zhw8\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775381 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-sys\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775453 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d5cdec0-76e5-4a22-b488-e509a63877d6-sys\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.775897 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775873 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-textfile\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.776004 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775979 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-accelerators-collector-config\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.776064 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.775986 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d5cdec0-76e5-4a22-b488-e509a63877d6-metrics-client-ca\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.777568 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.777530 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-tls\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.777872 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.777856 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d5cdec0-76e5-4a22-b488-e509a63877d6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.791797 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.791772 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zhw8\" (UniqueName: \"kubernetes.io/projected/1d5cdec0-76e5-4a22-b488-e509a63877d6-kube-api-access-5zhw8\") pod \"node-exporter-gn94f\" (UID: \"1d5cdec0-76e5-4a22-b488-e509a63877d6\") " pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.815202 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:30.815174 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gn94f" Sep 11 05:21:30.826660 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:30.826637 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5cdec0_76e5_4a22_b488_e509a63877d6.slice/crio-d77015c5a941b3dded2d73ee819655e83569d602caa59c045bec243556b8e46d WatchSource:0}: Error finding container d77015c5a941b3dded2d73ee819655e83569d602caa59c045bec243556b8e46d: Status 404 returned error can't find the container with id d77015c5a941b3dded2d73ee819655e83569d602caa59c045bec243556b8e46d Sep 11 05:21:31.219115 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:31.219036 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rh6tw" Sep 11 05:21:31.260837 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:31.260802 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn94f" event={"ID":"1d5cdec0-76e5-4a22-b488-e509a63877d6","Type":"ContainerStarted","Data":"d77015c5a941b3dded2d73ee819655e83569d602caa59c045bec243556b8e46d"} Sep 11 05:21:32.266605 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:32.266568 2569 generic.go:356] "Generic (PLEG): container finished" podID="1d5cdec0-76e5-4a22-b488-e509a63877d6" containerID="d0cc30c42f39f3ed17ee8bc3e06c25808b70b877c4627dece3b42daaf63309d1" exitCode=0 Sep 11 05:21:32.266916 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:32.266613 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn94f" event={"ID":"1d5cdec0-76e5-4a22-b488-e509a63877d6","Type":"ContainerDied","Data":"d0cc30c42f39f3ed17ee8bc3e06c25808b70b877c4627dece3b42daaf63309d1"} Sep 11 05:21:33.272268 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:33.272148 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn94f" event={"ID":"1d5cdec0-76e5-4a22-b488-e509a63877d6","Type":"ContainerStarted","Data":"41de7b8a1992470a3248c26c21a9e09432365590b06762e5a4cf650cff9e7aef"} Sep 11 05:21:33.272268 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:33.272200 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gn94f" event={"ID":"1d5cdec0-76e5-4a22-b488-e509a63877d6","Type":"ContainerStarted","Data":"c12862bb85157b99d8360c5c3ba0cb5defa326abcfd39550611107357411dc34"} Sep 11 05:21:33.292359 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:33.292312 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gn94f" podStartSLOduration=1.995159922 podStartE2EDuration="3.292294558s" totalImagesPullingTime="1.237134834s" totalInitContainerRuntime="59.999802ms" isStatefulPod=true podCreationTimestamp="2026-09-11 05:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:33.289985043 +0000 UTC m=+83.014164689" watchObservedRunningTime="2026-09-11 05:21:33.292294558 +0000 UTC m=+83.016474201" Sep 11 05:21:36.821400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:36.821368 2569 patch_prober.go:28] interesting pod/image-registry-8679779578-x7w2s container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 11 05:21:36.821777 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:36.821419 2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8679779578-x7w2s" podUID="d5a02ec5-fc69-40a2-b2c8-2077afe83d97" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 11 05:21:40.204968 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.204937 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:21:40.542292 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.542261 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d85f844fb-qnn4m"] Sep 11 05:21:40.546442 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.546425 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.548610 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.548586 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 11 05:21:40.548702 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.548684 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 11 05:21:40.548773 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.548727 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 11 05:21:40.548894 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.548875 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 11 05:21:40.548958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.548876 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 11 05:21:40.548958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.548940 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6lz56\"" Sep 11 05:21:40.549584 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.549568 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 11 05:21:40.549803 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.549787 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 11 05:21:40.553638 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.553377 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 11 05:21:40.555743 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.555718 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d85f844fb-qnn4m"] Sep 11 05:21:40.560191 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.560164 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-console-config\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.560281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.560209 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-service-ca\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.560281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.560240 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-oauth-config\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.560281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.560268 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prnx5\" (UniqueName: \"kubernetes.io/projected/48990830-9997-43c4-b7eb-746f5f979c81-kube-api-access-prnx5\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.560422 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.560308 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-serving-cert\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.560422 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.560330 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-oauth-serving-cert\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.560422 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.560375 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-trusted-ca-bundle\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.661468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.661435 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-console-config\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.661652 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.661475 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-service-ca\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.661652 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.661501 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-oauth-config\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.661652 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.661524 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prnx5\" (UniqueName: \"kubernetes.io/projected/48990830-9997-43c4-b7eb-746f5f979c81-kube-api-access-prnx5\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.661652 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.661634 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-serving-cert\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.661862 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.661664 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-oauth-serving-cert\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.661862 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.661722 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-trusted-ca-bundle\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.662258 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.662230 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-console-config\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.662382 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.662231 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-service-ca\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.662382 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.662344 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-oauth-serving-cert\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.662561 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.662528 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-trusted-ca-bundle\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.663938 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.663914 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-oauth-config\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.664018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.663979 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-serving-cert\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.669140 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.669118 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prnx5\" (UniqueName: \"kubernetes.io/projected/48990830-9997-43c4-b7eb-746f5f979c81-kube-api-access-prnx5\") pod \"console-6d85f844fb-qnn4m\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:40.857421 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:40.857341 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:41.128225 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:41.128199 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d85f844fb-qnn4m"] Sep 11 05:21:41.130384 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:21:41.130357 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48990830_9997_43c4_b7eb_746f5f979c81.slice/crio-9b57e3a0331fbba8028eb2e9591274e8b3437180d9578bb7ffe1dbff5ca4940c WatchSource:0}: Error finding container 9b57e3a0331fbba8028eb2e9591274e8b3437180d9578bb7ffe1dbff5ca4940c: Status 404 returned error can't find the container with id 9b57e3a0331fbba8028eb2e9591274e8b3437180d9578bb7ffe1dbff5ca4940c Sep 11 05:21:41.303634 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:41.303592 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d85f844fb-qnn4m" event={"ID":"48990830-9997-43c4-b7eb-746f5f979c81","Type":"ContainerStarted","Data":"9b57e3a0331fbba8028eb2e9591274e8b3437180d9578bb7ffe1dbff5ca4940c"} Sep 11 05:21:43.678597 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:43.678551 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8679779578-x7w2s"] Sep 11 05:21:44.318805 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:44.318763 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d85f844fb-qnn4m" event={"ID":"48990830-9997-43c4-b7eb-746f5f979c81","Type":"ContainerStarted","Data":"24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215"} Sep 11 05:21:44.336647 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:44.336601 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d85f844fb-qnn4m" podStartSLOduration=1.63418519 podStartE2EDuration="4.336587345s" totalImagesPullingTime="2.702402155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:21:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:21:44.335509427 +0000 UTC m=+94.059689074" watchObservedRunningTime="2026-09-11 05:21:44.336587345 +0000 UTC m=+94.060766985" Sep 11 05:21:48.191004 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:48.190974 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vcbgt" Sep 11 05:21:50.857494 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:50.857458 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:50.857971 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:50.857519 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:50.863236 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:50.863209 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:21:51.348966 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:21:51.348941 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:22:05.399349 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:05.399258 2569 generic.go:356] "Generic (PLEG): container finished" podID="70c2394a-6f61-412b-ab38-08390abfa53e" containerID="ce8df17d380f42bc1510b656ee613fc15ed8a78b6bac318e943e957236843a95" exitCode=0 Sep 11 05:22:05.399349 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:05.399326 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" event={"ID":"70c2394a-6f61-412b-ab38-08390abfa53e","Type":"ContainerDied","Data":"ce8df17d380f42bc1510b656ee613fc15ed8a78b6bac318e943e957236843a95"} Sep 11 05:22:05.399793 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:05.399654 2569 scope.go:117] "RemoveContainer" containerID="ce8df17d380f42bc1510b656ee613fc15ed8a78b6bac318e943e957236843a95" Sep 11 05:22:06.404346 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:06.404308 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-rb5cf" event={"ID":"70c2394a-6f61-412b-ab38-08390abfa53e","Type":"ContainerStarted","Data":"3bc563108c7b7f251a600db73decc16c30f671fdcc8a27eb7b2eb627d9fa74cf"} Sep 11 05:22:08.700181 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.700134 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8679779578-x7w2s" podUID="d5a02ec5-fc69-40a2-b2c8-2077afe83d97" containerName="registry" containerID="cri-o://3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac" gracePeriod=30 Sep 11 05:22:08.935966 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.935942 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:22:08.984018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.983996 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-image-registry-private-configuration\") pod \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " Sep 11 05:22:08.984146 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.984028 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-installation-pull-secrets\") pod \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " Sep 11 05:22:08.984146 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.984071 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-certificates\") pod \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " Sep 11 05:22:08.984146 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.984096 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgrnx\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-kube-api-access-sgrnx\") pod \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " Sep 11 05:22:08.984303 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.984146 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-bound-sa-token\") pod \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " Sep 11 05:22:08.984303 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.984176 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-ca-trust-extracted\") pod \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " Sep 11 05:22:08.984303 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.984207 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") pod \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " Sep 11 05:22:08.984303 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.984253 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-trusted-ca\") pod \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\" (UID: \"d5a02ec5-fc69-40a2-b2c8-2077afe83d97\") " Sep 11 05:22:08.986186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.984949 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d5a02ec5-fc69-40a2-b2c8-2077afe83d97" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:22:08.986186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.985045 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d5a02ec5-fc69-40a2-b2c8-2077afe83d97" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:22:08.986900 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.986855 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d5a02ec5-fc69-40a2-b2c8-2077afe83d97" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:22:08.987090 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.987064 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d5a02ec5-fc69-40a2-b2c8-2077afe83d97" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:22:08.987861 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.987839 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d5a02ec5-fc69-40a2-b2c8-2077afe83d97" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:22:08.988112 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.988092 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d5a02ec5-fc69-40a2-b2c8-2077afe83d97" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:22:08.988394 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.988366 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-kube-api-access-sgrnx" (OuterVolumeSpecName: "kube-api-access-sgrnx") pod "d5a02ec5-fc69-40a2-b2c8-2077afe83d97" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97"). InnerVolumeSpecName "kube-api-access-sgrnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:22:08.994935 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:08.994910 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d5a02ec5-fc69-40a2-b2c8-2077afe83d97" (UID: "d5a02ec5-fc69-40a2-b2c8-2077afe83d97"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 05:22:09.085056 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.085020 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-trusted-ca\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:22:09.085056 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.085056 2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-image-registry-private-configuration\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:22:09.085205 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.085073 2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-installation-pull-secrets\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:22:09.085205 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.085087 2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-certificates\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:22:09.085205 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.085101 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgrnx\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-kube-api-access-sgrnx\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:22:09.085205 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.085113 2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-bound-sa-token\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:22:09.085205 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.085126 2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-ca-trust-extracted\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:22:09.085205 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.085139 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5a02ec5-fc69-40a2-b2c8-2077afe83d97-registry-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:22:09.417462 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.417384 2569 generic.go:356] "Generic (PLEG): container finished" podID="d5a02ec5-fc69-40a2-b2c8-2077afe83d97" containerID="3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac" exitCode=0 Sep 11 05:22:09.417462 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.417427 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8679779578-x7w2s" Sep 11 05:22:09.417660 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.417464 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8679779578-x7w2s" event={"ID":"d5a02ec5-fc69-40a2-b2c8-2077afe83d97","Type":"ContainerDied","Data":"3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac"} Sep 11 05:22:09.417660 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.417513 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8679779578-x7w2s" event={"ID":"d5a02ec5-fc69-40a2-b2c8-2077afe83d97","Type":"ContainerDied","Data":"930335cae1a63476d90d5543f35dc7c33316e23beda944eda6443f055467c4d3"} Sep 11 05:22:09.417660 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.417534 2569 scope.go:117] "RemoveContainer" containerID="3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac" Sep 11 05:22:09.426120 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.426102 2569 scope.go:117] "RemoveContainer" containerID="3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac" Sep 11 05:22:09.426378 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:22:09.426360 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac\": container with ID starting with 3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac not found: ID does not exist" containerID="3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac" Sep 11 05:22:09.426444 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.426390 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac"} err="failed to get container status \"3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac\": rpc error: code = NotFound desc = could not find container \"3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac\": container with ID starting with 3356f8710652a70cd2cb1e56cbf9645968d6a2603a971f9074d4fe3c6c0b9bac not found: ID does not exist" Sep 11 05:22:09.436898 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.436875 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8679779578-x7w2s"] Sep 11 05:22:09.440978 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:09.440960 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8679779578-x7w2s"] Sep 11 05:22:10.762625 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:10.762595 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5a02ec5-fc69-40a2-b2c8-2077afe83d97" path="/var/lib/kubelet/pods/d5a02ec5-fc69-40a2-b2c8-2077afe83d97/volumes" Sep 11 05:22:20.463926 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:20.463854 2569 generic.go:356] "Generic (PLEG): container finished" podID="4dea7e44-25b3-4c8b-8f36-80ddf7026505" containerID="fe370201947b835d69edf5b7a4099e8ae42736eff6795b025ba1ff3e8bd0e786" exitCode=0 Sep 11 05:22:20.464257 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:20.463929 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" event={"ID":"4dea7e44-25b3-4c8b-8f36-80ddf7026505","Type":"ContainerDied","Data":"fe370201947b835d69edf5b7a4099e8ae42736eff6795b025ba1ff3e8bd0e786"} Sep 11 05:22:20.464257 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:20.464204 2569 scope.go:117] "RemoveContainer" containerID="fe370201947b835d69edf5b7a4099e8ae42736eff6795b025ba1ff3e8bd0e786" Sep 11 05:22:21.469398 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:21.469361 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-dwtwv" event={"ID":"4dea7e44-25b3-4c8b-8f36-80ddf7026505","Type":"ContainerStarted","Data":"6575d8650dd896e8905563755173e4d9da6f2cd71ee900dad3330ad7c40f6aed"} Sep 11 05:22:25.488126 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:25.488092 2569 generic.go:356] "Generic (PLEG): container finished" podID="fc957ed2-08b1-4e47-a8fb-e7cf25902179" containerID="8d15bc9a67316371f180a24ba322b572265a73580a6c75f94bae225bf03dd66e" exitCode=0 Sep 11 05:22:25.488506 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:25.488163 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-v6wtq" event={"ID":"fc957ed2-08b1-4e47-a8fb-e7cf25902179","Type":"ContainerDied","Data":"8d15bc9a67316371f180a24ba322b572265a73580a6c75f94bae225bf03dd66e"} Sep 11 05:22:25.488506 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:25.488497 2569 scope.go:117] "RemoveContainer" containerID="8d15bc9a67316371f180a24ba322b572265a73580a6c75f94bae225bf03dd66e" Sep 11 05:22:26.494712 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:26.494670 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-v6wtq" event={"ID":"fc957ed2-08b1-4e47-a8fb-e7cf25902179","Type":"ContainerStarted","Data":"d5df7eea528fbd1676553c75598d4dd01e316da2d00ce9e70a78c995532f61a0"} Sep 11 05:22:58.268847 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.268813 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78f95d767-8g7ws"] Sep 11 05:22:58.269281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.269083 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a02ec5-fc69-40a2-b2c8-2077afe83d97" containerName="registry" Sep 11 05:22:58.269281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.269095 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a02ec5-fc69-40a2-b2c8-2077afe83d97" containerName="registry" Sep 11 05:22:58.269281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.269144 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5a02ec5-fc69-40a2-b2c8-2077afe83d97" containerName="registry" Sep 11 05:22:58.273694 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.273670 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.285305 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.285278 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f95d767-8g7ws"] Sep 11 05:22:58.359290 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.359259 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-service-ca\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.359436 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.359297 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-oauth-serving-cert\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.359436 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.359335 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-config\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.359436 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.359377 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-oauth-config\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.359589 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.359459 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-serving-cert\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.359589 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.359488 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-trusted-ca-bundle\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.359589 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.359508 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj5nq\" (UniqueName: \"kubernetes.io/projected/e3463ac7-fd1c-48b4-b557-4d5a466356e7-kube-api-access-bj5nq\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.460643 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.460612 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-config\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.460783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.460651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-oauth-config\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.460783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.460697 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-serving-cert\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.460783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.460726 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-trusted-ca-bundle\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.460783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.460753 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj5nq\" (UniqueName: \"kubernetes.io/projected/e3463ac7-fd1c-48b4-b557-4d5a466356e7-kube-api-access-bj5nq\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.460975 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.460933 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-service-ca\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.460975 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.460969 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-oauth-serving-cert\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.461485 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.461460 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-config\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.461696 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.461674 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-oauth-serving-cert\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.466794 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.462010 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-service-ca\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.466794 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.463239 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-trusted-ca-bundle\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.466794 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.463661 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-oauth-config\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.467417 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.467399 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-serving-cert\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.473615 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.473589 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj5nq\" (UniqueName: \"kubernetes.io/projected/e3463ac7-fd1c-48b4-b557-4d5a466356e7-kube-api-access-bj5nq\") pod \"console-78f95d767-8g7ws\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.584790 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.584718 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:22:58.860137 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:58.860111 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78f95d767-8g7ws"] Sep 11 05:22:58.862686 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:22:58.862661 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3463ac7_fd1c_48b4_b557_4d5a466356e7.slice/crio-2d1fb7d349eeee71a8f4b4de5a57bad710e601ec3c77a7b62340df492cfdc05e WatchSource:0}: Error finding container 2d1fb7d349eeee71a8f4b4de5a57bad710e601ec3c77a7b62340df492cfdc05e: Status 404 returned error can't find the container with id 2d1fb7d349eeee71a8f4b4de5a57bad710e601ec3c77a7b62340df492cfdc05e Sep 11 05:22:59.625501 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:59.625468 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f95d767-8g7ws" event={"ID":"e3463ac7-fd1c-48b4-b557-4d5a466356e7","Type":"ContainerStarted","Data":"6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8"} Sep 11 05:22:59.625848 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:59.625517 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f95d767-8g7ws" event={"ID":"e3463ac7-fd1c-48b4-b557-4d5a466356e7","Type":"ContainerStarted","Data":"2d1fb7d349eeee71a8f4b4de5a57bad710e601ec3c77a7b62340df492cfdc05e"} Sep 11 05:22:59.642537 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:22:59.642495 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78f95d767-8g7ws" podStartSLOduration=1.642481498 podStartE2EDuration="1.642481498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:22:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:22:59.641326596 +0000 UTC m=+169.365506240" watchObservedRunningTime="2026-09-11 05:22:59.642481498 +0000 UTC m=+169.366661140" Sep 11 05:23:08.585480 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:08.585400 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:23:08.585480 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:08.585456 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:23:08.589901 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:08.589883 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:23:08.663555 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:08.663528 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:23:08.706144 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:08.706115 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d85f844fb-qnn4m"] Sep 11 05:23:33.728559 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:33.728506 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d85f844fb-qnn4m" podUID="48990830-9997-43c4-b7eb-746f5f979c81" containerName="console" containerID="cri-o://24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215" gracePeriod=15 Sep 11 05:23:33.969783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:33.969761 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:23:34.137220 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137192 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-trusted-ca-bundle\") pod \"48990830-9997-43c4-b7eb-746f5f979c81\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " Sep 11 05:23:34.137393 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137238 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-oauth-serving-cert\") pod \"48990830-9997-43c4-b7eb-746f5f979c81\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " Sep 11 05:23:34.137393 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137271 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-service-ca\") pod \"48990830-9997-43c4-b7eb-746f5f979c81\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " Sep 11 05:23:34.137513 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137432 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-oauth-config\") pod \"48990830-9997-43c4-b7eb-746f5f979c81\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " Sep 11 05:23:34.137513 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137498 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-serving-cert\") pod \"48990830-9997-43c4-b7eb-746f5f979c81\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " Sep 11 05:23:34.137655 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137533 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-console-config\") pod \"48990830-9997-43c4-b7eb-746f5f979c81\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " Sep 11 05:23:34.137655 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137590 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prnx5\" (UniqueName: \"kubernetes.io/projected/48990830-9997-43c4-b7eb-746f5f979c81-kube-api-access-prnx5\") pod \"48990830-9997-43c4-b7eb-746f5f979c81\" (UID: \"48990830-9997-43c4-b7eb-746f5f979c81\") " Sep 11 05:23:34.137655 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137621 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "48990830-9997-43c4-b7eb-746f5f979c81" (UID: "48990830-9997-43c4-b7eb-746f5f979c81"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:23:34.137794 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137657 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-service-ca" (OuterVolumeSpecName: "service-ca") pod "48990830-9997-43c4-b7eb-746f5f979c81" (UID: "48990830-9997-43c4-b7eb-746f5f979c81"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:23:34.137794 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137685 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "48990830-9997-43c4-b7eb-746f5f979c81" (UID: "48990830-9997-43c4-b7eb-746f5f979c81"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:23:34.137970 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137950 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-trusted-ca-bundle\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:23:34.138035 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137974 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-oauth-serving-cert\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:23:34.138035 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.137990 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-service-ca\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:23:34.138135 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.138038 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-console-config" (OuterVolumeSpecName: "console-config") pod "48990830-9997-43c4-b7eb-746f5f979c81" (UID: "48990830-9997-43c4-b7eb-746f5f979c81"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:23:34.139952 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.139924 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48990830-9997-43c4-b7eb-746f5f979c81-kube-api-access-prnx5" (OuterVolumeSpecName: "kube-api-access-prnx5") pod "48990830-9997-43c4-b7eb-746f5f979c81" (UID: "48990830-9997-43c4-b7eb-746f5f979c81"). InnerVolumeSpecName "kube-api-access-prnx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:23:34.140075 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.139923 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "48990830-9997-43c4-b7eb-746f5f979c81" (UID: "48990830-9997-43c4-b7eb-746f5f979c81"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:23:34.140075 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.139999 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "48990830-9997-43c4-b7eb-746f5f979c81" (UID: "48990830-9997-43c4-b7eb-746f5f979c81"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:23:34.238694 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.238662 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-oauth-config\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:23:34.238694 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.238689 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/48990830-9997-43c4-b7eb-746f5f979c81-console-serving-cert\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:23:34.238878 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.238703 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/48990830-9997-43c4-b7eb-746f5f979c81-console-config\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:23:34.238878 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.238717 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prnx5\" (UniqueName: \"kubernetes.io/projected/48990830-9997-43c4-b7eb-746f5f979c81-kube-api-access-prnx5\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:23:34.756750 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.756713 2569 generic.go:356] "Generic (PLEG): container finished" podID="48990830-9997-43c4-b7eb-746f5f979c81" containerID="24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215" exitCode=0 Sep 11 05:23:34.757136 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.756756 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d85f844fb-qnn4m" Sep 11 05:23:34.757136 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.756794 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d85f844fb-qnn4m" event={"ID":"48990830-9997-43c4-b7eb-746f5f979c81","Type":"ContainerDied","Data":"24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215"} Sep 11 05:23:34.757136 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.756928 2569 scope.go:117] "RemoveContainer" containerID="24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215" Sep 11 05:23:34.762532 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.762508 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d85f844fb-qnn4m" event={"ID":"48990830-9997-43c4-b7eb-746f5f979c81","Type":"ContainerDied","Data":"9b57e3a0331fbba8028eb2e9591274e8b3437180d9578bb7ffe1dbff5ca4940c"} Sep 11 05:23:34.766657 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.766583 2569 scope.go:117] "RemoveContainer" containerID="24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215" Sep 11 05:23:34.766949 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:23:34.766922 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215\": container with ID starting with 24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215 not found: ID does not exist" containerID="24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215" Sep 11 05:23:34.767035 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.766961 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215"} err="failed to get container status \"24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215\": rpc error: code = NotFound desc = could not find container \"24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215\": container with ID starting with 24f104c90ba6411735974776e43ca95fd0d32ebb793ff5a843467a06c7752215 not found: ID does not exist" Sep 11 05:23:34.779067 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.779042 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d85f844fb-qnn4m"] Sep 11 05:23:34.784276 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:34.784258 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d85f844fb-qnn4m"] Sep 11 05:23:36.761888 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:23:36.761856 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48990830-9997-43c4-b7eb-746f5f979c81" path="/var/lib/kubelet/pods/48990830-9997-43c4-b7eb-746f5f979c81/volumes" Sep 11 05:24:12.993051 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:12.993021 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6885869465-lwcwb"] Sep 11 05:24:12.993453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:12.993309 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48990830-9997-43c4-b7eb-746f5f979c81" containerName="console" Sep 11 05:24:12.993453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:12.993320 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="48990830-9997-43c4-b7eb-746f5f979c81" containerName="console" Sep 11 05:24:12.993453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:12.993379 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="48990830-9997-43c4-b7eb-746f5f979c81" containerName="console" Sep 11 05:24:12.997482 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:12.997454 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.000968 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.000943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-service-ca\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.001081 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.000981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-trusted-ca-bundle\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.001081 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.001064 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwt8g\" (UniqueName: \"kubernetes.io/projected/c6ab7466-62bb-449f-bfc6-a8950500ff68-kube-api-access-cwt8g\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.001185 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.001121 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-oauth-config\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.001240 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.001196 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-oauth-serving-cert\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.001292 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.001246 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-serving-cert\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.001292 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.001273 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-config\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.011682 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.011658 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6885869465-lwcwb"] Sep 11 05:24:13.101977 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.101944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-service-ca\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.101988 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-trusted-ca-bundle\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.102026 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwt8g\" (UniqueName: \"kubernetes.io/projected/c6ab7466-62bb-449f-bfc6-a8950500ff68-kube-api-access-cwt8g\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.102058 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-oauth-config\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.102091 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-oauth-serving-cert\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.102122 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-serving-cert\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.102147 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-config\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102710 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.102681 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-service-ca\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102874 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.102816 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-oauth-serving-cert\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.102962 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.102894 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-trusted-ca-bundle\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.103018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.103002 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-config\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.104714 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.104695 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-serving-cert\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.104805 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.104717 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-oauth-config\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.109172 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.109151 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwt8g\" (UniqueName: \"kubernetes.io/projected/c6ab7466-62bb-449f-bfc6-a8950500ff68-kube-api-access-cwt8g\") pod \"console-6885869465-lwcwb\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.307879 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.307804 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:13.581268 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.581244 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6885869465-lwcwb"] Sep 11 05:24:13.583912 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:24:13.583875 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ab7466_62bb_449f_bfc6_a8950500ff68.slice/crio-bf82a8aeb84c8bab04e966f5ae5e57a8cbab7ec2142fb733d42ca1ccd89994ec WatchSource:0}: Error finding container bf82a8aeb84c8bab04e966f5ae5e57a8cbab7ec2142fb733d42ca1ccd89994ec: Status 404 returned error can't find the container with id bf82a8aeb84c8bab04e966f5ae5e57a8cbab7ec2142fb733d42ca1ccd89994ec Sep 11 05:24:13.898662 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.898572 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6885869465-lwcwb" event={"ID":"c6ab7466-62bb-449f-bfc6-a8950500ff68","Type":"ContainerStarted","Data":"847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f"} Sep 11 05:24:13.898662 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.898629 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6885869465-lwcwb" event={"ID":"c6ab7466-62bb-449f-bfc6-a8950500ff68","Type":"ContainerStarted","Data":"bf82a8aeb84c8bab04e966f5ae5e57a8cbab7ec2142fb733d42ca1ccd89994ec"} Sep 11 05:24:13.915449 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:13.915402 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6885869465-lwcwb" podStartSLOduration=1.915385388 podStartE2EDuration="1.915385388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:24:13.913494613 +0000 UTC m=+243.637674257" watchObservedRunningTime="2026-09-11 05:24:13.915385388 +0000 UTC m=+243.639565031" Sep 11 05:24:23.308582 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:23.308529 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:23.309074 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:23.308610 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:23.313148 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:23.313127 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:23.938373 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:23.938341 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:24:23.982961 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:23.982931 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f95d767-8g7ws"] Sep 11 05:24:49.004890 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.004795 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78f95d767-8g7ws" podUID="e3463ac7-fd1c-48b4-b557-4d5a466356e7" containerName="console" containerID="cri-o://6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8" gracePeriod=15 Sep 11 05:24:49.249910 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.249886 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:24:49.363202 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363134 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-serving-cert\") pod \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " Sep 11 05:24:49.363202 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363175 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-config\") pod \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " Sep 11 05:24:49.363202 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363193 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-trusted-ca-bundle\") pod \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " Sep 11 05:24:49.363435 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363252 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-oauth-config\") pod \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " Sep 11 05:24:49.363435 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363271 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj5nq\" (UniqueName: \"kubernetes.io/projected/e3463ac7-fd1c-48b4-b557-4d5a466356e7-kube-api-access-bj5nq\") pod \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " Sep 11 05:24:49.363435 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363336 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-oauth-serving-cert\") pod \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " Sep 11 05:24:49.363435 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363364 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-service-ca\") pod \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\" (UID: \"e3463ac7-fd1c-48b4-b557-4d5a466356e7\") " Sep 11 05:24:49.363655 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363600 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-config" (OuterVolumeSpecName: "console-config") pod "e3463ac7-fd1c-48b4-b557-4d5a466356e7" (UID: "e3463ac7-fd1c-48b4-b557-4d5a466356e7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:24:49.363776 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363744 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e3463ac7-fd1c-48b4-b557-4d5a466356e7" (UID: "e3463ac7-fd1c-48b4-b557-4d5a466356e7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:24:49.363776 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363761 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e3463ac7-fd1c-48b4-b557-4d5a466356e7" (UID: "e3463ac7-fd1c-48b4-b557-4d5a466356e7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:24:49.363871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.363843 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-service-ca" (OuterVolumeSpecName: "service-ca") pod "e3463ac7-fd1c-48b4-b557-4d5a466356e7" (UID: "e3463ac7-fd1c-48b4-b557-4d5a466356e7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:24:49.365381 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.365359 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e3463ac7-fd1c-48b4-b557-4d5a466356e7" (UID: "e3463ac7-fd1c-48b4-b557-4d5a466356e7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:24:49.365468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.365411 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e3463ac7-fd1c-48b4-b557-4d5a466356e7" (UID: "e3463ac7-fd1c-48b4-b557-4d5a466356e7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:24:49.365512 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.365488 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3463ac7-fd1c-48b4-b557-4d5a466356e7-kube-api-access-bj5nq" (OuterVolumeSpecName: "kube-api-access-bj5nq") pod "e3463ac7-fd1c-48b4-b557-4d5a466356e7" (UID: "e3463ac7-fd1c-48b4-b557-4d5a466356e7"). InnerVolumeSpecName "kube-api-access-bj5nq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:24:49.464175 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.464149 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-oauth-serving-cert\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:24:49.464175 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.464173 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-service-ca\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:24:49.464319 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.464183 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-serving-cert\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:24:49.464319 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.464192 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-config\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:24:49.464319 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.464200 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3463ac7-fd1c-48b4-b557-4d5a466356e7-trusted-ca-bundle\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:24:49.464319 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.464209 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e3463ac7-fd1c-48b4-b557-4d5a466356e7-console-oauth-config\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:24:49.464319 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:49.464217 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj5nq\" (UniqueName: \"kubernetes.io/projected/e3463ac7-fd1c-48b4-b557-4d5a466356e7-kube-api-access-bj5nq\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:24:50.030002 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.029969 2569 generic.go:356] "Generic (PLEG): container finished" podID="e3463ac7-fd1c-48b4-b557-4d5a466356e7" containerID="6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8" exitCode=0 Sep 11 05:24:50.030400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.030008 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78f95d767-8g7ws" Sep 11 05:24:50.030400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.030054 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f95d767-8g7ws" event={"ID":"e3463ac7-fd1c-48b4-b557-4d5a466356e7","Type":"ContainerDied","Data":"6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8"} Sep 11 05:24:50.030400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.030102 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78f95d767-8g7ws" event={"ID":"e3463ac7-fd1c-48b4-b557-4d5a466356e7","Type":"ContainerDied","Data":"2d1fb7d349eeee71a8f4b4de5a57bad710e601ec3c77a7b62340df492cfdc05e"} Sep 11 05:24:50.030400 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.030122 2569 scope.go:117] "RemoveContainer" containerID="6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8" Sep 11 05:24:50.039244 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.039227 2569 scope.go:117] "RemoveContainer" containerID="6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8" Sep 11 05:24:50.039483 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:24:50.039463 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8\": container with ID starting with 6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8 not found: ID does not exist" containerID="6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8" Sep 11 05:24:50.039528 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.039491 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8"} err="failed to get container status \"6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8\": rpc error: code = NotFound desc = could not find container \"6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8\": container with ID starting with 6158534bdbe4d70de662c67e0f5a5b4e12bfce3adeec97410af7371288571fc8 not found: ID does not exist" Sep 11 05:24:50.050622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.050590 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78f95d767-8g7ws"] Sep 11 05:24:50.055048 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.055026 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78f95d767-8g7ws"] Sep 11 05:24:50.762391 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:24:50.762357 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3463ac7-fd1c-48b4-b557-4d5a466356e7" path="/var/lib/kubelet/pods/e3463ac7-fd1c-48b4-b557-4d5a466356e7/volumes" Sep 11 05:25:10.693762 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:25:10.693729 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:25:10.699207 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:25:10.699185 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:25:10.704082 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:25:10.704056 2569 kubelet.go:1648] "Image garbage collection succeeded" Sep 11 05:26:29.432430 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.432343 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85d959b7c9-7mhsk"] Sep 11 05:26:29.432942 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.432624 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3463ac7-fd1c-48b4-b557-4d5a466356e7" containerName="console" Sep 11 05:26:29.432942 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.432636 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3463ac7-fd1c-48b4-b557-4d5a466356e7" containerName="console" Sep 11 05:26:29.432942 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.432693 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3463ac7-fd1c-48b4-b557-4d5a466356e7" containerName="console" Sep 11 05:26:29.435692 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.435661 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.448680 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.448651 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d959b7c9-7mhsk"] Sep 11 05:26:29.585751 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.585721 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-oauth-config\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.585751 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.585752 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-service-ca\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.585991 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.585770 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-trusted-ca-bundle\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.585991 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.585823 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5kkf\" (UniqueName: \"kubernetes.io/projected/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-kube-api-access-v5kkf\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.585991 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.585888 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-config\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.585991 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.585962 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-serving-cert\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.585991 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.585988 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-oauth-serving-cert\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.687902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.687241 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-oauth-config\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.687902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.687319 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-service-ca\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.687902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.687348 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-trusted-ca-bundle\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.687902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.687395 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5kkf\" (UniqueName: \"kubernetes.io/projected/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-kube-api-access-v5kkf\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.687902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.687444 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-config\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.687902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.687529 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-serving-cert\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.687902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.687571 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-oauth-serving-cert\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.688501 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.688460 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-oauth-serving-cert\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.688672 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.688648 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-config\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.688822 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.688793 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-service-ca\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.689209 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.689188 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-trusted-ca-bundle\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.693785 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.693759 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-serving-cert\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.694031 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.694011 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-console-oauth-config\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.695708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.695687 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5kkf\" (UniqueName: \"kubernetes.io/projected/b2fc11eb-7adf-4daf-89f0-b51f0e071d2e-kube-api-access-v5kkf\") pod \"console-85d959b7c9-7mhsk\" (UID: \"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e\") " pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:29.745689 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:29.745653 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:30.018190 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:30.018164 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85d959b7c9-7mhsk"] Sep 11 05:26:30.020749 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:26:30.020722 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2fc11eb_7adf_4daf_89f0_b51f0e071d2e.slice/crio-6316efea607bcd8aedd0d9fb62cc41fa9ab0d42d544abaa281cb13a3d52b9776 WatchSource:0}: Error finding container 6316efea607bcd8aedd0d9fb62cc41fa9ab0d42d544abaa281cb13a3d52b9776: Status 404 returned error can't find the container with id 6316efea607bcd8aedd0d9fb62cc41fa9ab0d42d544abaa281cb13a3d52b9776 Sep 11 05:26:30.404813 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:30.404725 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d959b7c9-7mhsk" event={"ID":"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e","Type":"ContainerStarted","Data":"5ac931298307ff74d02f48196e2eb433400abbf4aadd3829789b5e46c4c1b0ae"} Sep 11 05:26:30.404813 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:30.404772 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85d959b7c9-7mhsk" event={"ID":"b2fc11eb-7adf-4daf-89f0-b51f0e071d2e","Type":"ContainerStarted","Data":"6316efea607bcd8aedd0d9fb62cc41fa9ab0d42d544abaa281cb13a3d52b9776"} Sep 11 05:26:30.422926 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:30.422880 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85d959b7c9-7mhsk" podStartSLOduration=1.4228654459999999 podStartE2EDuration="1.422865446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:26:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:26:30.421744635 +0000 UTC m=+380.145924280" watchObservedRunningTime="2026-09-11 05:26:30.422865446 +0000 UTC m=+380.147045116" Sep 11 05:26:39.746323 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:39.746287 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:39.746771 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:39.746622 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:39.751404 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:39.751381 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:40.444968 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:40.444942 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85d959b7c9-7mhsk" Sep 11 05:26:40.491709 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:26:40.491679 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6885869465-lwcwb"] Sep 11 05:27:05.511820 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.511780 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6885869465-lwcwb" podUID="c6ab7466-62bb-449f-bfc6-a8950500ff68" containerName="console" containerID="cri-o://847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f" gracePeriod=15 Sep 11 05:27:05.749757 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.749734 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:27:05.853753 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.853661 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-service-ca\") pod \"c6ab7466-62bb-449f-bfc6-a8950500ff68\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " Sep 11 05:27:05.853753 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.853704 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-oauth-config\") pod \"c6ab7466-62bb-449f-bfc6-a8950500ff68\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " Sep 11 05:27:05.853753 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.853730 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwt8g\" (UniqueName: \"kubernetes.io/projected/c6ab7466-62bb-449f-bfc6-a8950500ff68-kube-api-access-cwt8g\") pod \"c6ab7466-62bb-449f-bfc6-a8950500ff68\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " Sep 11 05:27:05.853753 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.853751 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-config\") pod \"c6ab7466-62bb-449f-bfc6-a8950500ff68\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " Sep 11 05:27:05.854064 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.853880 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-oauth-serving-cert\") pod \"c6ab7466-62bb-449f-bfc6-a8950500ff68\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " Sep 11 05:27:05.854064 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.853923 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-serving-cert\") pod \"c6ab7466-62bb-449f-bfc6-a8950500ff68\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " Sep 11 05:27:05.854064 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.853954 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-trusted-ca-bundle\") pod \"c6ab7466-62bb-449f-bfc6-a8950500ff68\" (UID: \"c6ab7466-62bb-449f-bfc6-a8950500ff68\") " Sep 11 05:27:05.854204 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.854188 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-config" (OuterVolumeSpecName: "console-config") pod "c6ab7466-62bb-449f-bfc6-a8950500ff68" (UID: "c6ab7466-62bb-449f-bfc6-a8950500ff68"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:27:05.854265 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.854195 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-service-ca" (OuterVolumeSpecName: "service-ca") pod "c6ab7466-62bb-449f-bfc6-a8950500ff68" (UID: "c6ab7466-62bb-449f-bfc6-a8950500ff68"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:27:05.854265 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.854237 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c6ab7466-62bb-449f-bfc6-a8950500ff68" (UID: "c6ab7466-62bb-449f-bfc6-a8950500ff68"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:27:05.854488 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.854465 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c6ab7466-62bb-449f-bfc6-a8950500ff68" (UID: "c6ab7466-62bb-449f-bfc6-a8950500ff68"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:27:05.855919 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.855897 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c6ab7466-62bb-449f-bfc6-a8950500ff68" (UID: "c6ab7466-62bb-449f-bfc6-a8950500ff68"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:27:05.855973 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.855944 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c6ab7466-62bb-449f-bfc6-a8950500ff68" (UID: "c6ab7466-62bb-449f-bfc6-a8950500ff68"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:27:05.856008 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.855987 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6ab7466-62bb-449f-bfc6-a8950500ff68-kube-api-access-cwt8g" (OuterVolumeSpecName: "kube-api-access-cwt8g") pod "c6ab7466-62bb-449f-bfc6-a8950500ff68" (UID: "c6ab7466-62bb-449f-bfc6-a8950500ff68"). InnerVolumeSpecName "kube-api-access-cwt8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:27:05.955264 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.955233 2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-service-ca\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:27:05.955264 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.955259 2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-oauth-config\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:27:05.955264 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.955269 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwt8g\" (UniqueName: \"kubernetes.io/projected/c6ab7466-62bb-449f-bfc6-a8950500ff68-kube-api-access-cwt8g\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:27:05.955470 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.955278 2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-config\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:27:05.955470 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.955287 2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-oauth-serving-cert\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:27:05.955470 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.955295 2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c6ab7466-62bb-449f-bfc6-a8950500ff68-console-serving-cert\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:27:05.955470 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:05.955303 2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6ab7466-62bb-449f-bfc6-a8950500ff68-trusted-ca-bundle\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:27:06.541792 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.541759 2569 generic.go:356] "Generic (PLEG): container finished" podID="c6ab7466-62bb-449f-bfc6-a8950500ff68" containerID="847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f" exitCode=0 Sep 11 05:27:06.542177 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.541804 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6885869465-lwcwb" Sep 11 05:27:06.542177 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.541838 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6885869465-lwcwb" event={"ID":"c6ab7466-62bb-449f-bfc6-a8950500ff68","Type":"ContainerDied","Data":"847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f"} Sep 11 05:27:06.542177 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.541885 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6885869465-lwcwb" event={"ID":"c6ab7466-62bb-449f-bfc6-a8950500ff68","Type":"ContainerDied","Data":"bf82a8aeb84c8bab04e966f5ae5e57a8cbab7ec2142fb733d42ca1ccd89994ec"} Sep 11 05:27:06.542177 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.541904 2569 scope.go:117] "RemoveContainer" containerID="847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f" Sep 11 05:27:06.550345 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.550332 2569 scope.go:117] "RemoveContainer" containerID="847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f" Sep 11 05:27:06.550622 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:27:06.550601 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f\": container with ID starting with 847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f not found: ID does not exist" containerID="847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f" Sep 11 05:27:06.550676 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.550632 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f"} err="failed to get container status \"847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f\": rpc error: code = NotFound desc = could not find container \"847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f\": container with ID starting with 847ba2a6d821e4d2ba9bacb4d3f9a851e45aea6b80843ce132248891a9964a0f not found: ID does not exist" Sep 11 05:27:06.563654 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.563628 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6885869465-lwcwb"] Sep 11 05:27:06.569192 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.569169 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6885869465-lwcwb"] Sep 11 05:27:06.762110 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:27:06.762081 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6ab7466-62bb-449f-bfc6-a8950500ff68" path="/var/lib/kubelet/pods/c6ab7466-62bb-449f-bfc6-a8950500ff68/volumes" Sep 11 05:30:10.719926 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:30:10.719898 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:30:10.725741 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:30:10.725719 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:32:57.233554 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.233514 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-fhtnv"] Sep 11 05:32:57.234038 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.233805 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6ab7466-62bb-449f-bfc6-a8950500ff68" containerName="console" Sep 11 05:32:57.234038 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.233817 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6ab7466-62bb-449f-bfc6-a8950500ff68" containerName="console" Sep 11 05:32:57.234038 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.233871 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6ab7466-62bb-449f-bfc6-a8950500ff68" containerName="console" Sep 11 05:32:57.236743 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.236726 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-fhtnv" Sep 11 05:32:57.239052 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.239026 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 11 05:32:57.239825 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.239809 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 11 05:32:57.239888 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.239812 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-x4m8q\"" Sep 11 05:32:57.239888 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.239837 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 11 05:32:57.243041 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.243016 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-fhtnv"] Sep 11 05:32:57.282320 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.282297 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd94c\" (UniqueName: \"kubernetes.io/projected/15efcb63-86da-457e-bdd1-cb06a1fc5fd5-kube-api-access-gd94c\") pod \"feast-test-apply-fhtnv\" (UID: \"15efcb63-86da-457e-bdd1-cb06a1fc5fd5\") " pod="test-ns-feast/feast-test-apply-fhtnv" Sep 11 05:32:57.383475 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.383454 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd94c\" (UniqueName: \"kubernetes.io/projected/15efcb63-86da-457e-bdd1-cb06a1fc5fd5-kube-api-access-gd94c\") pod \"feast-test-apply-fhtnv\" (UID: \"15efcb63-86da-457e-bdd1-cb06a1fc5fd5\") " pod="test-ns-feast/feast-test-apply-fhtnv" Sep 11 05:32:57.391092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.391073 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd94c\" (UniqueName: \"kubernetes.io/projected/15efcb63-86da-457e-bdd1-cb06a1fc5fd5-kube-api-access-gd94c\") pod \"feast-test-apply-fhtnv\" (UID: \"15efcb63-86da-457e-bdd1-cb06a1fc5fd5\") " pod="test-ns-feast/feast-test-apply-fhtnv" Sep 11 05:32:57.546338 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.546281 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-fhtnv" Sep 11 05:32:57.812634 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.812566 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-fhtnv"] Sep 11 05:32:57.815590 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:32:57.815534 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15efcb63_86da_457e_bdd1_cb06a1fc5fd5.slice/crio-5836553d83f61b7d1ece0c9dc23e29876e4bbf0d620b70fe128b8d60c4b06a13 WatchSource:0}: Error finding container 5836553d83f61b7d1ece0c9dc23e29876e4bbf0d620b70fe128b8d60c4b06a13: Status 404 returned error can't find the container with id 5836553d83f61b7d1ece0c9dc23e29876e4bbf0d620b70fe128b8d60c4b06a13 Sep 11 05:32:57.817359 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.817342 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 05:32:57.826296 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:32:57.826268 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fhtnv" event={"ID":"15efcb63-86da-457e-bdd1-cb06a1fc5fd5","Type":"ContainerStarted","Data":"5836553d83f61b7d1ece0c9dc23e29876e4bbf0d620b70fe128b8d60c4b06a13"} Sep 11 05:33:02.848289 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:02.848252 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fhtnv" event={"ID":"15efcb63-86da-457e-bdd1-cb06a1fc5fd5","Type":"ContainerStarted","Data":"b5a6b2d747dec7494ff83ce6853b15920cfd724cca7029612c6505f9846a4d01"} Sep 11 05:33:09.873835 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:09.873799 2569 generic.go:356] "Generic (PLEG): container finished" podID="15efcb63-86da-457e-bdd1-cb06a1fc5fd5" containerID="b5a6b2d747dec7494ff83ce6853b15920cfd724cca7029612c6505f9846a4d01" exitCode=0 Sep 11 05:33:09.874301 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:09.873875 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fhtnv" event={"ID":"15efcb63-86da-457e-bdd1-cb06a1fc5fd5","Type":"ContainerDied","Data":"b5a6b2d747dec7494ff83ce6853b15920cfd724cca7029612c6505f9846a4d01"} Sep 11 05:33:10.879082 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:10.879050 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fhtnv" event={"ID":"15efcb63-86da-457e-bdd1-cb06a1fc5fd5","Type":"ContainerStarted","Data":"94765126281af6918910933ed4d2b5fc0b822043c32e272c47743a2bd2a6001c"} Sep 11 05:33:10.893078 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:10.893027 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-fhtnv" podStartSLOduration=2.626109752 podStartE2EDuration="13.893013879s" totalImagesPullingTime="4.807726377s" totalInitContainerRuntime="6.45917775s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:33:10.892821736 +0000 UTC m=+780.617001380" watchObservedRunningTime="2026-09-11 05:33:10.893013879 +0000 UTC m=+780.617193523" Sep 11 05:33:19.920896 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:19.920813 2569 generic.go:356] "Generic (PLEG): container finished" podID="15efcb63-86da-457e-bdd1-cb06a1fc5fd5" containerID="94765126281af6918910933ed4d2b5fc0b822043c32e272c47743a2bd2a6001c" exitCode=0 Sep 11 05:33:19.920896 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:19.920882 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fhtnv" event={"ID":"15efcb63-86da-457e-bdd1-cb06a1fc5fd5","Type":"ContainerDied","Data":"94765126281af6918910933ed4d2b5fc0b822043c32e272c47743a2bd2a6001c"} Sep 11 05:33:21.050873 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:21.050852 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-fhtnv" Sep 11 05:33:21.146025 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:21.145996 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd94c\" (UniqueName: \"kubernetes.io/projected/15efcb63-86da-457e-bdd1-cb06a1fc5fd5-kube-api-access-gd94c\") pod \"15efcb63-86da-457e-bdd1-cb06a1fc5fd5\" (UID: \"15efcb63-86da-457e-bdd1-cb06a1fc5fd5\") " Sep 11 05:33:21.148086 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:21.148062 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15efcb63-86da-457e-bdd1-cb06a1fc5fd5-kube-api-access-gd94c" (OuterVolumeSpecName: "kube-api-access-gd94c") pod "15efcb63-86da-457e-bdd1-cb06a1fc5fd5" (UID: "15efcb63-86da-457e-bdd1-cb06a1fc5fd5"). InnerVolumeSpecName "kube-api-access-gd94c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:33:21.246979 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:21.246950 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd94c\" (UniqueName: \"kubernetes.io/projected/15efcb63-86da-457e-bdd1-cb06a1fc5fd5-kube-api-access-gd94c\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:33:21.930091 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:21.930057 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-fhtnv" event={"ID":"15efcb63-86da-457e-bdd1-cb06a1fc5fd5","Type":"ContainerDied","Data":"5836553d83f61b7d1ece0c9dc23e29876e4bbf0d620b70fe128b8d60c4b06a13"} Sep 11 05:33:21.930091 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:21.930094 2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5836553d83f61b7d1ece0c9dc23e29876e4bbf0d620b70fe128b8d60c4b06a13" Sep 11 05:33:21.930273 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:21.930064 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-fhtnv" Sep 11 05:33:22.122873 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:22.122844 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-fhtnv_15efcb63-86da-457e-bdd1-cb06a1fc5fd5/feast-0/0.log" Sep 11 05:33:22.128860 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:22.128817 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-fhtnv_15efcb63-86da-457e-bdd1-cb06a1fc5fd5/feast-1/0.log" Sep 11 05:33:59.377312 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:59.377276 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-fhtnv"] Sep 11 05:33:59.385737 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:33:59.385708 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-fhtnv"] Sep 11 05:34:00.762282 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:34:00.762248 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15efcb63-86da-457e-bdd1-cb06a1fc5fd5" path="/var/lib/kubelet/pods/15efcb63-86da-457e-bdd1-cb06a1fc5fd5/volumes" Sep 11 05:35:10.743221 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:35:10.743139 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:35:10.747810 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:35:10.747790 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:39:10.796610 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:10.796581 2569 scope.go:117] "RemoveContainer" containerID="94765126281af6918910933ed4d2b5fc0b822043c32e272c47743a2bd2a6001c" Sep 11 05:39:10.803939 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:10.803922 2569 scope.go:117] "RemoveContainer" containerID="b5a6b2d747dec7494ff83ce6853b15920cfd724cca7029612c6505f9846a4d01" Sep 11 05:39:29.300261 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.300216 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6"] Sep 11 05:39:29.300661 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.300492 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15efcb63-86da-457e-bdd1-cb06a1fc5fd5" containerName="feast-0" Sep 11 05:39:29.300661 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.300503 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="15efcb63-86da-457e-bdd1-cb06a1fc5fd5" containerName="feast-0" Sep 11 05:39:29.300661 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.300511 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15efcb63-86da-457e-bdd1-cb06a1fc5fd5" containerName="feast-1" Sep 11 05:39:29.300661 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.300517 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="15efcb63-86da-457e-bdd1-cb06a1fc5fd5" containerName="feast-1" Sep 11 05:39:29.300661 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.300585 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="15efcb63-86da-457e-bdd1-cb06a1fc5fd5" containerName="feast-1" Sep 11 05:39:29.304943 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.304926 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.306986 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.306955 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 11 05:39:29.306986 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.306972 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-8vp6j\"" Sep 11 05:39:29.307149 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.306972 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 11 05:39:29.307252 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.307239 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 11 05:39:29.307328 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.307313 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 11 05:39:29.307367 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.307330 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 11 05:39:29.307686 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.307671 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 11 05:39:29.317458 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.317023 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6"] Sep 11 05:39:29.360982 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.360952 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e98304-e57d-4f14-af45-756bd92df0a0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.361147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.360986 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbfrl\" (UniqueName: \"kubernetes.io/projected/c8e98304-e57d-4f14-af45-756bd92df0a0-kube-api-access-wbfrl\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.361147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.361083 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.361147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.361118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.361147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.361134 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.361286 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.361150 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.462132 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.462094 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.462132 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.462138 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.462389 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.462155 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.462389 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.462174 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.462389 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.462202 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e98304-e57d-4f14-af45-756bd92df0a0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.462389 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.462219 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbfrl\" (UniqueName: \"kubernetes.io/projected/c8e98304-e57d-4f14-af45-756bd92df0a0-kube-api-access-wbfrl\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.462389 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:39:29.462278 2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 11 05:39:29.462389 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:39:29.462356 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls podName:c8e98304-e57d-4f14-af45-756bd92df0a0 nodeName:}" failed. No retries permitted until 2026-09-11 05:39:29.96233297 +0000 UTC m=+1159.686512608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-d4pw6" (UID: "c8e98304-e57d-4f14-af45-756bd92df0a0") : secret "feast-simple-feast-setup-ui-tls" not found Sep 11 05:39:29.462725 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.462680 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e98304-e57d-4f14-af45-756bd92df0a0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.464717 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.464690 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.464844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.464773 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.464844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.464810 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.471384 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.471363 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbfrl\" (UniqueName: \"kubernetes.io/projected/c8e98304-e57d-4f14-af45-756bd92df0a0-kube-api-access-wbfrl\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.965835 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.965803 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:29.968143 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:29.968125 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-d4pw6\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:30.215699 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:30.215662 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:30.488944 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:30.488920 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6"] Sep 11 05:39:30.490508 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:39:30.490482 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8e98304_e57d_4f14_af45_756bd92df0a0.slice/crio-28465ead810761ce28662ea77d39f0bd0428d6d0f8f562d573bcb57ba8c40b33 WatchSource:0}: Error finding container 28465ead810761ce28662ea77d39f0bd0428d6d0f8f562d573bcb57ba8c40b33: Status 404 returned error can't find the container with id 28465ead810761ce28662ea77d39f0bd0428d6d0f8f562d573bcb57ba8c40b33 Sep 11 05:39:30.492300 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:30.492285 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 05:39:31.301306 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:31.301263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerStarted","Data":"28465ead810761ce28662ea77d39f0bd0428d6d0f8f562d573bcb57ba8c40b33"} Sep 11 05:39:44.360958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:44.360919 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerStarted","Data":"772542387bd8704e0565924ef1aa4ab1ef19787157c407f3d9786bff281f4b2b"} Sep 11 05:39:49.382311 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:49.382274 2569 generic.go:356] "Generic (PLEG): container finished" podID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerID="772542387bd8704e0565924ef1aa4ab1ef19787157c407f3d9786bff281f4b2b" exitCode=0 Sep 11 05:39:49.382688 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:49.382328 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerDied","Data":"772542387bd8704e0565924ef1aa4ab1ef19787157c407f3d9786bff281f4b2b"} Sep 11 05:39:50.388224 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:50.388187 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerStarted","Data":"d215fe4905b549018caf86fbb77c561e003aaca40ab4472b0a38a797013d3475"} Sep 11 05:39:55.407949 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:55.407861 2569 generic.go:356] "Generic (PLEG): container finished" podID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerID="d215fe4905b549018caf86fbb77c561e003aaca40ab4472b0a38a797013d3475" exitCode=0 Sep 11 05:39:55.407949 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:55.407903 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerDied","Data":"d215fe4905b549018caf86fbb77c561e003aaca40ab4472b0a38a797013d3475"} Sep 11 05:39:56.422702 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:56.422655 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerStarted","Data":"120f6d683b9ceb885224423e9a3d3c8607335725f5250cf105a47e8eac953231"} Sep 11 05:39:56.423178 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:56.422726 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerStarted","Data":"e405ee1b9aec255d643deae59228b18e79e205c8c4d3720f6f27172a28e7ad77"} Sep 11 05:39:56.423178 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:56.422746 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerStarted","Data":"73cd379d1d244516fef40e181d0bfe501eb2ecbfa53fd5cf337ec4fec7ee720a"} Sep 11 05:39:56.423178 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:56.422762 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerStarted","Data":"b491b8a444f55132ac65ad96bd2cd51288097cb3fecd9c96a5ca694d1aa6c47a"} Sep 11 05:39:56.446015 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:56.445953 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podStartSLOduration=13.791678225 podStartE2EDuration="27.445932823s" totalImagesPullingTime="13.654254598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:39:56.444127004 +0000 UTC m=+1186.168306651" watchObservedRunningTime="2026-09-11 05:39:56.445932823 +0000 UTC m=+1186.170112476" Sep 11 05:39:57.216403 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:57.216359 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:57.216624 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:57.216429 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:57.216624 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:57.216448 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:57.216624 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:57.216465 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:39:57.218614 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:57.218443 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 11 05:39:57.218614 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:57.218486 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 11 05:39:57.218614 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:57.218509 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 11 05:39:57.218614 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:39:57.218491 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 11 05:40:00.216642 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:00.216601 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:00.217189 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:00.217145 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 11 05:40:00.217189 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:00.217171 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:00.217372 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:00.216778 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 11 05:40:00.217372 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:00.217201 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:00.217372 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:00.217276 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:00.217372 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:00.216864 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.26:6571: connect: connection refused" Sep 11 05:40:00.217372 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:00.216801 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 11 05:40:03.216716 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:03.216669 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 11 05:40:03.217177 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:03.216670 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 11 05:40:03.217610 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:03.217589 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:03.217762 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:03.217749 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:03.218308 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:03.218287 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:03.218666 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:03.218648 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:06.216822 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:06.216789 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:06.217602 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:06.217580 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:06.222105 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:06.222079 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:06.473124 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:06.473036 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:40:10.771234 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:10.771201 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:40:10.771704 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:40:10.771407 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:41:07.664796 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:07.664599 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6"] Sep 11 05:41:07.665334 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:07.665002 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="registry" containerID="cri-o://b491b8a444f55132ac65ad96bd2cd51288097cb3fecd9c96a5ca694d1aa6c47a" gracePeriod=30 Sep 11 05:41:07.665334 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:07.665288 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" containerID="cri-o://120f6d683b9ceb885224423e9a3d3c8607335725f5250cf105a47e8eac953231" gracePeriod=30 Sep 11 05:41:07.665451 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:07.665387 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" containerID="cri-o://73cd379d1d244516fef40e181d0bfe501eb2ecbfa53fd5cf337ec4fec7ee720a" gracePeriod=30 Sep 11 05:41:07.665506 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:07.665480 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="offline" containerID="cri-o://e405ee1b9aec255d643deae59228b18e79e205c8c4d3720f6f27172a28e7ad77" gracePeriod=30 Sep 11 05:41:08.100671 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.100636 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw"] Sep 11 05:41:08.104644 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.104626 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.106777 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.106753 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5vb78\"" Sep 11 05:41:08.115751 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.115723 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw"] Sep 11 05:41:08.216882 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.216832 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7a711971-d8b9-4bee-8a42-079550c19594-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.217047 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.216882 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdmkd\" (UniqueName: \"kubernetes.io/projected/7a711971-d8b9-4bee-8a42-079550c19594-kube-api-access-jdmkd\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.217047 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.216912 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.217047 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.216981 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.217229 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.217056 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.217229 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.217104 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.318378 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.318346 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7a711971-d8b9-4bee-8a42-079550c19594-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.318580 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.318386 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdmkd\" (UniqueName: \"kubernetes.io/projected/7a711971-d8b9-4bee-8a42-079550c19594-kube-api-access-jdmkd\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.318580 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.318406 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.318580 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.318430 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.318580 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.318474 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.318580 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.318516 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.318853 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:41:08.318661 2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 11 05:41:08.318853 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:41:08.318732 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls podName:7a711971-d8b9-4bee-8a42-079550c19594 nodeName:}" failed. No retries permitted until 2026-09-11 05:41:08.818711162 +0000 UTC m=+1258.542890784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls") pod "feast-simple-feast-setup-57576b8fcf-s6cnw" (UID: "7a711971-d8b9-4bee-8a42-079550c19594") : secret "feast-simple-feast-setup-online-tls" not found Sep 11 05:41:08.318853 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.318817 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7a711971-d8b9-4bee-8a42-079550c19594-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.320785 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.320759 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.320896 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.320835 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.321020 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.320996 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.326530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.326509 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdmkd\" (UniqueName: \"kubernetes.io/projected/7a711971-d8b9-4bee-8a42-079550c19594-kube-api-access-jdmkd\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.712580 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.712484 2569 generic.go:356] "Generic (PLEG): container finished" podID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerID="120f6d683b9ceb885224423e9a3d3c8607335725f5250cf105a47e8eac953231" exitCode=0 Sep 11 05:41:08.712580 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.712511 2569 generic.go:356] "Generic (PLEG): container finished" podID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerID="73cd379d1d244516fef40e181d0bfe501eb2ecbfa53fd5cf337ec4fec7ee720a" exitCode=0 Sep 11 05:41:08.712963 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.712569 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerDied","Data":"120f6d683b9ceb885224423e9a3d3c8607335725f5250cf105a47e8eac953231"} Sep 11 05:41:08.712963 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.712614 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerDied","Data":"73cd379d1d244516fef40e181d0bfe501eb2ecbfa53fd5cf337ec4fec7ee720a"} Sep 11 05:41:08.822729 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.822691 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:08.825060 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:08.825040 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-s6cnw\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:09.013674 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:09.013649 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:09.285505 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:09.285474 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw"] Sep 11 05:41:09.287041 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:41:09.287012 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a711971_d8b9_4bee_8a42_079550c19594.slice/crio-ecf25f783300029ad1b4d492347d98d937d25675bc9d49ed89aa5afbfe93a368 WatchSource:0}: Error finding container ecf25f783300029ad1b4d492347d98d937d25675bc9d49ed89aa5afbfe93a368: Status 404 returned error can't find the container with id ecf25f783300029ad1b4d492347d98d937d25675bc9d49ed89aa5afbfe93a368 Sep 11 05:41:09.718057 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:09.717966 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerStarted","Data":"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03"} Sep 11 05:41:09.718057 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:09.718015 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerStarted","Data":"ecf25f783300029ad1b4d492347d98d937d25675bc9d49ed89aa5afbfe93a368"} Sep 11 05:41:14.738833 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:14.738798 2569 generic.go:356] "Generic (PLEG): container finished" podID="7a711971-d8b9-4bee-8a42-079550c19594" containerID="9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03" exitCode=0 Sep 11 05:41:14.739282 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:14.738872 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerDied","Data":"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03"} Sep 11 05:41:15.744308 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:15.744272 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerStarted","Data":"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4"} Sep 11 05:41:16.217667 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:16.217528 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 11 05:41:16.470914 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:16.470815 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 11 05:41:20.765781 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:20.765749 2569 generic.go:356] "Generic (PLEG): container finished" podID="7a711971-d8b9-4bee-8a42-079550c19594" containerID="a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4" exitCode=0 Sep 11 05:41:20.766141 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:20.765817 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerDied","Data":"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4"} Sep 11 05:41:21.783591 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:21.776947 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerStarted","Data":"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80"} Sep 11 05:41:21.783591 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:21.777025 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerStarted","Data":"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5"} Sep 11 05:41:21.783591 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:21.777047 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerStarted","Data":"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380"} Sep 11 05:41:21.783591 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:21.777083 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerStarted","Data":"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924"} Sep 11 05:41:21.808671 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:21.806252 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podStartSLOduration=13.806231968 podStartE2EDuration="13.806231968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:41:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:41:21.804787062 +0000 UTC m=+1271.528966707" watchObservedRunningTime="2026-09-11 05:41:21.806231968 +0000 UTC m=+1271.530411615" Sep 11 05:41:24.014530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:24.014454 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:24.014530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:24.014524 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:24.015083 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:24.014563 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:24.015083 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:24.014590 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:24.016848 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:24.016812 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 11 05:41:24.017050 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:24.016841 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Sep 11 05:41:24.017050 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:24.016896 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused" Sep 11 05:41:24.017236 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:24.016922 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 11 05:41:26.218311 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:26.218257 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 11 05:41:26.471133 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:26.471014 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 11 05:41:27.014464 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:27.014414 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.27:6571: connect: connection refused" Sep 11 05:41:27.014659 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:27.014414 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 11 05:41:27.014659 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:27.014424 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.27:8816: connect: connection refused" Sep 11 05:41:27.015042 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:27.015014 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 11 05:41:29.013913 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:29.013875 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:29.014263 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:29.013940 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:29.014263 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:29.013960 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:29.014263 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:29.013979 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:30.014835 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:30.014803 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:30.015195 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:30.014936 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:30.015360 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:30.015322 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:30.015640 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:30.015620 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:30.015736 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:30.015689 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:30.015787 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:30.015742 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:30.020079 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:30.020056 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:30.824209 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:30.824178 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:41:36.217652 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:36.217612 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 11 05:41:36.218011 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:36.217721 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:41:36.471000 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:36.470913 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 11 05:41:36.471128 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:36.471040 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:41:37.849105 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:37.849074 2569 generic.go:356] "Generic (PLEG): container finished" podID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerID="e405ee1b9aec255d643deae59228b18e79e205c8c4d3720f6f27172a28e7ad77" exitCode=137 Sep 11 05:41:37.849105 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:37.849101 2569 generic.go:356] "Generic (PLEG): container finished" podID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerID="b491b8a444f55132ac65ad96bd2cd51288097cb3fecd9c96a5ca694d1aa6c47a" exitCode=137 Sep 11 05:41:37.849461 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:37.849144 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerDied","Data":"e405ee1b9aec255d643deae59228b18e79e205c8c4d3720f6f27172a28e7ad77"} Sep 11 05:41:37.849461 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:37.849182 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerDied","Data":"b491b8a444f55132ac65ad96bd2cd51288097cb3fecd9c96a5ca694d1aa6c47a"} Sep 11 05:41:38.316943 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.316919 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:41:38.470147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.470070 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls\") pod \"c8e98304-e57d-4f14-af45-756bd92df0a0\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " Sep 11 05:41:38.470147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.470103 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-offline-tls\") pod \"c8e98304-e57d-4f14-af45-756bd92df0a0\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " Sep 11 05:41:38.470147 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.470127 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-registry-tls\") pod \"c8e98304-e57d-4f14-af45-756bd92df0a0\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " Sep 11 05:41:38.470414 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.470155 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbfrl\" (UniqueName: \"kubernetes.io/projected/c8e98304-e57d-4f14-af45-756bd92df0a0-kube-api-access-wbfrl\") pod \"c8e98304-e57d-4f14-af45-756bd92df0a0\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " Sep 11 05:41:38.470414 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.470233 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-online-tls\") pod \"c8e98304-e57d-4f14-af45-756bd92df0a0\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " Sep 11 05:41:38.470414 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.470289 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e98304-e57d-4f14-af45-756bd92df0a0-feast-data\") pod \"c8e98304-e57d-4f14-af45-756bd92df0a0\" (UID: \"c8e98304-e57d-4f14-af45-756bd92df0a0\") " Sep 11 05:41:38.470930 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.470895 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8e98304-e57d-4f14-af45-756bd92df0a0-feast-data" (OuterVolumeSpecName: "feast-data") pod "c8e98304-e57d-4f14-af45-756bd92df0a0" (UID: "c8e98304-e57d-4f14-af45-756bd92df0a0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 05:41:38.472361 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.472330 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c8e98304-e57d-4f14-af45-756bd92df0a0" (UID: "c8e98304-e57d-4f14-af45-756bd92df0a0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:41:38.472463 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.472409 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c8e98304-e57d-4f14-af45-756bd92df0a0" (UID: "c8e98304-e57d-4f14-af45-756bd92df0a0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:41:38.472528 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.472509 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8e98304-e57d-4f14-af45-756bd92df0a0-kube-api-access-wbfrl" (OuterVolumeSpecName: "kube-api-access-wbfrl") pod "c8e98304-e57d-4f14-af45-756bd92df0a0" (UID: "c8e98304-e57d-4f14-af45-756bd92df0a0"). InnerVolumeSpecName "kube-api-access-wbfrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:41:38.472712 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.472684 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c8e98304-e57d-4f14-af45-756bd92df0a0" (UID: "c8e98304-e57d-4f14-af45-756bd92df0a0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:41:38.472800 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.472726 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-online-tls" (OuterVolumeSpecName: "online-tls") pod "c8e98304-e57d-4f14-af45-756bd92df0a0" (UID: "c8e98304-e57d-4f14-af45-756bd92df0a0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:41:38.571392 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.571361 2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-online-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:41:38.571392 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.571387 2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c8e98304-e57d-4f14-af45-756bd92df0a0-feast-data\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:41:38.571392 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.571397 2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-ui-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:41:38.571666 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.571404 2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-offline-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:41:38.571666 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.571413 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c8e98304-e57d-4f14-af45-756bd92df0a0-registry-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:41:38.571666 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.571422 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbfrl\" (UniqueName: \"kubernetes.io/projected/c8e98304-e57d-4f14-af45-756bd92df0a0-kube-api-access-wbfrl\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:41:38.856821 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.856789 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" event={"ID":"c8e98304-e57d-4f14-af45-756bd92df0a0","Type":"ContainerDied","Data":"28465ead810761ce28662ea77d39f0bd0428d6d0f8f562d573bcb57ba8c40b33"} Sep 11 05:41:38.856821 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.856809 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6" Sep 11 05:41:38.857241 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.856841 2569 scope.go:117] "RemoveContainer" containerID="120f6d683b9ceb885224423e9a3d3c8607335725f5250cf105a47e8eac953231" Sep 11 05:41:38.865122 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.865101 2569 scope.go:117] "RemoveContainer" containerID="e405ee1b9aec255d643deae59228b18e79e205c8c4d3720f6f27172a28e7ad77" Sep 11 05:41:38.873127 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.873108 2569 scope.go:117] "RemoveContainer" containerID="73cd379d1d244516fef40e181d0bfe501eb2ecbfa53fd5cf337ec4fec7ee720a" Sep 11 05:41:38.874820 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.874801 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6"] Sep 11 05:41:38.877256 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.877236 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-d4pw6"] Sep 11 05:41:38.881381 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.881366 2569 scope.go:117] "RemoveContainer" containerID="b491b8a444f55132ac65ad96bd2cd51288097cb3fecd9c96a5ca694d1aa6c47a" Sep 11 05:41:38.888320 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.888304 2569 scope.go:117] "RemoveContainer" containerID="d215fe4905b549018caf86fbb77c561e003aaca40ab4472b0a38a797013d3475" Sep 11 05:41:38.894979 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:38.894957 2569 scope.go:117] "RemoveContainer" containerID="772542387bd8704e0565924ef1aa4ab1ef19787157c407f3d9786bff281f4b2b" Sep 11 05:41:40.762515 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:41:40.762477 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" path="/var/lib/kubelet/pods/c8e98304-e57d-4f14-af45-756bd92df0a0/volumes" Sep 11 05:42:33.128503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128428 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64"] Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128718 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128729 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128738 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128744 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128754 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="registry" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128760 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="registry" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128770 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="feast-init" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128775 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="feast-init" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128789 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="feast-apply" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128794 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="feast-apply" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128801 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="offline" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128806 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="offline" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128853 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="registry" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128859 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="offline" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128867 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="ui" Sep 11 05:42:33.128883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.128875 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8e98304-e57d-4f14-af45-756bd92df0a0" containerName="online" Sep 11 05:42:33.133385 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.133369 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.135666 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.135618 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 11 05:42:33.135803 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.135701 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 11 05:42:33.135803 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.135761 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 11 05:42:33.135928 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.135802 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-8b6xm\"" Sep 11 05:42:33.135928 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.135816 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 11 05:42:33.135928 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.135865 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 11 05:42:33.135928 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.135873 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 11 05:42:33.143712 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.143690 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64"] Sep 11 05:42:33.258693 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.258663 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.258693 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.258693 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.258886 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.258711 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.258886 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.258733 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.258886 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.258807 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7jfl\" (UniqueName: \"kubernetes.io/projected/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-kube-api-access-r7jfl\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.258886 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.258863 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.359213 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.359179 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.359374 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.359220 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.359374 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.359238 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.359374 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.359254 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.359374 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.359309 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.359374 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.359351 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7jfl\" (UniqueName: \"kubernetes.io/projected/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-kube-api-access-r7jfl\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.359665 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:42:33.359526 2569 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 11 05:42:33.359665 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:42:33.359629 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls podName:2cec3dcb-b6e1-463e-8c75-fde9b7bfab45 nodeName:}" failed. No retries permitted until 2026-09-11 05:42:33.859606243 +0000 UTC m=+1343.583785879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-76b64" (UID: "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 11 05:42:33.359757 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.359669 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.360029 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.360006 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.361679 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.361662 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.361757 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.361728 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.367568 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.367536 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7jfl\" (UniqueName: \"kubernetes.io/projected/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-kube-api-access-r7jfl\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.863449 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.863412 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:33.865783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:33.865760 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-76b64\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:34.042890 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:34.042859 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:42:34.315104 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:34.315080 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64"] Sep 11 05:42:34.316787 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:42:34.316764 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cec3dcb_b6e1_463e_8c75_fde9b7bfab45.slice/crio-e650548bfff839e5d380e1ebd5074809b19b76b96995e2ab7cc5454c9f2bcc44 WatchSource:0}: Error finding container e650548bfff839e5d380e1ebd5074809b19b76b96995e2ab7cc5454c9f2bcc44: Status 404 returned error can't find the container with id e650548bfff839e5d380e1ebd5074809b19b76b96995e2ab7cc5454c9f2bcc44 Sep 11 05:42:35.077118 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:35.077076 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerStarted","Data":"73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a"} Sep 11 05:42:35.077285 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:35.077141 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerStarted","Data":"e650548bfff839e5d380e1ebd5074809b19b76b96995e2ab7cc5454c9f2bcc44"} Sep 11 05:42:40.096743 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:40.096713 2569 generic.go:356] "Generic (PLEG): container finished" podID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerID="73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a" exitCode=0 Sep 11 05:42:40.097107 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:40.096751 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerDied","Data":"73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a"} Sep 11 05:42:41.102379 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:42:41.102338 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerStarted","Data":"2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef"} Sep 11 05:43:02.185068 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:02.185027 2569 generic.go:356] "Generic (PLEG): container finished" podID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerID="2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef" exitCode=0 Sep 11 05:43:02.185599 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:02.185103 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerDied","Data":"2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef"} Sep 11 05:43:03.193832 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:03.193790 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerStarted","Data":"8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6"} Sep 11 05:43:03.194225 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:03.193858 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerStarted","Data":"dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90"} Sep 11 05:43:03.194225 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:03.193878 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerStarted","Data":"720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1"} Sep 11 05:43:03.215473 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:03.215399 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podStartSLOduration=30.215379221 podStartE2EDuration="30.215379221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:43:03.213792997 +0000 UTC m=+1372.937972642" watchObservedRunningTime="2026-09-11 05:43:03.215379221 +0000 UTC m=+1372.939558866" Sep 11 05:43:04.043320 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.043275 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:04.043490 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.043340 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:04.043490 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.043363 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:04.043490 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.043379 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:04.043490 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.043395 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:04.043490 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.043412 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:04.045344 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.045304 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 11 05:43:04.045344 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.045325 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 11 05:43:04.045536 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:04.045390 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 11 05:43:07.043707 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:07.043654 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 11 05:43:07.044176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:07.043726 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 11 05:43:07.044176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:07.043663 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 11 05:43:10.044050 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:10.044001 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 11 05:43:10.044436 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:10.044018 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 11 05:43:10.044776 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:10.044755 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:10.045486 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:10.045464 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:13.044244 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:13.044212 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:13.045032 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:13.045008 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:13.772171 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:13.772140 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:43:15.048661 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:15.048622 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 11 05:43:16.052689 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:16.052645 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 11 05:43:25.778169 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:43:25.778133 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:44:27.654710 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.654674 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64"] Sep 11 05:44:27.655300 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.654991 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" containerID="cri-o://720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1" gracePeriod=30 Sep 11 05:44:27.655300 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.655151 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" containerID="cri-o://8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6" gracePeriod=30 Sep 11 05:44:27.655300 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.655166 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="offline" containerID="cri-o://dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90" gracePeriod=30 Sep 11 05:44:27.793154 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.793122 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw"] Sep 11 05:44:27.793395 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.793366 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="registry" containerID="cri-o://becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924" gracePeriod=30 Sep 11 05:44:27.793476 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.793446 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="offline" containerID="cri-o://b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5" gracePeriod=30 Sep 11 05:44:27.793533 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.793488 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" containerID="cri-o://f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80" gracePeriod=30 Sep 11 05:44:27.793533 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:27.793519 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" containerID="cri-o://fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380" gracePeriod=30 Sep 11 05:44:28.543171 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:28.543145 2569 generic.go:356] "Generic (PLEG): container finished" podID="7a711971-d8b9-4bee-8a42-079550c19594" containerID="f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80" exitCode=0 Sep 11 05:44:28.543303 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:28.543222 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerDied","Data":"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80"} Sep 11 05:44:28.546104 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:28.546079 2569 generic.go:356] "Generic (PLEG): container finished" podID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerID="8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6" exitCode=0 Sep 11 05:44:28.546198 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:28.546115 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerDied","Data":"8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6"} Sep 11 05:44:29.552752 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:29.552721 2569 generic.go:356] "Generic (PLEG): container finished" podID="7a711971-d8b9-4bee-8a42-079550c19594" containerID="fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380" exitCode=0 Sep 11 05:44:29.553151 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:29.552796 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerDied","Data":"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380"} Sep 11 05:44:29.555369 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:29.555350 2569 generic.go:356] "Generic (PLEG): container finished" podID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerID="720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1" exitCode=0 Sep 11 05:44:29.555458 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:29.555404 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerDied","Data":"720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1"} Sep 11 05:44:30.015784 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:30.015742 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 11 05:44:30.821109 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:30.821071 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 11 05:44:33.045738 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:33.045698 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 11 05:44:35.049642 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:35.049602 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 11 05:44:40.016199 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:40.016147 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 11 05:44:40.821897 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:40.821859 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 11 05:44:43.045456 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:43.045414 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 11 05:44:45.049651 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:45.049601 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 11 05:44:50.015941 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:50.015890 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.27:8443: connect: connection refused" Sep 11 05:44:50.016461 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:50.016049 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:44:50.821684 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:50.821649 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" probeResult="failure" output="Get \"https://10.132.0.27:6567/health\": dial tcp 10.132.0.27:6567: connect: connection refused" Sep 11 05:44:50.821845 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:50.821747 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:44:53.044938 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:53.044889 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.28:8443: connect: connection refused" Sep 11 05:44:53.045321 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:53.045023 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:44:55.049960 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:55.049917 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 11 05:44:55.050343 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:55.050046 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:44:57.881994 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.881966 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:44:57.964994 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.964925 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls\") pod \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " Sep 11 05:44:57.965117 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.965014 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-offline-tls\") pod \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " Sep 11 05:44:57.965117 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.965040 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7jfl\" (UniqueName: \"kubernetes.io/projected/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-kube-api-access-r7jfl\") pod \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " Sep 11 05:44:57.965117 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.965077 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-registry-tls\") pod \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " Sep 11 05:44:57.965254 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.965126 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-online-tls\") pod \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " Sep 11 05:44:57.965254 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.965173 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-feast-data\") pod \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\" (UID: \"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45\") " Sep 11 05:44:57.965519 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.965483 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" (UID: "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:44:57.965783 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.965747 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-feast-data" (OuterVolumeSpecName: "feast-data") pod "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" (UID: "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 05:44:57.967273 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.967250 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-online-tls" (OuterVolumeSpecName: "online-tls") pod "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" (UID: "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:44:57.967359 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.967277 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" (UID: "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:44:57.967474 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.967455 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" (UID: "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:44:57.967520 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:57.967458 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-kube-api-access-r7jfl" (OuterVolumeSpecName: "kube-api-access-r7jfl") pod "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" (UID: "2cec3dcb-b6e1-463e-8c75-fde9b7bfab45"). InnerVolumeSpecName "kube-api-access-r7jfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:44:58.065969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.065945 2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-ui-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.065969 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.065966 2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-offline-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.066092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.065976 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7jfl\" (UniqueName: \"kubernetes.io/projected/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-kube-api-access-r7jfl\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.066092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.065984 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-registry-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.066092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.065992 2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-online-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.066092 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.066000 2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45-feast-data\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.423364 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.423336 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:44:58.469465 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.469437 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7a711971-d8b9-4bee-8a42-079550c19594-feast-data\") pod \"7a711971-d8b9-4bee-8a42-079550c19594\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " Sep 11 05:44:58.469615 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.469482 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-ui-tls\") pod \"7a711971-d8b9-4bee-8a42-079550c19594\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " Sep 11 05:44:58.469615 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.469510 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdmkd\" (UniqueName: \"kubernetes.io/projected/7a711971-d8b9-4bee-8a42-079550c19594-kube-api-access-jdmkd\") pod \"7a711971-d8b9-4bee-8a42-079550c19594\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " Sep 11 05:44:58.469615 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.469567 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-registry-tls\") pod \"7a711971-d8b9-4bee-8a42-079550c19594\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " Sep 11 05:44:58.469615 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.469606 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-offline-tls\") pod \"7a711971-d8b9-4bee-8a42-079550c19594\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " Sep 11 05:44:58.469812 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.469639 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls\") pod \"7a711971-d8b9-4bee-8a42-079550c19594\" (UID: \"7a711971-d8b9-4bee-8a42-079550c19594\") " Sep 11 05:44:58.469992 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.469963 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a711971-d8b9-4bee-8a42-079550c19594-feast-data" (OuterVolumeSpecName: "feast-data") pod "7a711971-d8b9-4bee-8a42-079550c19594" (UID: "7a711971-d8b9-4bee-8a42-079550c19594"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 05:44:58.471574 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.471513 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a711971-d8b9-4bee-8a42-079550c19594-kube-api-access-jdmkd" (OuterVolumeSpecName: "kube-api-access-jdmkd") pod "7a711971-d8b9-4bee-8a42-079550c19594" (UID: "7a711971-d8b9-4bee-8a42-079550c19594"). InnerVolumeSpecName "kube-api-access-jdmkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:44:58.472004 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.471975 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7a711971-d8b9-4bee-8a42-079550c19594" (UID: "7a711971-d8b9-4bee-8a42-079550c19594"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:44:58.472093 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.472007 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls" (OuterVolumeSpecName: "online-tls") pod "7a711971-d8b9-4bee-8a42-079550c19594" (UID: "7a711971-d8b9-4bee-8a42-079550c19594"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:44:58.472134 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.472086 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7a711971-d8b9-4bee-8a42-079550c19594" (UID: "7a711971-d8b9-4bee-8a42-079550c19594"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:44:58.472134 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.472097 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7a711971-d8b9-4bee-8a42-079550c19594" (UID: "7a711971-d8b9-4bee-8a42-079550c19594"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:44:58.570393 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.570334 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-registry-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.570393 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.570357 2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-offline-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.570393 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.570367 2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-online-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.570393 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.570374 2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7a711971-d8b9-4bee-8a42-079550c19594-feast-data\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.570393 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.570381 2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7a711971-d8b9-4bee-8a42-079550c19594-ui-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.570393 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.570389 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdmkd\" (UniqueName: \"kubernetes.io/projected/7a711971-d8b9-4bee-8a42-079550c19594-kube-api-access-jdmkd\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:44:58.675102 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.675072 2569 generic.go:356] "Generic (PLEG): container finished" podID="7a711971-d8b9-4bee-8a42-079550c19594" containerID="b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5" exitCode=137 Sep 11 05:44:58.675102 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.675098 2569 generic.go:356] "Generic (PLEG): container finished" podID="7a711971-d8b9-4bee-8a42-079550c19594" containerID="becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924" exitCode=137 Sep 11 05:44:58.675266 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.675132 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" Sep 11 05:44:58.675266 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.675153 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerDied","Data":"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5"} Sep 11 05:44:58.675266 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.675202 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerDied","Data":"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924"} Sep 11 05:44:58.675266 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.675225 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw" event={"ID":"7a711971-d8b9-4bee-8a42-079550c19594","Type":"ContainerDied","Data":"ecf25f783300029ad1b4d492347d98d937d25675bc9d49ed89aa5afbfe93a368"} Sep 11 05:44:58.675266 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.675251 2569 scope.go:117] "RemoveContainer" containerID="f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80" Sep 11 05:44:58.677899 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.677876 2569 generic.go:356] "Generic (PLEG): container finished" podID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerID="dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90" exitCode=137 Sep 11 05:44:58.678000 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.677907 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerDied","Data":"dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90"} Sep 11 05:44:58.678000 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.677946 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" event={"ID":"2cec3dcb-b6e1-463e-8c75-fde9b7bfab45","Type":"ContainerDied","Data":"e650548bfff839e5d380e1ebd5074809b19b76b96995e2ab7cc5454c9f2bcc44"} Sep 11 05:44:58.678000 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.677971 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64" Sep 11 05:44:58.693248 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.693232 2569 scope.go:117] "RemoveContainer" containerID="b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5" Sep 11 05:44:58.700694 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.700677 2569 scope.go:117] "RemoveContainer" containerID="fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380" Sep 11 05:44:58.705180 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.705162 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64"] Sep 11 05:44:58.708630 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.708614 2569 scope.go:117] "RemoveContainer" containerID="becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924" Sep 11 05:44:58.709154 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.709134 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-76b64"] Sep 11 05:44:58.715521 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.715506 2569 scope.go:117] "RemoveContainer" containerID="a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4" Sep 11 05:44:58.719013 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.718993 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw"] Sep 11 05:44:58.722947 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.722928 2569 scope.go:117] "RemoveContainer" containerID="9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03" Sep 11 05:44:58.723829 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.723804 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-s6cnw"] Sep 11 05:44:58.729507 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.729487 2569 scope.go:117] "RemoveContainer" containerID="f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80" Sep 11 05:44:58.729791 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.729774 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80\": container with ID starting with f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80 not found: ID does not exist" containerID="f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80" Sep 11 05:44:58.729854 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.729797 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80"} err="failed to get container status \"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80\": rpc error: code = NotFound desc = could not find container \"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80\": container with ID starting with f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80 not found: ID does not exist" Sep 11 05:44:58.729854 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.729812 2569 scope.go:117] "RemoveContainer" containerID="b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5" Sep 11 05:44:58.730092 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.730072 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5\": container with ID starting with b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5 not found: ID does not exist" containerID="b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5" Sep 11 05:44:58.730139 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.730101 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5"} err="failed to get container status \"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5\": rpc error: code = NotFound desc = could not find container \"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5\": container with ID starting with b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5 not found: ID does not exist" Sep 11 05:44:58.730139 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.730115 2569 scope.go:117] "RemoveContainer" containerID="fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380" Sep 11 05:44:58.730326 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.730312 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380\": container with ID starting with fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380 not found: ID does not exist" containerID="fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380" Sep 11 05:44:58.730370 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.730329 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380"} err="failed to get container status \"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380\": rpc error: code = NotFound desc = could not find container \"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380\": container with ID starting with fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380 not found: ID does not exist" Sep 11 05:44:58.730370 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.730341 2569 scope.go:117] "RemoveContainer" containerID="becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924" Sep 11 05:44:58.730595 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.730569 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924\": container with ID starting with becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924 not found: ID does not exist" containerID="becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924" Sep 11 05:44:58.730695 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.730597 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924"} err="failed to get container status \"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924\": rpc error: code = NotFound desc = could not find container \"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924\": container with ID starting with becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924 not found: ID does not exist" Sep 11 05:44:58.730695 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.730611 2569 scope.go:117] "RemoveContainer" containerID="a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4" Sep 11 05:44:58.730853 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.730837 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4\": container with ID starting with a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4 not found: ID does not exist" containerID="a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4" Sep 11 05:44:58.730915 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.730856 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4"} err="failed to get container status \"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4\": rpc error: code = NotFound desc = could not find container \"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4\": container with ID starting with a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4 not found: ID does not exist" Sep 11 05:44:58.730915 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.730871 2569 scope.go:117] "RemoveContainer" containerID="9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03" Sep 11 05:44:58.731100 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.731082 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03\": container with ID starting with 9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03 not found: ID does not exist" containerID="9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03" Sep 11 05:44:58.731135 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731106 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03"} err="failed to get container status \"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03\": rpc error: code = NotFound desc = could not find container \"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03\": container with ID starting with 9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03 not found: ID does not exist" Sep 11 05:44:58.731135 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731120 2569 scope.go:117] "RemoveContainer" containerID="f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80" Sep 11 05:44:58.731345 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731327 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80"} err="failed to get container status \"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80\": rpc error: code = NotFound desc = could not find container \"f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80\": container with ID starting with f6c7026df668008066d47af8668376158f0ff16eb9427e189a03a3ef4897be80 not found: ID does not exist" Sep 11 05:44:58.731381 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731346 2569 scope.go:117] "RemoveContainer" containerID="b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5" Sep 11 05:44:58.731575 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731538 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5"} err="failed to get container status \"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5\": rpc error: code = NotFound desc = could not find container \"b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5\": container with ID starting with b0448b42dca0f7b732c93351edea378691fa0b523969e619b3bcf7fcedde63c5 not found: ID does not exist" Sep 11 05:44:58.731627 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731574 2569 scope.go:117] "RemoveContainer" containerID="fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380" Sep 11 05:44:58.731795 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731779 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380"} err="failed to get container status \"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380\": rpc error: code = NotFound desc = could not find container \"fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380\": container with ID starting with fc6d16827790026851e56447c858656903a8d345a8c66dc1feddd7c191922380 not found: ID does not exist" Sep 11 05:44:58.731835 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731797 2569 scope.go:117] "RemoveContainer" containerID="becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924" Sep 11 05:44:58.732000 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.731984 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924"} err="failed to get container status \"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924\": rpc error: code = NotFound desc = could not find container \"becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924\": container with ID starting with becd0657de28ed2cb9d6e4bef84b1205780d7e3dd68627d0dd9fcb3ce62da924 not found: ID does not exist" Sep 11 05:44:58.732049 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.732000 2569 scope.go:117] "RemoveContainer" containerID="a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4" Sep 11 05:44:58.732223 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.732208 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4"} err="failed to get container status \"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4\": rpc error: code = NotFound desc = could not find container \"a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4\": container with ID starting with a9ee4512e1a002ad33e2eecff54a078aff1bfc8f6150db070db0729b75c7cbb4 not found: ID does not exist" Sep 11 05:44:58.732267 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.732224 2569 scope.go:117] "RemoveContainer" containerID="9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03" Sep 11 05:44:58.732432 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.732413 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03"} err="failed to get container status \"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03\": rpc error: code = NotFound desc = could not find container \"9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03\": container with ID starting with 9ccd7b3392b906b3dd319d0dc6de76e467a354e16fae9301946f835d517adf03 not found: ID does not exist" Sep 11 05:44:58.732480 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.732433 2569 scope.go:117] "RemoveContainer" containerID="8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6" Sep 11 05:44:58.738913 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.738898 2569 scope.go:117] "RemoveContainer" containerID="dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90" Sep 11 05:44:58.745860 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.745846 2569 scope.go:117] "RemoveContainer" containerID="720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1" Sep 11 05:44:58.752491 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.752475 2569 scope.go:117] "RemoveContainer" containerID="2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef" Sep 11 05:44:58.759051 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.759033 2569 scope.go:117] "RemoveContainer" containerID="73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a" Sep 11 05:44:58.762130 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.762104 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" path="/var/lib/kubelet/pods/2cec3dcb-b6e1-463e-8c75-fde9b7bfab45/volumes" Sep 11 05:44:58.762778 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.762760 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a711971-d8b9-4bee-8a42-079550c19594" path="/var/lib/kubelet/pods/7a711971-d8b9-4bee-8a42-079550c19594/volumes" Sep 11 05:44:58.765732 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.765717 2569 scope.go:117] "RemoveContainer" containerID="8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6" Sep 11 05:44:58.765961 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.765947 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6\": container with ID starting with 8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6 not found: ID does not exist" containerID="8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6" Sep 11 05:44:58.766007 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.765965 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6"} err="failed to get container status \"8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6\": rpc error: code = NotFound desc = could not find container \"8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6\": container with ID starting with 8f91d96763a873083973bc285a0206034937159b1366244768d72844f3bb31c6 not found: ID does not exist" Sep 11 05:44:58.766007 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.765979 2569 scope.go:117] "RemoveContainer" containerID="dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90" Sep 11 05:44:58.766181 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.766163 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90\": container with ID starting with dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90 not found: ID does not exist" containerID="dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90" Sep 11 05:44:58.766222 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.766186 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90"} err="failed to get container status \"dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90\": rpc error: code = NotFound desc = could not find container \"dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90\": container with ID starting with dfab9103331f5625ec54748d141041460033f96a41287231928505e7b2682b90 not found: ID does not exist" Sep 11 05:44:58.766222 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.766200 2569 scope.go:117] "RemoveContainer" containerID="720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1" Sep 11 05:44:58.766390 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.766376 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1\": container with ID starting with 720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1 not found: ID does not exist" containerID="720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1" Sep 11 05:44:58.766429 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.766393 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1"} err="failed to get container status \"720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1\": rpc error: code = NotFound desc = could not find container \"720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1\": container with ID starting with 720bf236bec5081153735e9a9201e13e09557cd0c1e782586e0dd03ef83978e1 not found: ID does not exist" Sep 11 05:44:58.766429 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.766404 2569 scope.go:117] "RemoveContainer" containerID="2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef" Sep 11 05:44:58.766610 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.766596 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef\": container with ID starting with 2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef not found: ID does not exist" containerID="2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef" Sep 11 05:44:58.766661 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.766612 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef"} err="failed to get container status \"2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef\": rpc error: code = NotFound desc = could not find container \"2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef\": container with ID starting with 2846b6d463827e32b578de72cd81111b1099195b9766b4ca3e3e1f2643fb00ef not found: ID does not exist" Sep 11 05:44:58.766661 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.766623 2569 scope.go:117] "RemoveContainer" containerID="73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a" Sep 11 05:44:58.766843 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:44:58.766828 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a\": container with ID starting with 73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a not found: ID does not exist" containerID="73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a" Sep 11 05:44:58.766879 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:44:58.766845 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a"} err="failed to get container status \"73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a\": rpc error: code = NotFound desc = could not find container \"73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a\": container with ID starting with 73b8e742b9ffc64dd10a4fa947d72793191f525075f498f391453537cd00059a not found: ID does not exist" Sep 11 05:45:10.791816 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:10.791776 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:45:10.794185 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:10.794164 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:45:40.130751 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130666 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk"] Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130931 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="feast-apply" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130941 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="feast-apply" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130950 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="feast-apply" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130957 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="feast-apply" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130966 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130975 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130986 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.130993 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131003 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="feast-init" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131008 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="feast-init" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131016 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131021 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131026 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="feast-init" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131032 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="feast-init" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131037 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="registry" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131042 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="registry" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131048 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131053 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131058 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="offline" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131063 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="offline" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131072 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="offline" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131076 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="offline" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131120 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="online" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131127 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="registry" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131134 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="online" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131140 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="offline" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131145 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="ui" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131151 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cec3dcb-b6e1-463e-8c75-fde9b7bfab45" containerName="ui" Sep 11 05:45:40.131186 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.131156 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a711971-d8b9-4bee-8a42-079550c19594" containerName="offline" Sep 11 05:45:40.134349 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.134332 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.136413 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.136383 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xfhrk\"" Sep 11 05:45:40.136622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.136384 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 11 05:45:40.136622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.136424 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 11 05:45:40.136622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.136385 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 11 05:45:40.136622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.136606 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 11 05:45:40.136770 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.136705 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 11 05:45:40.137183 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.137163 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 11 05:45:40.144947 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.144923 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk"] Sep 11 05:45:40.283912 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.283882 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.284052 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.283935 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.284052 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.283975 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.284052 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.284021 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.284159 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.284055 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkz9m\" (UniqueName: \"kubernetes.io/projected/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-kube-api-access-dkz9m\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.284159 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.284080 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.384633 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.384558 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.384633 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.384594 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkz9m\" (UniqueName: \"kubernetes.io/projected/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-kube-api-access-dkz9m\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.384633 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.384616 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.384875 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.384657 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.384875 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.384701 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.384875 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.384716 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.384875 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:45:40.384700 2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 11 05:45:40.384875 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:45:40.384792 2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 11 05:45:40.384875 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:45:40.384851 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls podName:0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5 nodeName:}" failed. No retries permitted until 2026-09-11 05:45:40.884828826 +0000 UTC m=+1530.609008470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-5bjsk" (UID: "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5") : secret "feast-simple-feast-setup-ui-tls" not found Sep 11 05:45:40.384875 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:45:40.384871 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls podName:0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5 nodeName:}" failed. No retries permitted until 2026-09-11 05:45:40.884862474 +0000 UTC m=+1530.609042099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls") pod "feast-simple-feast-setup-57576b8fcf-5bjsk" (UID: "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5") : secret "feast-simple-feast-setup-online-tls" not found Sep 11 05:45:40.385208 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.384994 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.387096 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.387078 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.387244 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.387223 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.392937 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.392917 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkz9m\" (UniqueName: \"kubernetes.io/projected/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-kube-api-access-dkz9m\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.888086 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.888048 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.888280 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.888101 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.890578 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.890532 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:40.890743 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:40.890721 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-5bjsk\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:41.043452 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:41.043429 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:41.320741 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:41.320714 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk"] Sep 11 05:45:41.321591 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:45:41.321566 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d8bd16b_69ed_44f6_bf2a_5d51ba853eb5.slice/crio-a22ee6003288ca22d791491b77ebc2db70b25b540a5cd9e49d77f000f1818ec8 WatchSource:0}: Error finding container a22ee6003288ca22d791491b77ebc2db70b25b540a5cd9e49d77f000f1818ec8: Status 404 returned error can't find the container with id a22ee6003288ca22d791491b77ebc2db70b25b540a5cd9e49d77f000f1818ec8 Sep 11 05:45:41.838895 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:41.838863 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerStarted","Data":"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a"} Sep 11 05:45:41.838895 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:41.838906 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerStarted","Data":"a22ee6003288ca22d791491b77ebc2db70b25b540a5cd9e49d77f000f1818ec8"} Sep 11 05:45:46.857944 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:46.857907 2569 generic.go:356] "Generic (PLEG): container finished" podID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerID="0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a" exitCode=0 Sep 11 05:45:46.858365 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:46.857974 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerDied","Data":"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a"} Sep 11 05:45:47.863240 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:47.863208 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerStarted","Data":"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba"} Sep 11 05:45:52.891906 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:52.891813 2569 generic.go:356] "Generic (PLEG): container finished" podID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerID="3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba" exitCode=0 Sep 11 05:45:52.891906 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:52.891891 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerDied","Data":"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba"} Sep 11 05:45:53.901980 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:53.901940 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerStarted","Data":"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512"} Sep 11 05:45:53.902457 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:53.902004 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerStarted","Data":"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7"} Sep 11 05:45:53.902457 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:53.902029 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerStarted","Data":"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499"} Sep 11 05:45:53.902457 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:53.902048 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerStarted","Data":"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0"} Sep 11 05:45:53.926361 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:53.926279 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podStartSLOduration=13.926256745 podStartE2EDuration="13.926256745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:45:53.92319717 +0000 UTC m=+1543.647376815" watchObservedRunningTime="2026-09-11 05:45:53.926256745 +0000 UTC m=+1543.650436386" Sep 11 05:45:56.044017 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:56.043969 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:56.044504 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:56.044032 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:56.044504 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:56.044052 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:56.044504 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:56.044071 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:45:56.046098 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:56.046065 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 11 05:45:56.046300 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:56.046083 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Sep 11 05:45:56.046370 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:56.046129 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Sep 11 05:45:56.046428 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:56.046214 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 11 05:45:59.044270 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:59.044141 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 11 05:45:59.044270 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:59.044166 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 11 05:45:59.044270 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:59.044140 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.29:8816: connect: connection refused" Sep 11 05:45:59.044270 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:45:59.044140 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.29:6571: connect: connection refused" Sep 11 05:46:01.043534 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:01.043497 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:01.043906 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:01.043563 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:01.043906 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:01.043578 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:01.043906 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:01.043590 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:02.044906 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:02.044871 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:02.045296 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:02.044981 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:02.045296 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:02.045194 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:02.045730 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:02.045677 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:02.045890 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:02.045864 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:02.046077 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:02.046062 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:02.050320 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:02.050297 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:46:02.955532 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:46:02.955495 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:47:04.346423 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.346341 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk"] Sep 11 05:47:04.346982 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.346608 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="registry" containerID="cri-o://3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0" gracePeriod=30 Sep 11 05:47:04.346982 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.346684 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="offline" containerID="cri-o://6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7" gracePeriod=30 Sep 11 05:47:04.346982 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.346685 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" containerID="cri-o://09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512" gracePeriod=30 Sep 11 05:47:04.346982 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.346781 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" containerID="cri-o://d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499" gracePeriod=30 Sep 11 05:47:04.765936 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.765895 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8"] Sep 11 05:47:04.770584 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.770560 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:04.772654 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.772634 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xhwqr\"" Sep 11 05:47:04.780614 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.780585 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8"] Sep 11 05:47:04.900467 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.900436 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:04.900622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.900481 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2dp\" (UniqueName: \"kubernetes.io/projected/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-kube-api-access-qj2dp\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:04.900622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.900512 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:04.900707 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.900616 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:04.900707 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.900657 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:04.900707 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:04.900688 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.001607 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.001573 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.001775 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.001614 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2dp\" (UniqueName: \"kubernetes.io/projected/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-kube-api-access-qj2dp\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.001775 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.001641 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.001775 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.001687 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.001775 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.001725 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.002013 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:05.001809 2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 11 05:47:05.002013 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.001858 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.002013 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:05.001873 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls podName:a9fc455a-c3a8-46e1-b20e-1194673e2b6c nodeName:}" failed. No retries permitted until 2026-09-11 05:47:05.501848731 +0000 UTC m=+1615.226028377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls") pod "feast-simple-feast-setup-57576b8fcf-x7qd8" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c") : secret "feast-simple-feast-setup-online-tls" not found Sep 11 05:47:05.002013 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:05.001810 2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 11 05:47:05.002013 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:05.001810 2569 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 11 05:47:05.002013 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:05.001988 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls podName:a9fc455a-c3a8-46e1-b20e-1194673e2b6c nodeName:}" failed. No retries permitted until 2026-09-11 05:47:05.501950738 +0000 UTC m=+1615.226130377 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-x7qd8" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c") : secret "feast-simple-feast-setup-offline-tls" not found Sep 11 05:47:05.002013 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:05.002008 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls podName:a9fc455a-c3a8-46e1-b20e-1194673e2b6c nodeName:}" failed. No retries permitted until 2026-09-11 05:47:05.501999454 +0000 UTC m=+1615.226179088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-x7qd8" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c") : secret "feast-simple-feast-setup-registry-tls" not found Sep 11 05:47:05.002013 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.002012 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.004263 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.004239 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.011470 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.011447 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2dp\" (UniqueName: \"kubernetes.io/projected/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-kube-api-access-qj2dp\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.184331 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.184302 2569 generic.go:356] "Generic (PLEG): container finished" podID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerID="09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512" exitCode=0 Sep 11 05:47:05.184331 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.184327 2569 generic.go:356] "Generic (PLEG): container finished" podID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerID="d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499" exitCode=0 Sep 11 05:47:05.184483 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.184377 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerDied","Data":"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512"} Sep 11 05:47:05.184483 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.184409 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerDied","Data":"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499"} Sep 11 05:47:05.505890 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.505857 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.506241 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.505926 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.506241 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.505962 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.508332 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.508308 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.508530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.508508 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.508593 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.508508 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-x7qd8\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.681720 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.681687 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:05.957468 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:05.957438 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8"] Sep 11 05:47:05.959068 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:47:05.959040 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9fc455a_c3a8_46e1_b20e_1194673e2b6c.slice/crio-b7f644211edb7b9fdc05358da1b33aaa0c77ba94a517b7803fc742c3b34bb836 WatchSource:0}: Error finding container b7f644211edb7b9fdc05358da1b33aaa0c77ba94a517b7803fc742c3b34bb836: Status 404 returned error can't find the container with id b7f644211edb7b9fdc05358da1b33aaa0c77ba94a517b7803fc742c3b34bb836 Sep 11 05:47:06.190411 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:06.190371 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerStarted","Data":"3ac70ce9fb6f4ddda787556c2a11231c468c4b4f744b97a4119de64cfa0171d6"} Sep 11 05:47:06.190599 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:06.190425 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerStarted","Data":"b7f644211edb7b9fdc05358da1b33aaa0c77ba94a517b7803fc742c3b34bb836"} Sep 11 05:47:11.211017 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:11.210940 2569 generic.go:356] "Generic (PLEG): container finished" podID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerID="3ac70ce9fb6f4ddda787556c2a11231c468c4b4f744b97a4119de64cfa0171d6" exitCode=0 Sep 11 05:47:11.211017 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:11.211004 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerDied","Data":"3ac70ce9fb6f4ddda787556c2a11231c468c4b4f744b97a4119de64cfa0171d6"} Sep 11 05:47:12.046065 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:12.046018 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 11 05:47:12.217215 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:12.217182 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerStarted","Data":"d1c00646ead73a942be62cfe37739ea1f1a6a71134b51b24a32f0cf38eb788cc"} Sep 11 05:47:12.953348 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:12.953308 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 11 05:47:17.238742 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:17.238706 2569 generic.go:356] "Generic (PLEG): container finished" podID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerID="d1c00646ead73a942be62cfe37739ea1f1a6a71134b51b24a32f0cf38eb788cc" exitCode=0 Sep 11 05:47:17.239185 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:17.238757 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerDied","Data":"d1c00646ead73a942be62cfe37739ea1f1a6a71134b51b24a32f0cf38eb788cc"} Sep 11 05:47:18.249188 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:18.249145 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerStarted","Data":"adb3dd4306c049f57136a81ec12f9744599c782b0983061ce3013ca8d4458aac"} Sep 11 05:47:18.249682 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:18.249210 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerStarted","Data":"dac929af7c92fd8e825a077294895a91c0ef32daa628b224b7810518cbba207d"} Sep 11 05:47:18.249682 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:18.249229 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerStarted","Data":"e7b35a707f2da3337dfb8bdc2826c30c45b56ce3e50d7496fd3ad29ec0198023"} Sep 11 05:47:18.249682 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:18.249245 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerStarted","Data":"1d4ed5a9ff1ae99b7d6fe9a6d702387eb3c6f8e6e00c86a36d369e6f682eed77"} Sep 11 05:47:18.275211 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:18.275151 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podStartSLOduration=14.275130256 podStartE2EDuration="14.275130256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:47:18.272810533 +0000 UTC m=+1627.996990178" watchObservedRunningTime="2026-09-11 05:47:18.275130256 +0000 UTC m=+1627.999309902" Sep 11 05:47:20.682698 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:20.682663 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:20.683269 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:20.683243 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:20.683403 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:20.683277 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:20.683403 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:20.683295 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:20.684814 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:20.684782 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Sep 11 05:47:20.685013 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:20.684804 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused" Sep 11 05:47:20.685104 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:20.684837 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused" Sep 11 05:47:20.685104 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:20.684863 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Sep 11 05:47:22.046448 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:22.046403 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 11 05:47:22.952917 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:22.952868 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 11 05:47:23.682446 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:23.682397 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.30:6571: connect: connection refused" Sep 11 05:47:23.682955 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:23.682486 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.30:8816: connect: connection refused" Sep 11 05:47:23.682955 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:23.682398 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Sep 11 05:47:23.682955 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:23.682406 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Sep 11 05:47:25.682219 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:25.682185 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:25.682687 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:25.682230 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:25.682687 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:25.682245 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:25.682687 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:25.682257 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:26.682849 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:26.682813 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:26.683659 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:26.683633 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:26.683824 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:26.683813 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:26.688289 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:26.688263 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:27.297281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:27.297248 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:27.297532 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:27.297510 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:27.297622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:27.297600 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:27.300073 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:27.300052 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:47:32.046424 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:32.046377 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.29:8443: connect: connection refused" Sep 11 05:47:32.046927 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:32.046565 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:47:32.953077 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:32.953033 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" probeResult="failure" output="Get \"https://10.132.0.29:6567/health\": dial tcp 10.132.0.29:6567: connect: connection refused" Sep 11 05:47:32.953270 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:32.953137 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:47:34.997238 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:34.997214 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:47:35.062035 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.062006 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkz9m\" (UniqueName: \"kubernetes.io/projected/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-kube-api-access-dkz9m\") pod \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " Sep 11 05:47:35.062179 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.062042 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-registry-tls\") pod \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " Sep 11 05:47:35.062179 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.062084 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-offline-tls\") pod \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " Sep 11 05:47:35.062281 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.062261 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls\") pod \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " Sep 11 05:47:35.062346 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.062330 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls\") pod \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " Sep 11 05:47:35.062410 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.062353 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-feast-data\") pod \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\" (UID: \"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5\") " Sep 11 05:47:35.063076 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.063039 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-feast-data" (OuterVolumeSpecName: "feast-data") pod "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" (UID: "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 05:47:35.064398 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.064375 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" (UID: "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:47:35.064487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.064397 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" (UID: "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:47:35.064487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.064421 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls" (OuterVolumeSpecName: "online-tls") pod "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" (UID: "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:47:35.064487 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.064471 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" (UID: "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:47:35.064628 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.064603 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-kube-api-access-dkz9m" (OuterVolumeSpecName: "kube-api-access-dkz9m") pod "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" (UID: "0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5"). InnerVolumeSpecName "kube-api-access-dkz9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:47:35.163453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.163388 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-registry-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:47:35.163453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.163409 2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-offline-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:47:35.163453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.163418 2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-ui-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:47:35.163453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.163426 2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-online-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:47:35.163453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.163435 2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-feast-data\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:47:35.163453 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.163443 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkz9m\" (UniqueName: \"kubernetes.io/projected/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5-kube-api-access-dkz9m\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:47:35.333752 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.333722 2569 generic.go:356] "Generic (PLEG): container finished" podID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerID="6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7" exitCode=137 Sep 11 05:47:35.333752 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.333749 2569 generic.go:356] "Generic (PLEG): container finished" podID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerID="3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0" exitCode=137 Sep 11 05:47:35.333922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.333799 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" Sep 11 05:47:35.333922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.333805 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerDied","Data":"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7"} Sep 11 05:47:35.333922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.333851 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerDied","Data":"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0"} Sep 11 05:47:35.333922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.333866 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk" event={"ID":"0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5","Type":"ContainerDied","Data":"a22ee6003288ca22d791491b77ebc2db70b25b540a5cd9e49d77f000f1818ec8"} Sep 11 05:47:35.333922 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.333885 2569 scope.go:117] "RemoveContainer" containerID="09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512" Sep 11 05:47:35.342639 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.342624 2569 scope.go:117] "RemoveContainer" containerID="6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7" Sep 11 05:47:35.350130 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.350107 2569 scope.go:117] "RemoveContainer" containerID="d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499" Sep 11 05:47:35.355026 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.355007 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk"] Sep 11 05:47:35.357871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.357761 2569 scope.go:117] "RemoveContainer" containerID="3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0" Sep 11 05:47:35.358658 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.358640 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-5bjsk"] Sep 11 05:47:35.365038 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.365016 2569 scope.go:117] "RemoveContainer" containerID="3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba" Sep 11 05:47:35.371680 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.371660 2569 scope.go:117] "RemoveContainer" containerID="0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a" Sep 11 05:47:35.378155 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.378140 2569 scope.go:117] "RemoveContainer" containerID="09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512" Sep 11 05:47:35.378388 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:35.378370 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512\": container with ID starting with 09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512 not found: ID does not exist" containerID="09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512" Sep 11 05:47:35.378448 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.378393 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512"} err="failed to get container status \"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512\": rpc error: code = NotFound desc = could not find container \"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512\": container with ID starting with 09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512 not found: ID does not exist" Sep 11 05:47:35.378448 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.378409 2569 scope.go:117] "RemoveContainer" containerID="6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7" Sep 11 05:47:35.378676 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:35.378661 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7\": container with ID starting with 6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7 not found: ID does not exist" containerID="6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7" Sep 11 05:47:35.378720 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.378679 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7"} err="failed to get container status \"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7\": rpc error: code = NotFound desc = could not find container \"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7\": container with ID starting with 6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7 not found: ID does not exist" Sep 11 05:47:35.378720 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.378693 2569 scope.go:117] "RemoveContainer" containerID="d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499" Sep 11 05:47:35.378881 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:35.378868 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499\": container with ID starting with d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499 not found: ID does not exist" containerID="d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499" Sep 11 05:47:35.378926 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.378884 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499"} err="failed to get container status \"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499\": rpc error: code = NotFound desc = could not find container \"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499\": container with ID starting with d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499 not found: ID does not exist" Sep 11 05:47:35.378926 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.378896 2569 scope.go:117] "RemoveContainer" containerID="3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0" Sep 11 05:47:35.379082 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:35.379068 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0\": container with ID starting with 3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0 not found: ID does not exist" containerID="3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0" Sep 11 05:47:35.379121 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.379086 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0"} err="failed to get container status \"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0\": rpc error: code = NotFound desc = could not find container \"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0\": container with ID starting with 3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0 not found: ID does not exist" Sep 11 05:47:35.379121 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.379096 2569 scope.go:117] "RemoveContainer" containerID="3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba" Sep 11 05:47:35.379299 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:35.379285 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba\": container with ID starting with 3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba not found: ID does not exist" containerID="3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba" Sep 11 05:47:35.379337 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.379301 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba"} err="failed to get container status \"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba\": rpc error: code = NotFound desc = could not find container \"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba\": container with ID starting with 3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba not found: ID does not exist" Sep 11 05:47:35.379337 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.379312 2569 scope.go:117] "RemoveContainer" containerID="0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a" Sep 11 05:47:35.379556 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:47:35.379528 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a\": container with ID starting with 0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a not found: ID does not exist" containerID="0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a" Sep 11 05:47:35.379601 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.379559 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a"} err="failed to get container status \"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a\": rpc error: code = NotFound desc = could not find container \"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a\": container with ID starting with 0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a not found: ID does not exist" Sep 11 05:47:35.379601 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.379573 2569 scope.go:117] "RemoveContainer" containerID="09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512" Sep 11 05:47:35.379813 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.379797 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512"} err="failed to get container status \"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512\": rpc error: code = NotFound desc = could not find container \"09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512\": container with ID starting with 09e5ad7746ea2c3543aff6c559cb2cac7fb116d003a67378e7c5a74f8c81a512 not found: ID does not exist" Sep 11 05:47:35.379854 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.379813 2569 scope.go:117] "RemoveContainer" containerID="6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7" Sep 11 05:47:35.380020 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380003 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7"} err="failed to get container status \"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7\": rpc error: code = NotFound desc = could not find container \"6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7\": container with ID starting with 6fa63782cd5963d0c1b1b1908f11b22bee81945a06c833a9ee4c5d9ebc8434a7 not found: ID does not exist" Sep 11 05:47:35.380020 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380020 2569 scope.go:117] "RemoveContainer" containerID="d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499" Sep 11 05:47:35.380214 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380197 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499"} err="failed to get container status \"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499\": rpc error: code = NotFound desc = could not find container \"d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499\": container with ID starting with d8d6040e1695c2b9b3cd17f8beba483d20e0dfe53f399c75235b66148347d499 not found: ID does not exist" Sep 11 05:47:35.380256 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380214 2569 scope.go:117] "RemoveContainer" containerID="3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0" Sep 11 05:47:35.380416 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380399 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0"} err="failed to get container status \"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0\": rpc error: code = NotFound desc = could not find container \"3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0\": container with ID starting with 3d24d94cb914f037799e8171cf42d85d24bea1555afe87d15a3686a88aa3d0d0 not found: ID does not exist" Sep 11 05:47:35.380416 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380415 2569 scope.go:117] "RemoveContainer" containerID="3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba" Sep 11 05:47:35.380631 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380616 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba"} err="failed to get container status \"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba\": rpc error: code = NotFound desc = could not find container \"3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba\": container with ID starting with 3ba917268c3f8fff6542885ad3fc63609866bf3aad5138e4a4265d24e7a6e5ba not found: ID does not exist" Sep 11 05:47:35.380631 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380631 2569 scope.go:117] "RemoveContainer" containerID="0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a" Sep 11 05:47:35.380838 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:35.380822 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a"} err="failed to get container status \"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a\": rpc error: code = NotFound desc = could not find container \"0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a\": container with ID starting with 0c5111b42e8ab7e8933cc070460e549ff843057e122da66dcf78b5265b3c170a not found: ID does not exist" Sep 11 05:47:36.761747 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:47:36.761714 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" path="/var/lib/kubelet/pods/0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5/volumes" Sep 11 05:48:29.602781 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.602752 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh"] Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603007 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="registry" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603018 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="registry" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603025 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603032 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603046 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="feast-apply" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603051 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="feast-apply" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603062 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="offline" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603067 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="offline" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603079 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="feast-init" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603085 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="feast-init" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603091 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603096 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603145 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="offline" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603154 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="ui" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603159 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="registry" Sep 11 05:48:29.603158 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.603166 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8bd16b-69ed-44f6-bf2a-5d51ba853eb5" containerName="online" Sep 11 05:48:29.606307 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.606289 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.608713 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.608691 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 11 05:48:29.608827 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.608798 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 11 05:48:29.608883 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.608839 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 11 05:48:29.608938 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.608927 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 11 05:48:29.608994 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.608967 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 11 05:48:29.609084 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.609024 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-dvwzz\"" Sep 11 05:48:29.609084 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.609038 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 11 05:48:29.616790 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.616757 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh"] Sep 11 05:48:29.656523 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.656499 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.656662 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.656528 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d42c4ad-4506-404c-be52-0c9e4f0adb08-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.656662 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.656568 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d42c4ad-4506-404c-be52-0c9e4f0adb08-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.656662 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.656619 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.656662 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.656642 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmcv\" (UniqueName: \"kubernetes.io/projected/3d42c4ad-4506-404c-be52-0c9e4f0adb08-kube-api-access-5gmcv\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.656800 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.656673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.757638 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.757613 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.757762 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.757651 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmcv\" (UniqueName: \"kubernetes.io/projected/3d42c4ad-4506-404c-be52-0c9e4f0adb08-kube-api-access-5gmcv\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.757762 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.757674 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.757762 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.757729 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.757762 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.757754 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d42c4ad-4506-404c-be52-0c9e4f0adb08-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.757903 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:48:29.757768 2569 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 11 05:48:29.757903 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:48:29.757842 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls podName:3d42c4ad-4506-404c-be52-0c9e4f0adb08 nodeName:}" failed. No retries permitted until 2026-09-11 05:48:30.257824359 +0000 UTC m=+1699.982004048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" (UID: "3d42c4ad-4506-404c-be52-0c9e4f0adb08") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 11 05:48:29.757903 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:48:29.757846 2569 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 11 05:48:29.758005 ip-10-0-138-238 kubenswrapper[2569]: E0911 05:48:29.757920 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls podName:3d42c4ad-4506-404c-be52-0c9e4f0adb08 nodeName:}" failed. No retries permitted until 2026-09-11 05:48:30.25790238 +0000 UTC m=+1699.982082013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" (UID: "3d42c4ad-4506-404c-be52-0c9e4f0adb08") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 11 05:48:29.758005 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.757915 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d42c4ad-4506-404c-be52-0c9e4f0adb08-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.758227 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.758200 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d42c4ad-4506-404c-be52-0c9e4f0adb08-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.758421 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.758404 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d42c4ad-4506-404c-be52-0c9e4f0adb08-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.760084 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.760061 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:29.765818 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:29.765797 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmcv\" (UniqueName: \"kubernetes.io/projected/3d42c4ad-4506-404c-be52-0c9e4f0adb08-kube-api-access-5gmcv\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:30.261347 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:30.261305 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:30.261533 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:30.261374 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:30.263696 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:30.263674 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:30.263844 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:30.263823 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-gwkjh\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:30.515062 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:30.514979 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:48:30.789480 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:30.789454 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh"] Sep 11 05:48:30.791867 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:48:30.791835 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d42c4ad_4506_404c_be52_0c9e4f0adb08.slice/crio-ad707d9f90a1b27d5860826061de8b94eef332a5fe9faa6e3c7141b7129592d7 WatchSource:0}: Error finding container ad707d9f90a1b27d5860826061de8b94eef332a5fe9faa6e3c7141b7129592d7: Status 404 returned error can't find the container with id ad707d9f90a1b27d5860826061de8b94eef332a5fe9faa6e3c7141b7129592d7 Sep 11 05:48:31.550047 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:31.550015 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerStarted","Data":"f72365ffbebb04c37c42b26fc8765d1142cbacf4bcb3290ad282aa5a4010f2f2"} Sep 11 05:48:31.550207 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:31.550059 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerStarted","Data":"ad707d9f90a1b27d5860826061de8b94eef332a5fe9faa6e3c7141b7129592d7"} Sep 11 05:48:36.572842 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:36.572812 2569 generic.go:356] "Generic (PLEG): container finished" podID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerID="f72365ffbebb04c37c42b26fc8765d1142cbacf4bcb3290ad282aa5a4010f2f2" exitCode=0 Sep 11 05:48:36.573249 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:36.572848 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerDied","Data":"f72365ffbebb04c37c42b26fc8765d1142cbacf4bcb3290ad282aa5a4010f2f2"} Sep 11 05:48:37.578389 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:37.578357 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerStarted","Data":"97310e7818b6265cdf6393786574b6a393cccc422c10161c7634818bd87a9584"} Sep 11 05:48:58.662254 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:58.662213 2569 generic.go:356] "Generic (PLEG): container finished" podID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerID="97310e7818b6265cdf6393786574b6a393cccc422c10161c7634818bd87a9584" exitCode=0 Sep 11 05:48:58.662707 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:58.662285 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerDied","Data":"97310e7818b6265cdf6393786574b6a393cccc422c10161c7634818bd87a9584"} Sep 11 05:48:59.671505 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:59.671468 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerStarted","Data":"6c9c1ce9123c6410080c41c258b87ca5aab27678ab84d3a108e0a25e27f76ef2"} Sep 11 05:48:59.672029 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:59.671518 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerStarted","Data":"650a958531057499d377738a427af213acb7b69ed67eecb51320ceaa88226fa0"} Sep 11 05:48:59.672029 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:59.671531 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerStarted","Data":"a2fdb95cba9b21ab1ce8f7a209304fac23fbeaf02eebaec576d73714f779a8e6"} Sep 11 05:48:59.692708 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:48:59.692622 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podStartSLOduration=30.692608174 podStartE2EDuration="30.692608174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:48:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:48:59.691478611 +0000 UTC m=+1729.415658255" watchObservedRunningTime="2026-09-11 05:48:59.692608174 +0000 UTC m=+1729.416787818" Sep 11 05:49:00.515580 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.515518 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:00.515764 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.515598 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:00.515764 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.515622 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:00.515764 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.515658 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:00.515764 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.515677 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:00.515764 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.515692 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:00.517558 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.517502 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused" Sep 11 05:49:00.517696 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.517515 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 11 05:49:00.517696 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:00.517568 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 11 05:49:03.515585 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:03.515514 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 11 05:49:03.515585 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:03.515565 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 11 05:49:03.516225 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:03.515525 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.31:8816: connect: connection refused" Sep 11 05:49:06.515478 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:06.515430 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 11 05:49:06.515923 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:06.515441 2569 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 11 05:49:06.516265 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:06.516243 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:06.517191 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:06.517170 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:09.515903 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:09.515862 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:09.516694 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:09.516671 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:10.228903 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:10.228869 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:49:11.519706 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:11.519655 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 11 05:49:12.524671 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:12.524633 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 11 05:49:22.223161 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:49:22.223124 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:50:10.817448 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:10.817419 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:50:10.820644 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:10.820618 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:50:23.546646 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.546610 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh"] Sep 11 05:50:23.547159 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.546840 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" containerID="cri-o://a2fdb95cba9b21ab1ce8f7a209304fac23fbeaf02eebaec576d73714f779a8e6" gracePeriod=30 Sep 11 05:50:23.547159 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.546926 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" containerID="cri-o://6c9c1ce9123c6410080c41c258b87ca5aab27678ab84d3a108e0a25e27f76ef2" gracePeriod=30 Sep 11 05:50:23.547159 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.547056 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="offline" containerID="cri-o://650a958531057499d377738a427af213acb7b69ed67eecb51320ceaa88226fa0" gracePeriod=30 Sep 11 05:50:23.723912 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.723880 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8"] Sep 11 05:50:23.724336 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.724119 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="registry" containerID="cri-o://1d4ed5a9ff1ae99b7d6fe9a6d702387eb3c6f8e6e00c86a36d369e6f682eed77" gracePeriod=30 Sep 11 05:50:23.724336 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.724203 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" containerID="cri-o://e7b35a707f2da3337dfb8bdc2826c30c45b56ce3e50d7496fd3ad29ec0198023" gracePeriod=30 Sep 11 05:50:23.724336 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.724204 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="offline" containerID="cri-o://dac929af7c92fd8e825a077294895a91c0ef32daa628b224b7810518cbba207d" gracePeriod=30 Sep 11 05:50:23.724336 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:23.724307 2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" containerID="cri-o://adb3dd4306c049f57136a81ec12f9744599c782b0983061ce3013ca8d4458aac" gracePeriod=30 Sep 11 05:50:25.015319 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:25.015279 2569 generic.go:356] "Generic (PLEG): container finished" podID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerID="6c9c1ce9123c6410080c41c258b87ca5aab27678ab84d3a108e0a25e27f76ef2" exitCode=0 Sep 11 05:50:25.015319 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:25.015312 2569 generic.go:356] "Generic (PLEG): container finished" podID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerID="a2fdb95cba9b21ab1ce8f7a209304fac23fbeaf02eebaec576d73714f779a8e6" exitCode=0 Sep 11 05:50:25.015836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:25.015350 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerDied","Data":"6c9c1ce9123c6410080c41c258b87ca5aab27678ab84d3a108e0a25e27f76ef2"} Sep 11 05:50:25.015836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:25.015393 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerDied","Data":"a2fdb95cba9b21ab1ce8f7a209304fac23fbeaf02eebaec576d73714f779a8e6"} Sep 11 05:50:25.018322 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:25.018301 2569 generic.go:356] "Generic (PLEG): container finished" podID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerID="adb3dd4306c049f57136a81ec12f9744599c782b0983061ce3013ca8d4458aac" exitCode=0 Sep 11 05:50:25.018322 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:25.018319 2569 generic.go:356] "Generic (PLEG): container finished" podID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerID="e7b35a707f2da3337dfb8bdc2826c30c45b56ce3e50d7496fd3ad29ec0198023" exitCode=0 Sep 11 05:50:25.018476 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:25.018353 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerDied","Data":"adb3dd4306c049f57136a81ec12f9744599c782b0983061ce3013ca8d4458aac"} Sep 11 05:50:25.018476 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:25.018378 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerDied","Data":"e7b35a707f2da3337dfb8bdc2826c30c45b56ce3e50d7496fd3ad29ec0198023"} Sep 11 05:50:27.297806 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:27.297759 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Sep 11 05:50:27.297806 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:27.297795 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Sep 11 05:50:29.516749 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:29.516703 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 11 05:50:31.520485 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:31.520442 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 11 05:50:37.297813 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:37.297769 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Sep 11 05:50:37.298231 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:37.297774 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Sep 11 05:50:39.516864 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:39.516816 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 11 05:50:41.521001 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:41.520957 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 11 05:50:47.297055 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:47.297006 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.30:8443: connect: connection refused" Sep 11 05:50:47.297055 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:47.297028 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.30:6567/health\": dial tcp 10.132.0.30:6567: connect: connection refused" Sep 11 05:50:47.297638 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:47.297160 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:50:47.297638 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:47.297320 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:50:49.516777 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:49.516738 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.31:8443: connect: connection refused" Sep 11 05:50:49.517141 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:49.516856 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:50:51.520863 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:51.520821 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 11 05:50:51.521254 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:51.520964 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:50:54.138446 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.138417 2569 generic.go:356] "Generic (PLEG): container finished" podID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerID="dac929af7c92fd8e825a077294895a91c0ef32daa628b224b7810518cbba207d" exitCode=137 Sep 11 05:50:54.138446 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.138442 2569 generic.go:356] "Generic (PLEG): container finished" podID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerID="1d4ed5a9ff1ae99b7d6fe9a6d702387eb3c6f8e6e00c86a36d369e6f682eed77" exitCode=137 Sep 11 05:50:54.138917 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.138507 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerDied","Data":"dac929af7c92fd8e825a077294895a91c0ef32daa628b224b7810518cbba207d"} Sep 11 05:50:54.138917 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.138579 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerDied","Data":"1d4ed5a9ff1ae99b7d6fe9a6d702387eb3c6f8e6e00c86a36d369e6f682eed77"} Sep 11 05:50:54.141429 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.141407 2569 generic.go:356] "Generic (PLEG): container finished" podID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerID="650a958531057499d377738a427af213acb7b69ed67eecb51320ceaa88226fa0" exitCode=137 Sep 11 05:50:54.141534 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.141470 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerDied","Data":"650a958531057499d377738a427af213acb7b69ed67eecb51320ceaa88226fa0"} Sep 11 05:50:54.188695 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.188669 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:50:54.276872 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.276842 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d42c4ad-4506-404c-be52-0c9e4f0adb08-registry-tls\") pod \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " Sep 11 05:50:54.277019 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.276888 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d42c4ad-4506-404c-be52-0c9e4f0adb08-feast-data\") pod \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " Sep 11 05:50:54.277019 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.276944 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gmcv\" (UniqueName: \"kubernetes.io/projected/3d42c4ad-4506-404c-be52-0c9e4f0adb08-kube-api-access-5gmcv\") pod \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " Sep 11 05:50:54.277019 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.276981 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls\") pod \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " Sep 11 05:50:54.277019 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.277001 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-ui-tls\") pod \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " Sep 11 05:50:54.277210 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.277024 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls\") pod \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\" (UID: \"3d42c4ad-4506-404c-be52-0c9e4f0adb08\") " Sep 11 05:50:54.277455 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.277428 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d42c4ad-4506-404c-be52-0c9e4f0adb08-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3d42c4ad-4506-404c-be52-0c9e4f0adb08" (UID: "3d42c4ad-4506-404c-be52-0c9e4f0adb08"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 11 05:50:54.277586 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.277523 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d42c4ad-4506-404c-be52-0c9e4f0adb08-feast-data" (OuterVolumeSpecName: "feast-data") pod "3d42c4ad-4506-404c-be52-0c9e4f0adb08" (UID: "3d42c4ad-4506-404c-be52-0c9e4f0adb08"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 05:50:54.279309 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.279276 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3d42c4ad-4506-404c-be52-0c9e4f0adb08" (UID: "3d42c4ad-4506-404c-be52-0c9e4f0adb08"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:50:54.279309 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.279291 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d42c4ad-4506-404c-be52-0c9e4f0adb08-kube-api-access-5gmcv" (OuterVolumeSpecName: "kube-api-access-5gmcv") pod "3d42c4ad-4506-404c-be52-0c9e4f0adb08" (UID: "3d42c4ad-4506-404c-be52-0c9e4f0adb08"). InnerVolumeSpecName "kube-api-access-5gmcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:50:54.279464 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.279439 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls" (OuterVolumeSpecName: "online-tls") pod "3d42c4ad-4506-404c-be52-0c9e4f0adb08" (UID: "3d42c4ad-4506-404c-be52-0c9e4f0adb08"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:50:54.279513 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.279460 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3d42c4ad-4506-404c-be52-0c9e4f0adb08" (UID: "3d42c4ad-4506-404c-be52-0c9e4f0adb08"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:50:54.362994 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.362972 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:50:54.377934 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.377905 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-ui-tls\") pod \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " Sep 11 05:50:54.378007 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.377967 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-feast-data\") pod \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " Sep 11 05:50:54.378073 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378054 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls\") pod \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " Sep 11 05:50:54.378119 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378092 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls\") pod \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " Sep 11 05:50:54.378174 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378120 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls\") pod \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " Sep 11 05:50:54.378174 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378145 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj2dp\" (UniqueName: \"kubernetes.io/projected/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-kube-api-access-qj2dp\") pod \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\" (UID: \"a9fc455a-c3a8-46e1-b20e-1194673e2b6c\") " Sep 11 05:50:54.378388 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378364 2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3d42c4ad-4506-404c-be52-0c9e4f0adb08-feast-data\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.378503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378392 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gmcv\" (UniqueName: \"kubernetes.io/projected/3d42c4ad-4506-404c-be52-0c9e4f0adb08-kube-api-access-5gmcv\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.378503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378408 2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-online-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.378503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378421 2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-ui-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.378503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378434 2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3d42c4ad-4506-404c-be52-0c9e4f0adb08-offline-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.378503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378436 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-feast-data" (OuterVolumeSpecName: "feast-data") pod "a9fc455a-c3a8-46e1-b20e-1194673e2b6c" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 11 05:50:54.378503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.378445 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/3d42c4ad-4506-404c-be52-0c9e4f0adb08-registry-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.380133 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.380097 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a9fc455a-c3a8-46e1-b20e-1194673e2b6c" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:50:54.380224 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.380151 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls" (OuterVolumeSpecName: "online-tls") pod "a9fc455a-c3a8-46e1-b20e-1194673e2b6c" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:50:54.380270 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.380226 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-kube-api-access-qj2dp" (OuterVolumeSpecName: "kube-api-access-qj2dp") pod "a9fc455a-c3a8-46e1-b20e-1194673e2b6c" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c"). InnerVolumeSpecName "kube-api-access-qj2dp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 11 05:50:54.380427 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.380402 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a9fc455a-c3a8-46e1-b20e-1194673e2b6c" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:50:54.380427 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.380412 2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a9fc455a-c3a8-46e1-b20e-1194673e2b6c" (UID: "a9fc455a-c3a8-46e1-b20e-1194673e2b6c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 11 05:50:54.479669 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.479645 2569 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-online-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.479669 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.479667 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj2dp\" (UniqueName: \"kubernetes.io/projected/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-kube-api-access-qj2dp\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.479838 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.479677 2569 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-ui-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.479838 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.479686 2569 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-feast-data\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.479838 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.479695 2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-registry-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:54.479838 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:54.479702 2569 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a9fc455a-c3a8-46e1-b20e-1194673e2b6c-offline-tls\") on node \"ip-10-0-138-238.ec2.internal\" DevicePath \"\"" Sep 11 05:50:55.148613 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.148522 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" Sep 11 05:50:55.148613 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.148556 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8" event={"ID":"a9fc455a-c3a8-46e1-b20e-1194673e2b6c","Type":"ContainerDied","Data":"b7f644211edb7b9fdc05358da1b33aaa0c77ba94a517b7803fc742c3b34bb836"} Sep 11 05:50:55.148613 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.148613 2569 scope.go:117] "RemoveContainer" containerID="adb3dd4306c049f57136a81ec12f9744599c782b0983061ce3013ca8d4458aac" Sep 11 05:50:55.151613 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.151590 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" event={"ID":"3d42c4ad-4506-404c-be52-0c9e4f0adb08","Type":"ContainerDied","Data":"ad707d9f90a1b27d5860826061de8b94eef332a5fe9faa6e3c7141b7129592d7"} Sep 11 05:50:55.151729 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.151669 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh" Sep 11 05:50:55.157737 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.157720 2569 scope.go:117] "RemoveContainer" containerID="dac929af7c92fd8e825a077294895a91c0ef32daa628b224b7810518cbba207d" Sep 11 05:50:55.165130 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.165114 2569 scope.go:117] "RemoveContainer" containerID="e7b35a707f2da3337dfb8bdc2826c30c45b56ce3e50d7496fd3ad29ec0198023" Sep 11 05:50:55.171838 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.171806 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8"] Sep 11 05:50:55.173188 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.173169 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-x7qd8"] Sep 11 05:50:55.173354 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.173342 2569 scope.go:117] "RemoveContainer" containerID="1d4ed5a9ff1ae99b7d6fe9a6d702387eb3c6f8e6e00c86a36d369e6f682eed77" Sep 11 05:50:55.180710 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.180692 2569 scope.go:117] "RemoveContainer" containerID="d1c00646ead73a942be62cfe37739ea1f1a6a71134b51b24a32f0cf38eb788cc" Sep 11 05:50:55.185693 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.185674 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh"] Sep 11 05:50:55.187855 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.187841 2569 scope.go:117] "RemoveContainer" containerID="3ac70ce9fb6f4ddda787556c2a11231c468c4b4f744b97a4119de64cfa0171d6" Sep 11 05:50:55.191478 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.191458 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-gwkjh"] Sep 11 05:50:55.194721 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.194704 2569 scope.go:117] "RemoveContainer" containerID="6c9c1ce9123c6410080c41c258b87ca5aab27678ab84d3a108e0a25e27f76ef2" Sep 11 05:50:55.201167 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.201148 2569 scope.go:117] "RemoveContainer" containerID="650a958531057499d377738a427af213acb7b69ed67eecb51320ceaa88226fa0" Sep 11 05:50:55.207948 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.207931 2569 scope.go:117] "RemoveContainer" containerID="a2fdb95cba9b21ab1ce8f7a209304fac23fbeaf02eebaec576d73714f779a8e6" Sep 11 05:50:55.216213 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.216194 2569 scope.go:117] "RemoveContainer" containerID="97310e7818b6265cdf6393786574b6a393cccc422c10161c7634818bd87a9584" Sep 11 05:50:55.222679 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:55.222662 2569 scope.go:117] "RemoveContainer" containerID="f72365ffbebb04c37c42b26fc8765d1142cbacf4bcb3290ad282aa5a4010f2f2" Sep 11 05:50:56.761738 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:56.761705 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" path="/var/lib/kubelet/pods/3d42c4ad-4506-404c-be52-0c9e4f0adb08/volumes" Sep 11 05:50:56.762436 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:50:56.762413 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" path="/var/lib/kubelet/pods/a9fc455a-c3a8-46e1-b20e-1194673e2b6c/volumes" Sep 11 05:51:30.112394 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112358 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbwzt/must-gather-c8h2p"] Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112626 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="feast-apply" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112638 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="feast-apply" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112647 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="feast-init" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112652 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="feast-init" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112660 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="feast-apply" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112666 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="feast-apply" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112672 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112677 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112688 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="registry" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112693 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="registry" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112703 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112707 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112712 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="offline" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112717 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="offline" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112722 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="offline" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112727 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="offline" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112733 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112738 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112746 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112752 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112762 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="feast-init" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112767 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="feast-init" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112821 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="offline" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112829 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="registry" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112835 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="offline" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112840 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="online" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112845 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9fc455a-c3a8-46e1-b20e-1194673e2b6c" containerName="ui" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112852 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="ui" Sep 11 05:51:30.112871 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.112857 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d42c4ad-4506-404c-be52-0c9e4f0adb08" containerName="online" Sep 11 05:51:30.115826 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.115806 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbwzt/must-gather-c8h2p" Sep 11 05:51:30.119132 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.119113 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gbwzt\"/\"default-dockercfg-m9v22\"" Sep 11 05:51:30.120867 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.120843 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbwzt\"/\"openshift-service-ca.crt\"" Sep 11 05:51:30.121133 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.121117 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gbwzt\"/\"kube-root-ca.crt\"" Sep 11 05:51:30.136313 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.136279 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbwzt/must-gather-c8h2p"] Sep 11 05:51:30.226503 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.226459 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjczh\" (UniqueName: \"kubernetes.io/projected/b7031d9f-9b8f-40ee-87f1-d5b386c9dd57-kube-api-access-jjczh\") pod \"must-gather-c8h2p\" (UID: \"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57\") " pod="openshift-must-gather-gbwzt/must-gather-c8h2p" Sep 11 05:51:30.226722 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.226592 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7031d9f-9b8f-40ee-87f1-d5b386c9dd57-must-gather-output\") pod \"must-gather-c8h2p\" (UID: \"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57\") " pod="openshift-must-gather-gbwzt/must-gather-c8h2p" Sep 11 05:51:30.327288 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.327254 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7031d9f-9b8f-40ee-87f1-d5b386c9dd57-must-gather-output\") pod \"must-gather-c8h2p\" (UID: \"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57\") " pod="openshift-must-gather-gbwzt/must-gather-c8h2p" Sep 11 05:51:30.327454 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.327302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjczh\" (UniqueName: \"kubernetes.io/projected/b7031d9f-9b8f-40ee-87f1-d5b386c9dd57-kube-api-access-jjczh\") pod \"must-gather-c8h2p\" (UID: \"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57\") " pod="openshift-must-gather-gbwzt/must-gather-c8h2p" Sep 11 05:51:30.327649 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.327623 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/b7031d9f-9b8f-40ee-87f1-d5b386c9dd57-must-gather-output\") pod \"must-gather-c8h2p\" (UID: \"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57\") " pod="openshift-must-gather-gbwzt/must-gather-c8h2p" Sep 11 05:51:30.334766 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.334739 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjczh\" (UniqueName: \"kubernetes.io/projected/b7031d9f-9b8f-40ee-87f1-d5b386c9dd57-kube-api-access-jjczh\") pod \"must-gather-c8h2p\" (UID: \"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57\") " pod="openshift-must-gather-gbwzt/must-gather-c8h2p" Sep 11 05:51:30.425018 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.424945 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbwzt/must-gather-c8h2p" Sep 11 05:51:30.694377 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.694352 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbwzt/must-gather-c8h2p"] Sep 11 05:51:30.699592 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:51:30.699496 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7031d9f_9b8f_40ee_87f1_d5b386c9dd57.slice/crio-fc74427991695841ff7691da4fea72f114f2b0b4093de81d27a301e872211054 WatchSource:0}: Error finding container fc74427991695841ff7691da4fea72f114f2b0b4093de81d27a301e872211054: Status 404 returned error can't find the container with id fc74427991695841ff7691da4fea72f114f2b0b4093de81d27a301e872211054 Sep 11 05:51:30.700982 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:30.700963 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 11 05:51:31.296172 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:31.296130 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbwzt/must-gather-c8h2p" event={"ID":"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57","Type":"ContainerStarted","Data":"fc74427991695841ff7691da4fea72f114f2b0b4093de81d27a301e872211054"} Sep 11 05:51:35.312383 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:35.312339 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbwzt/must-gather-c8h2p" event={"ID":"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57","Type":"ContainerStarted","Data":"5cfedb6e9cfb61f636cea7c34c9ee6d3360337bbc39dcb1b72c73eec4f2cad24"} Sep 11 05:51:35.312383 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:35.312386 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbwzt/must-gather-c8h2p" event={"ID":"b7031d9f-9b8f-40ee-87f1-d5b386c9dd57","Type":"ContainerStarted","Data":"360a4bdd72c603a403609ddd1da333c93863a1fb60ecdf3c1ad7b1ec7b18d469"} Sep 11 05:51:35.326904 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:35.326849 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gbwzt/must-gather-c8h2p" podStartSLOduration=1.241800809 podStartE2EDuration="5.326828829s" totalImagesPullingTime="4.08502802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 05:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:51:35.325945455 +0000 UTC m=+1885.050125099" watchObservedRunningTime="2026-09-11 05:51:35.326828829 +0000 UTC m=+1885.051008474" Sep 11 05:51:36.306211 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:36.306178 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l5k7k_00440703-718d-4501-9ff5-1d00f39b4ec3/global-pull-secret-syncer/0.log" Sep 11 05:51:36.412385 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:36.412353 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ww299_db6b5a4e-5ed2-40f7-af21-222e80b573f9/konnectivity-agent/0.log" Sep 11 05:51:36.477414 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:36.477386 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-238.ec2.internal_ad58f719ce68c03137c90aff08168b70/haproxy/0.log" Sep 11 05:51:39.661197 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:39.661146 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-g95w2_97bc18e9-1612-4bc1-acc2-1e0bcc5394b8/cluster-monitoring-operator/0.log" Sep 11 05:51:39.973789 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:39.973761 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn94f_1d5cdec0-76e5-4a22-b488-e509a63877d6/node-exporter/0.log" Sep 11 05:51:40.002405 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:40.002377 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn94f_1d5cdec0-76e5-4a22-b488-e509a63877d6/kube-rbac-proxy/0.log" Sep 11 05:51:40.026901 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:40.026873 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gn94f_1d5cdec0-76e5-4a22-b488-e509a63877d6/init-textfile/0.log" Sep 11 05:51:42.490423 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:42.490391 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/1.log" Sep 11 05:51:42.497865 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:42.497835 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-zrtx2_f933e7e1-994e-453c-a52a-74349bdc41d3/console-operator/2.log" Sep 11 05:51:42.895836 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:42.895753 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-85d959b7c9-7mhsk_b2fc11eb-7adf-4daf-89f0-b51f0e071d2e/console/0.log" Sep 11 05:51:43.425458 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.425423 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-vnfwq_a478863e-495d-4f6d-9500-770a4eea85bd/volume-data-source-validator/0.log" Sep 11 05:51:43.648665 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.648631 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6"] Sep 11 05:51:43.654603 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.654569 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.661231 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.661206 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6"] Sep 11 05:51:43.734351 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.734314 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-lib-modules\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.734530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.734366 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbslk\" (UniqueName: \"kubernetes.io/projected/8a2941ad-e1df-4da0-898a-f4d244e91688-kube-api-access-zbslk\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.734530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.734392 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-proc\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.734530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.734433 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-sys\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.734530 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.734460 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-podres\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.835840 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.835798 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-lib-modules\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.836823 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.836081 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-lib-modules\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.836964 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.836843 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbslk\" (UniqueName: \"kubernetes.io/projected/8a2941ad-e1df-4da0-898a-f4d244e91688-kube-api-access-zbslk\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.836964 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.836886 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-proc\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.836964 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.836914 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-sys\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.836964 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.836960 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-podres\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.837176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.836967 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-proc\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.837176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.837055 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-podres\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.837176 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.837062 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a2941ad-e1df-4da0-898a-f4d244e91688-sys\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.845445 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.845419 2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbslk\" (UniqueName: \"kubernetes.io/projected/8a2941ad-e1df-4da0-898a-f4d244e91688-kube-api-access-zbslk\") pod \"perf-node-gather-daemonset-ws2p6\" (UID: \"8a2941ad-e1df-4da0-898a-f4d244e91688\") " pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:43.979427 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:43.979392 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:44.266051 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.265963 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6"] Sep 11 05:51:44.268953 ip-10-0-138-238 kubenswrapper[2569]: W0911 05:51:44.268924 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8a2941ad_e1df_4da0_898a_f4d244e91688.slice/crio-1f8e5def46b82b8054b896fd12b9e2fb57b44879f5a8820bb86febebe6e58dc6 WatchSource:0}: Error finding container 1f8e5def46b82b8054b896fd12b9e2fb57b44879f5a8820bb86febebe6e58dc6: Status 404 returned error can't find the container with id 1f8e5def46b82b8054b896fd12b9e2fb57b44879f5a8820bb86febebe6e58dc6 Sep 11 05:51:44.361396 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.361361 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" event={"ID":"8a2941ad-e1df-4da0-898a-f4d244e91688","Type":"ContainerStarted","Data":"7fd10676bc701ea65661028ed720a73f7c342eec4f873e4ac78cd6e0c66182ae"} Sep 11 05:51:44.361496 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.361422 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" event={"ID":"8a2941ad-e1df-4da0-898a-f4d244e91688","Type":"ContainerStarted","Data":"1f8e5def46b82b8054b896fd12b9e2fb57b44879f5a8820bb86febebe6e58dc6"} Sep 11 05:51:44.361496 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.361474 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:44.375958 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.375922 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" podStartSLOduration=1.375910075 podStartE2EDuration="1.375910075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 05:51:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 05:51:44.375117749 +0000 UTC m=+1894.099297393" watchObservedRunningTime="2026-09-11 05:51:44.375910075 +0000 UTC m=+1894.100089719" Sep 11 05:51:44.387738 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.387706 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rh6tw_682454e1-5ba2-4c02-b92d-8c2b66c59a66/dns/0.log" Sep 11 05:51:44.408518 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.408499 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rh6tw_682454e1-5ba2-4c02-b92d-8c2b66c59a66/kube-rbac-proxy/0.log" Sep 11 05:51:44.431040 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.431015 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cnvp6_e41e0543-6109-4304-baaf-2f5c1ef80e11/dns-node-resolver/0.log" Sep 11 05:51:44.927500 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:44.927461 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sh49c_5850659d-ad02-4261-ae58-8a547785ec32/node-ca/0.log" Sep 11 05:51:45.585621 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:45.585594 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7666854f74-b8zpj_6da37175-6b47-4105-ba72-c2644ada4fff/router/0.log" Sep 11 05:51:45.938821 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:45.938698 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n29fh_c12aa7da-3ae4-4d26-bb5a-787feddaa9f2/serve-healthcheck-canary/0.log" Sep 11 05:51:46.279683 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:46.279658 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-v6wtq_fc957ed2-08b1-4e47-a8fb-e7cf25902179/insights-operator/0.log" Sep 11 05:51:46.279925 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:46.279908 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-v6wtq_fc957ed2-08b1-4e47-a8fb-e7cf25902179/insights-operator/1.log" Sep 11 05:51:46.359635 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:46.359605 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxb5g_6d81c499-6929-467a-983f-64090a6b231c/kube-rbac-proxy/0.log" Sep 11 05:51:46.379610 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:46.379584 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxb5g_6d81c499-6929-467a-983f-64090a6b231c/exporter/0.log" Sep 11 05:51:46.399725 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:46.399703 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rxb5g_6d81c499-6929-467a-983f-64090a6b231c/extractor/0.log" Sep 11 05:51:50.376804 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:50.376073 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gbwzt/perf-node-gather-daemonset-ws2p6" Sep 11 05:51:50.635187 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:50.635106 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-dwtwv_4dea7e44-25b3-4c8b-8f36-80ddf7026505/kube-storage-version-migrator-operator/1.log" Sep 11 05:51:50.636104 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:50.636084 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-dwtwv_4dea7e44-25b3-4c8b-8f36-80ddf7026505/kube-storage-version-migrator-operator/0.log" Sep 11 05:51:51.440189 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.440125 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5hvsr_3266632a-286d-48ef-a7be-e5b0b4581b0b/kube-multus/0.log" Sep 11 05:51:51.802732 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.802688 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9f4bx_64063deb-08d8-43d4-9cfb-446b3496652e/kube-multus-additional-cni-plugins/0.log" Sep 11 05:51:51.823834 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.823807 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9f4bx_64063deb-08d8-43d4-9cfb-446b3496652e/egress-router-binary-copy/0.log" Sep 11 05:51:51.845535 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.845504 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9f4bx_64063deb-08d8-43d4-9cfb-446b3496652e/cni-plugins/0.log" Sep 11 05:51:51.869622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.869597 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9f4bx_64063deb-08d8-43d4-9cfb-446b3496652e/bond-cni-plugin/0.log" Sep 11 05:51:51.891342 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.891319 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9f4bx_64063deb-08d8-43d4-9cfb-446b3496652e/routeoverride-cni/0.log" Sep 11 05:51:51.917728 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.917701 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9f4bx_64063deb-08d8-43d4-9cfb-446b3496652e/whereabouts-cni-bincopy/0.log" Sep 11 05:51:51.941957 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.941935 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9f4bx_64063deb-08d8-43d4-9cfb-446b3496652e/whereabouts-cni/0.log" Sep 11 05:51:51.993054 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:51.993030 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4lj77_b9079d0d-8a44-4c4e-ba0d-43284c60f675/network-metrics-daemon/0.log" Sep 11 05:51:52.012648 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:52.012623 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4lj77_b9079d0d-8a44-4c4e-ba0d-43284c60f675/kube-rbac-proxy/0.log" Sep 11 05:51:52.919902 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:52.919749 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78lkv_c9204d9f-ef6c-49a0-b474-1167b59f0e7c/ovn-controller/0.log" Sep 11 05:51:52.937106 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:52.937067 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78lkv_c9204d9f-ef6c-49a0-b474-1167b59f0e7c/ovn-acl-logging/0.log" Sep 11 05:51:52.966647 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:52.966621 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78lkv_c9204d9f-ef6c-49a0-b474-1167b59f0e7c/kube-rbac-proxy-node/0.log" Sep 11 05:51:52.991622 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:52.991595 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78lkv_c9204d9f-ef6c-49a0-b474-1167b59f0e7c/kube-rbac-proxy-ovn-metrics/0.log" Sep 11 05:51:53.012641 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:53.012606 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78lkv_c9204d9f-ef6c-49a0-b474-1167b59f0e7c/northd/0.log" Sep 11 05:51:53.036591 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:53.036565 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78lkv_c9204d9f-ef6c-49a0-b474-1167b59f0e7c/nbdb/0.log" Sep 11 05:51:53.060028 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:53.060003 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78lkv_c9204d9f-ef6c-49a0-b474-1167b59f0e7c/sbdb/0.log" Sep 11 05:51:53.108175 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:53.108135 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-78lkv_c9204d9f-ef6c-49a0-b474-1167b59f0e7c/ovnkube-controller/0.log" Sep 11 05:51:54.432425 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:54.432399 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f8b768455-9jnhd_9a374b1f-83c6-454b-8161-4a46d45f6139/check-endpoints/0.log" Sep 11 05:51:54.502389 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:54.502365 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-vcbgt_a176acf4-1745-4e19-86f9-e6721082ea17/network-check-target-container/0.log" Sep 11 05:51:55.334360 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:55.334325 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-dpzl5_e013f606-d92b-4a85-acf4-09d132bce1e5/iptables-alerter/0.log" Sep 11 05:51:55.961812 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:55.961778 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-c2tv8_190d908a-3215-4b00-9d3c-da12e9fb574c/tuned/0.log" Sep 11 05:51:57.591457 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:57.591425 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-zjhng_0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e/cluster-samples-operator/0.log" Sep 11 05:51:57.606873 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:57.606845 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-86499c89c4-zjhng_0cf49a3c-94c8-4c2e-991b-8f0d4c6d691e/cluster-samples-operator-watch/0.log" Sep 11 05:51:58.460045 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:58.460003 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-rb5cf_70c2394a-6f61-412b-ab38-08390abfa53e/service-ca-operator/1.log" Sep 11 05:51:58.460975 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:58.460954 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-cf7c776b7-rb5cf_70c2394a-6f61-412b-ab38-08390abfa53e/service-ca-operator/0.log" Sep 11 05:51:59.283323 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:59.283295 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-r6frx_f87542f5-1cab-4c8a-80aa-230a0ac86c0a/csi-driver/0.log" Sep 11 05:51:59.319588 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:59.319561 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-r6frx_f87542f5-1cab-4c8a-80aa-230a0ac86c0a/csi-node-driver-registrar/0.log" Sep 11 05:51:59.355411 ip-10-0-138-238 kubenswrapper[2569]: I0911 05:51:59.355340 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-r6frx_f87542f5-1cab-4c8a-80aa-230a0ac86c0a/csi-liveness-probe/0.log"