Sep 07 13:00:49.912980 ip-10-0-137-227 systemd[1]: Starting Kubernetes Kubelet... Sep 07 13:00:50.355215 ip-10-0-137-227 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:00:50.355215 ip-10-0-137-227 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 07 13:00:50.355215 ip-10-0-137-227 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:00:50.355215 ip-10-0-137-227 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 07 13:00:50.355215 ip-10-0-137-227 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 07 13:00:50.356146 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.356078 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 07 13:00:50.360101 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360086 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:00:50.360101 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360100 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360104 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360108 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360110 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360113 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360116 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360119 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360122 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360124 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360135 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360140 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360143 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360146 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360148 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360151 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360153 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360157 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360159 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360162 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:00:50.360172 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360165 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360167 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360170 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360172 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360175 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360177 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360180 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360183 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360186 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360188 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360191 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360193 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360196 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360198 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360200 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360203 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360205 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360207 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360210 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360214 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:00:50.360620 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360216 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360218 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360221 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360224 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360226 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360229 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360231 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360234 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360236 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360239 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360241 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360243 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360246 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360248 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360252 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360255 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360258 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360260 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360263 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360265 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:00:50.361126 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360268 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360271 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360274 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360276 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360279 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360282 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360284 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360288 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360290 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360292 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360295 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360300 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360303 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360306 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360309 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360311 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360314 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360316 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360319 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:00:50.361614 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360321 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360324 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360326 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360329 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360331 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360333 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360336 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360341 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360345 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360348 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360350 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360353 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360356 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360358 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360361 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360363 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360366 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360368 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360371 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.360373 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:00:50.362094 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362039 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362046 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362050 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362053 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362056 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362060 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362062 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362065 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362068 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362071 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362073 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362076 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362079 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362082 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362084 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362087 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362089 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362092 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362094 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362097 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:00:50.362606 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362100 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362103 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362106 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362109 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362111 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362114 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362117 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362119 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362122 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362124 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362127 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362129 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362132 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362135 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362137 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362140 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362143 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362147 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362150 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:00:50.363136 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362153 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362156 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362158 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362161 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362168 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362171 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362174 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362177 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362179 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362182 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362186 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362189 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362194 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362198 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362200 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362203 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362206 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362208 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362211 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:00:50.363627 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362213 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362216 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362218 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362221 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362223 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362226 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362228 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362230 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362233 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362235 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362237 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362240 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362242 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362245 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362248 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362250 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362252 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362255 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362259 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362262 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:00:50.364184 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362265 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362268 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362271 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362273 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362276 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362280 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362284 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362287 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362290 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362292 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362295 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362298 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362301 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362303 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362306 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362308 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362311 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362314 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362316 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362319 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:00:50.364684 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362321 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362749 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362754 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362759 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362762 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362766 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362769 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362772 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362775 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362778 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362780 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362783 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362786 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362788 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362791 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362794 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362797 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362800 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362803 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362805 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:00:50.365189 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362815 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362818 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362821 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362823 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362826 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362828 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362831 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362833 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362836 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362838 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362840 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362843 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362845 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362848 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362850 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362853 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362856 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362858 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362866 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362871 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:00:50.365686 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362873 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362876 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362879 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362882 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362885 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362887 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362890 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362893 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362895 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362898 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362901 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362903 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362906 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362909 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362911 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362913 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362916 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362918 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362921 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:00:50.366175 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362923 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362925 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362928 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362931 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362934 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362936 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362939 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362941 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362944 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362946 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362948 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362951 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362954 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362956 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362958 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362961 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362963 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362966 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362968 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362971 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:00:50.366645 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362973 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362975 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362978 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362981 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362983 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362986 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362988 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362991 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362993 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362996 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.362998 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363001 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363003 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363006 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363009 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363012 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363015 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363017 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363020 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363022 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:00:50.367134 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363024 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363088 2579 flags.go:64] FLAG: --address="0.0.0.0" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363121 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363128 2579 flags.go:64] FLAG: --anonymous-auth="true" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363132 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363137 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363140 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363144 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363148 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363152 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363155 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363158 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363161 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363166 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363170 2579 flags.go:64] FLAG: --cgroup-root="" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363172 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363175 2579 flags.go:64] FLAG: --client-ca-file="" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363178 2579 flags.go:64] FLAG: --cloud-provider="external" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363181 2579 flags.go:64] FLAG: --cluster-dns="[]" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363185 2579 flags.go:64] FLAG: --cluster-domain="" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363187 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363190 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363193 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363196 2579 flags.go:64] FLAG: --container-log-max-files="5" Sep 07 13:00:50.367645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363200 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363203 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363206 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363209 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363212 2579 flags.go:64] FLAG: --contention-profiling="false" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363215 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363217 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363220 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363223 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363227 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363230 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363232 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363235 2579 flags.go:64] FLAG: --enable-load-reader="false" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363238 2579 flags.go:64] FLAG: --enable-server="true" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363241 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363246 2579 flags.go:64] FLAG: --event-burst="100" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363249 2579 flags.go:64] FLAG: --event-qps="50" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363251 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363255 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363257 2579 flags.go:64] FLAG: --eviction-hard="" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363261 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363265 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363269 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363272 2579 flags.go:64] FLAG: --eviction-soft="" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363275 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 07 13:00:50.368232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363277 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363280 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363283 2579 flags.go:64] FLAG: --experimental-mounter-path="" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363286 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363288 2579 flags.go:64] FLAG: --fail-swap-on="true" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363291 2579 flags.go:64] FLAG: --feature-gates="" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363295 2579 flags.go:64] FLAG: --file-check-frequency="20s" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363298 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363301 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363303 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363306 2579 flags.go:64] FLAG: --healthz-port="10248" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363309 2579 flags.go:64] FLAG: --help="false" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363312 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363315 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363317 2579 flags.go:64] FLAG: --http-check-frequency="20s" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363320 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363323 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363326 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363329 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363332 2579 flags.go:64] FLAG: --image-service-endpoint="" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363334 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363337 2579 flags.go:64] FLAG: --kube-api-burst="100" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363340 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363343 2579 flags.go:64] FLAG: --kube-api-qps="50" Sep 07 13:00:50.368903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363346 2579 flags.go:64] FLAG: --kube-reserved="" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363349 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363351 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363354 2579 flags.go:64] FLAG: --kubelet-cgroups="" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363361 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363365 2579 flags.go:64] FLAG: --lock-file="" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363368 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363370 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363373 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363378 2579 flags.go:64] FLAG: --log-json-split-stream="false" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363381 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363384 2579 flags.go:64] FLAG: --log-text-split-stream="false" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363387 2579 flags.go:64] FLAG: --logging-format="text" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363390 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363393 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363396 2579 flags.go:64] FLAG: --manifest-url="" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363398 2579 flags.go:64] FLAG: --manifest-url-header="" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363403 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363405 2579 flags.go:64] FLAG: --max-open-files="1000000" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363409 2579 flags.go:64] FLAG: --max-pods="110" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363412 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363415 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363418 2579 flags.go:64] FLAG: --memory-manager-policy="None" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363420 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363423 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 07 13:00:50.369514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363426 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363429 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363435 2579 flags.go:64] FLAG: --node-status-max-images="50" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363438 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363441 2579 flags.go:64] FLAG: --oom-score-adj="-999" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363444 2579 flags.go:64] FLAG: --pod-cidr="" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363447 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363452 2579 flags.go:64] FLAG: --pod-manifest-path="" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363455 2579 flags.go:64] FLAG: --pod-max-pids="-1" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363458 2579 flags.go:64] FLAG: --pods-per-core="0" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363460 2579 flags.go:64] FLAG: --port="10250" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363464 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363467 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04508c30e17ad8473" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363471 2579 flags.go:64] FLAG: --qos-reserved="" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363473 2579 flags.go:64] FLAG: --read-only-port="10255" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363476 2579 flags.go:64] FLAG: --register-node="true" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363479 2579 flags.go:64] FLAG: --register-with-taints="" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363482 2579 flags.go:64] FLAG: --registry-burst="10" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363485 2579 flags.go:64] FLAG: --registry-qps="5" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363488 2579 flags.go:64] FLAG: --reserved-cpus="" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363490 2579 flags.go:64] FLAG: --reserved-memory="" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363494 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363497 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363500 2579 flags.go:64] FLAG: --rotate-certificates="false" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363502 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 07 13:00:50.370145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363505 2579 flags.go:64] FLAG: --runonce="false" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363508 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363511 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363513 2579 flags.go:64] FLAG: --seccomp-default="false" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363516 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363519 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363522 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363525 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363527 2579 flags.go:64] FLAG: --storage-driver-password="root" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363530 2579 flags.go:64] FLAG: --storage-driver-secure="false" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363532 2579 flags.go:64] FLAG: --storage-driver-table="stats" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363535 2579 flags.go:64] FLAG: --storage-driver-user="root" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363538 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363540 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363560 2579 flags.go:64] FLAG: --system-cgroups="" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363582 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363595 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363600 2579 flags.go:64] FLAG: --tls-cert-file="" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363603 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363609 2579 flags.go:64] FLAG: --tls-min-version="" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363612 2579 flags.go:64] FLAG: --tls-private-key-file="" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363615 2579 flags.go:64] FLAG: --topology-manager-policy="none" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363618 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363621 2579 flags.go:64] FLAG: --topology-manager-scope="container" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363624 2579 flags.go:64] FLAG: --v="2" Sep 07 13:00:50.370812 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363630 2579 flags.go:64] FLAG: --version="false" Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363634 2579 flags.go:64] FLAG: --vmodule="" Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363638 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.363642 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363778 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363783 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363786 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363789 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363792 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363795 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363798 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363801 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363804 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363807 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363809 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363811 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363814 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363817 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363819 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363822 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:00:50.371463 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363824 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363827 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363830 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363834 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363837 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363840 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363842 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363845 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363847 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363850 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363853 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363855 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363858 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363860 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363863 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363865 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363869 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363873 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363875 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363878 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:00:50.371962 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363881 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363883 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363886 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363889 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363894 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363897 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363900 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363903 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363906 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363908 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363911 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363914 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363916 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363919 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363922 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363924 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363927 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363930 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363933 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:00:50.372445 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363936 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363938 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363941 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363944 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363946 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363949 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363951 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363954 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363956 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363959 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363961 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363963 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363966 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363968 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363970 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363973 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363976 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363978 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363981 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363983 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:00:50.372932 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363986 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363988 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363991 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363994 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363996 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.363999 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364001 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364004 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364007 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364009 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364012 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364015 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364017 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364019 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364022 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364024 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364027 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364031 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364034 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:00:50.373430 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364037 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364039 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364042 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364045 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.364047 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.364942 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.372236 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.372249 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.372271 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.372277 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372348 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372353 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372356 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372359 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:00:50.373950 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372363 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372367 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372369 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372372 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372374 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372377 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372380 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372382 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372385 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372387 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372391 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372395 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372398 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372401 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372404 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372407 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372409 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372412 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372414 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372416 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:00:50.374292 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372419 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372421 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372424 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372426 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372434 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372437 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372440 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372443 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372446 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372448 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372451 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372453 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372456 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372459 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372461 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372464 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372466 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372469 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372472 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:00:50.374823 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372475 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372478 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372480 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372483 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372485 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372488 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372490 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372492 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372495 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372497 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372500 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372502 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372504 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372507 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372509 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372512 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372514 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372516 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372525 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372528 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:00:50.375301 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372531 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372533 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372536 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372538 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372540 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372543 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372545 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372548 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372550 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372553 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372555 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372558 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372560 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372569 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372571 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372574 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372576 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372579 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372581 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372583 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:00:50.375803 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372586 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372588 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372590 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372592 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372595 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372598 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372600 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372603 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372605 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372608 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372611 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372619 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372621 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372624 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372626 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:00:50.376328 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372629 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.372634 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372815 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372820 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372823 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372826 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372828 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372830 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372833 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372835 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372838 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372841 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372843 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372846 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372848 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 07 13:00:50.376707 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372850 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372852 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372856 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372859 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372862 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372865 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372868 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372870 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372873 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372875 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372878 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372880 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372883 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372885 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372893 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372896 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372898 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372901 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372903 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372905 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 07 13:00:50.377076 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372908 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372910 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372913 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372915 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372917 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372920 2579 feature_gate.go:328] unrecognized feature gate: Example2 Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372922 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372925 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372928 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372930 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372933 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372935 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372938 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372940 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372943 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372945 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372948 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372950 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372952 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372955 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 07 13:00:50.377571 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372957 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372959 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372962 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372964 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372967 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372969 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372972 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372979 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372982 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372984 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372988 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372991 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372993 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372996 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.372999 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373001 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373004 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373006 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373008 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 07 13:00:50.378173 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373011 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373013 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373016 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373018 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373021 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373023 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373026 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373028 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373030 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373033 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373035 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373037 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373040 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373045 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373048 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373050 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373053 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373055 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373058 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373060 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 07 13:00:50.378630 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373063 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373072 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373075 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373078 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373080 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373083 2579 feature_gate.go:328] unrecognized feature gate: Example Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:50.373085 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.373090 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.373196 2579 server.go:962] "Client rotation is on, will bootstrap in background" Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.374953 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.375974 2579 server.go:1019] "Starting client certificate rotation" Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.376082 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 13:00:50.379120 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.376114 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 07 13:00:50.379463 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.379268 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 13:00:50.385838 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.385814 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 07 13:00:50.397050 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.397030 2579 log.go:25] "Validated CRI v1 runtime API" Sep 07 13:00:50.400516 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.400503 2579 log.go:25] "Validated CRI v1 image API" Sep 07 13:00:50.401386 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.401371 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 07 13:00:50.406642 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.406624 2579 fs.go:135] Filesystem UUIDs: map[039b8774-4d4d-4f9b-9537-b49fb966bf14:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9b5eda65-1396-4db4-9233-d416c36c6707:/dev/nvme0n1p3] Sep 07 13:00:50.406728 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.406642 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 07 13:00:50.409984 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.409961 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 13:00:50.411723 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.411598 2579 manager.go:216] Machine: {Timestamp:2026-09-07 13:00:50.410201136 +0000 UTC m=+0.369520682 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100494 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e20cf53e8bc5c12b5663b14184f65 SystemUUID:ec2e20cf-53e8-bc5c-12b5-663b14184f65 BootID:a6b22f2a-b7f1-4b4e-8f80-7309a4e97c69 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:86:4f:37:fd:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:86:4f:37:fd:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:ce:01:7c:88:53 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 07 13:00:50.411723 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.411718 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 07 13:00:50.411851 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.411785 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 07 13:00:50.415590 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.415566 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 07 13:00:50.415779 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.415597 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-227.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 07 13:00:50.417293 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.417280 2579 topology_manager.go:138] "Creating topology manager with none policy" Sep 07 13:00:50.417358 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.417301 2579 container_manager_linux.go:309] "Creating device plugin manager" Sep 07 13:00:50.417358 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.417311 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 13:00:50.417358 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.417334 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 07 13:00:50.418719 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.418706 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 07 13:00:50.423287 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423273 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 07 13:00:50.423429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423417 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 07 13:00:50.423484 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423454 2579 kubelet.go:486] "Attempting to sync node with API server" Sep 07 13:00:50.423484 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423469 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 07 13:00:50.423484 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423482 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 07 13:00:50.423607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423495 2579 kubelet.go:398] "Adding apiserver pod source" Sep 07 13:00:50.423607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423507 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 07 13:00:50.423958 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423945 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 13:00:50.424079 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.423984 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 07 13:00:50.426275 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.426253 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 07 13:00:50.429232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.429218 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 07 13:00:50.429289 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.429247 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 07 13:00:50.430008 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.429997 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 07 13:00:50.430056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430011 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 07 13:00:50.430056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430017 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 07 13:00:50.430056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430022 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 07 13:00:50.430056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430029 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 07 13:00:50.430056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430034 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 07 13:00:50.430192 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430094 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 07 13:00:50.430192 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430099 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 07 13:00:50.430192 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430107 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 07 13:00:50.430192 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430112 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 07 13:00:50.430192 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430120 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 07 13:00:50.430192 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.430127 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 07 13:00:50.432035 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.432017 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 07 13:00:50.432137 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.432125 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 07 13:00:50.434966 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.434946 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-227.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 07 13:00:50.435887 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.435853 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 07 13:00:50.435943 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.435855 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 07 13:00:50.436077 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.436062 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qftlj" Sep 07 13:00:50.436643 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.436630 2579 server.go:1268] "Started kubelet" Sep 07 13:00:50.436800 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.436758 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 07 13:00:50.436853 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.436765 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 07 13:00:50.436908 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.436864 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 07 13:00:50.437313 ip-10-0-137-227 systemd[1]: Started Kubernetes Kubelet. Sep 07 13:00:50.438394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.438378 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 07 13:00:50.438839 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.438822 2579 server.go:310] "Adding debug handlers to kubelet server" Sep 07 13:00:50.442342 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.442322 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 07 13:00:50.443816 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.442712 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-227.ec2.internal.18d30b6f7b726bb3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-227.ec2.internal,UID:ip-10-0-137-227.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-227.ec2.internal,},FirstTimestamp:2026-09-07 13:00:50.436590515 +0000 UTC m=+0.395910062,LastTimestamp:2026-09-07 13:00:50.436590515 +0000 UTC m=+0.395910062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-227.ec2.internal,}" Sep 07 13:00:50.444435 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.444421 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qftlj" Sep 07 13:00:50.447191 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.447177 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 07 13:00:50.447269 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.447190 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 07 13:00:50.447319 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.447273 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:50.448197 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448059 2579 factory.go:55] Registering systemd factory Sep 07 13:00:50.448197 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448073 2579 factory.go:223] Registration of the systemd container factory successfully Sep 07 13:00:50.448339 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448244 2579 factory.go:153] Registering CRI-O factory Sep 07 13:00:50.448339 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448257 2579 factory.go:223] Registration of the crio container factory successfully Sep 07 13:00:50.448339 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448294 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 07 13:00:50.448339 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448305 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 07 13:00:50.448339 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448310 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 07 13:00:50.448339 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448339 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 07 13:00:50.448618 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448322 2579 factory.go:103] Registering Raw factory Sep 07 13:00:50.448618 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448368 2579 manager.go:1196] Started watching for new ooms in manager Sep 07 13:00:50.448618 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448500 2579 reconstruct.go:97] "Volume reconstruction finished" Sep 07 13:00:50.448618 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.448509 2579 reconciler.go:29] "Reconciler: start to sync state" Sep 07 13:00:50.449567 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.449553 2579 manager.go:349] Starting recovery of all containers Sep 07 13:00:50.449955 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.449930 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 07 13:00:50.450155 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.450131 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 07 13:00:50.458962 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.458879 2579 manager.go:354] Recovery completed Sep 07 13:00:50.463675 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.463646 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:00:50.465265 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.465252 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:00:50.465320 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.465277 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:00:50.465320 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.465288 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:00:50.465732 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.465720 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 07 13:00:50.465732 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.465731 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 07 13:00:50.465799 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.465745 2579 state_mem.go:36] "Initialized new in-memory state store" Sep 07 13:00:50.465799 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.465787 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:00:50.466441 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.466424 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:00:50.466509 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.466453 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:00:50.466509 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.466467 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:00:50.467741 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.467728 2579 policy_none.go:49] "None policy: Start" Sep 07 13:00:50.467775 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.467745 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 07 13:00:50.467775 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.467755 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 07 13:00:50.469689 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.469680 2579 policy_none.go:47] "Start" Sep 07 13:00:50.500282 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.500187 2579 manager.go:337] "Starting Device Plugin manager" Sep 07 13:00:50.500342 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.500299 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 07 13:00:50.500342 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.500309 2579 server.go:87] "Starting device plugin registration server" Sep 07 13:00:50.500486 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.500476 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 07 13:00:50.500517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.500488 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 07 13:00:50.501269 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.500776 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 07 13:00:50.501269 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.500844 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 07 13:00:50.501269 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.500852 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 07 13:00:50.501269 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.501127 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 07 13:00:50.501269 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.501173 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:50.518940 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.518915 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 07 13:00:50.530132 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.520158 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 07 13:00:50.530132 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.520199 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 07 13:00:50.530132 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.520219 2579 kubelet.go:2448] "Starting kubelet main sync loop" Sep 07 13:00:50.530132 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.520254 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 07 13:00:50.530132 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.522378 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:00:50.601499 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.601474 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:00:50.602237 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.602216 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:00:50.602334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.602247 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:00:50.602334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.602261 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:00:50.602334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.602286 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.619102 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.619061 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.619102 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.619080 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-227.ec2.internal\": node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:50.620778 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.620760 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal"] Sep 07 13:00:50.620854 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.620840 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:00:50.622260 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.622243 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:00:50.622350 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.622271 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:00:50.622350 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.622286 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:00:50.624597 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.624578 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:00:50.624734 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.624716 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.624810 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.624753 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:00:50.625325 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.625309 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:00:50.625394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.625332 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:00:50.625394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.625342 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:00:50.625394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.625350 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:00:50.625394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.625357 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:00:50.625394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.625363 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:00:50.627675 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.627649 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.627728 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.627697 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 07 13:00:50.628363 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.628343 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientMemory" Sep 07 13:00:50.628363 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.628363 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasNoDiskPressure" Sep 07 13:00:50.628439 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.628372 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeHasSufficientPID" Sep 07 13:00:50.639967 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.639950 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:50.650010 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.649987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c120f44b6917a67388de059e5a715a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal\" (UID: \"0c120f44b6917a67388de059e5a715a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.650107 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.650011 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c120f44b6917a67388de059e5a715a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal\" (UID: \"0c120f44b6917a67388de059e5a715a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.650107 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.650037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da5e3a4c5eae8de2d6c17446168336e8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-227.ec2.internal\" (UID: \"da5e3a4c5eae8de2d6c17446168336e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.651289 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.651274 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-227.ec2.internal\" not found" node="ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.655449 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.655435 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-227.ec2.internal\" not found" node="ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.740984 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.740964 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:50.751030 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.751010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c120f44b6917a67388de059e5a715a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal\" (UID: \"0c120f44b6917a67388de059e5a715a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.751094 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.751050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c120f44b6917a67388de059e5a715a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal\" (UID: \"0c120f44b6917a67388de059e5a715a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.751094 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.751072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da5e3a4c5eae8de2d6c17446168336e8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-227.ec2.internal\" (UID: \"da5e3a4c5eae8de2d6c17446168336e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.751160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.751108 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c120f44b6917a67388de059e5a715a0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal\" (UID: \"0c120f44b6917a67388de059e5a715a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.751160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.751115 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c120f44b6917a67388de059e5a715a0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal\" (UID: \"0c120f44b6917a67388de059e5a715a0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.751160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.751124 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/da5e3a4c5eae8de2d6c17446168336e8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-227.ec2.internal\" (UID: \"da5e3a4c5eae8de2d6c17446168336e8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.841074 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.841055 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:50.941873 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:50.941832 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:50.953285 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.953272 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:50.959407 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:50.959392 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" Sep 07 13:00:51.042634 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.042614 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.143147 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.143129 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.243718 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.243636 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.299937 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.299915 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:00:51.344164 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.344140 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.375704 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.375657 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 07 13:00:51.376060 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.375810 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 13:00:51.376060 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.375845 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 07 13:00:51.444773 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.444752 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.451427 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.451390 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 12:55:51 +0000 UTC" deadline="2028-02-09 23:41:23.308483907 +0000 UTC" Sep 07 13:00:51.451475 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.451429 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12490h40m31.857060005s" Sep 07 13:00:51.545689 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.545617 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.646229 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.646205 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.746719 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.746695 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.802042 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.801995 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:00:51.842355 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:51.842331 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda5e3a4c5eae8de2d6c17446168336e8.slice/crio-a819eea725f1fff6374357c09c225d5c22bdd5e04f0ec563e4694ca1d84e7058 WatchSource:0}: Error finding container a819eea725f1fff6374357c09c225d5c22bdd5e04f0ec563e4694ca1d84e7058: Status 404 returned error can't find the container with id a819eea725f1fff6374357c09c225d5c22bdd5e04f0ec563e4694ca1d84e7058 Sep 07 13:00:51.846767 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:51.846753 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-227.ec2.internal\" not found" Sep 07 13:00:51.847904 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.847890 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 13:00:51.851046 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.851029 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:00:51.947882 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.947848 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" Sep 07 13:00:51.956540 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.956522 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 13:00:51.957596 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.957584 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" Sep 07 13:00:51.967653 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:51.967636 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 07 13:00:53.534194 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.534168 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c120f44b6917a67388de059e5a715a0.slice/crio-813c95d68e48d1a472cb6799b1bdc5502aab33647f3f486b0fcf364ad2b6b445 WatchSource:0}: Error finding container 813c95d68e48d1a472cb6799b1bdc5502aab33647f3f486b0fcf364ad2b6b445: Status 404 returned error can't find the container with id 813c95d68e48d1a472cb6799b1bdc5502aab33647f3f486b0fcf364ad2b6b445 Sep 07 13:00:53.595153 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.595130 2579 apiserver.go:52] "Watching apiserver" Sep 07 13:00:53.602322 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.602303 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 07 13:00:53.603598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.603575 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-cfp6f","openshift-multus/multus-additional-cni-plugins-qtg4b","openshift-multus/multus-scfft","openshift-multus/network-metrics-daemon-j944k","openshift-network-diagnostics/network-check-target-2tvj7","kube-system/konnectivity-agent-pbfpr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl","openshift-dns/node-resolver-644ph","openshift-image-registry/node-ca-nzgwf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal","openshift-network-operator/iptables-alerter-j9bjw","openshift-ovn-kubernetes/ovnkube-node-7vrt7","kube-system/global-pull-secret-syncer-vbrfx","kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal"] Sep 07 13:00:53.606026 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.606001 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.608414 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.608394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.608520 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.608488 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:00:53.608900 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.608875 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 07 13:00:53.609005 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.608972 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 07 13:00:53.609065 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.609042 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 07 13:00:53.609121 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.609072 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vhgqk\"" Sep 07 13:00:53.610789 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.610767 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scfft" Sep 07 13:00:53.612983 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.612961 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:53.613104 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.613036 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:00:53.613396 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.613337 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9rcvp\"" Sep 07 13:00:53.613635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.613618 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 07 13:00:53.613882 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.613860 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 07 13:00:53.613978 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.613884 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 07 13:00:53.613978 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.613885 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 07 13:00:53.616033 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.615770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:53.616033 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.615835 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:00:53.618255 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.618237 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:00:53.618535 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.618517 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 07 13:00:53.620426 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.620153 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.621183 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.621163 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 07 13:00:53.621334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.621196 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 07 13:00:53.621334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.621276 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-llrfv\"" Sep 07 13:00:53.622446 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.622428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.623235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.622777 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 07 13:00:53.623235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.622868 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 07 13:00:53.623235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.622979 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 07 13:00:53.623235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.623228 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gdd4l\"" Sep 07 13:00:53.626424 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.624940 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.626424 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.624951 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:00:53.627241 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.626880 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 07 13:00:53.627241 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.627074 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pp48v\"" Sep 07 13:00:53.627388 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.627344 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.627773 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.627751 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 07 13:00:53.628386 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.628359 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 07 13:00:53.628497 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.628368 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-76t9d\"" Sep 07 13:00:53.629787 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.629764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/273c431c-d571-433b-b52d-ffa9a825c2be-agent-certs\") pod \"konnectivity-agent-pbfpr\" (UID: \"273c431c-d571-433b-b52d-ffa9a825c2be\") " pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:00:53.629897 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.629802 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-cnibin\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.629897 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.629827 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5911bf3-8084-4a00-a070-d18f1937f7e3-cni-binary-copy\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630002 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.629890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-conf-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630002 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.629924 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-modprobe-d\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630002 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.629945 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-kubernetes\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630002 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.629967 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-systemd\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630002 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.629991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-registration-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630013 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-sys-fs\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630037 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-hostroot\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-socket-dir-parent\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630083 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-etc-kubernetes\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630106 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8909dd03-0c85-40a4-9252-29a07ab443b7-host\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630127 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8909dd03-0c85-40a4-9252-29a07ab443b7-serviceca\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630150 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxzwq\" (UniqueName: \"kubernetes.io/projected/8909dd03-0c85-40a4-9252-29a07ab443b7-kube-api-access-kxzwq\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630173 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-cni-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630194 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysctl-d\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630214 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-sys\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysctl-conf\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr8w2\" (UniqueName: \"kubernetes.io/projected/32fd61b2-4c97-4a05-b159-3392cc08620b-kube-api-access-gr8w2\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630305 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630319 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-cni-multus\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630333 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-kubelet\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630351 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysconfig\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-var-lib-kubelet\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630395 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32fd61b2-4c97-4a05-b159-3392cc08620b-tmp\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630408 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630417 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-device-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44675e1d-941e-4e2c-ba99-2efdbda04edf-kubelet-config\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630485 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-system-cni-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630526 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-k8s-cni-cncf-io\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.630607 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-cni-bin\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630585 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-multus-certs\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630606 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsghg\" (UniqueName: \"kubernetes.io/projected/f5911bf3-8084-4a00-a070-d18f1937f7e3-kube-api-access-gsghg\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630608 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630646 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-run\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630717 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-host\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630760 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-tuned\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630805 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-lib-modules\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630823 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-socket-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630843 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjwmx\" (UniqueName: \"kubernetes.io/projected/6b673a25-15d6-4aaa-bda3-8fd6edb75494-kube-api-access-sjwmx\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630844 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44675e1d-941e-4e2c-ba99-2efdbda04edf-dbus\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630918 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmvtv\" (UniqueName: \"kubernetes.io/projected/0dc9eb65-272c-4303-8892-bef137df8bd6-kube-api-access-pmvtv\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630942 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/273c431c-d571-433b-b52d-ffa9a825c2be-konnectivity-ca\") pod \"konnectivity-agent-pbfpr\" (UID: \"273c431c-d571-433b-b52d-ffa9a825c2be\") " pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.630987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-netns\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.631004 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gmtn7\"" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.631014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-daemon-config\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.631429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.631050 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.633107 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.633088 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.633212 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.633197 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:00:53.633569 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.633548 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 07 13:00:53.633569 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.633565 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 07 13:00:53.633863 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.633845 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 07 13:00:53.633950 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.633912 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rxq92\"" Sep 07 13:00:53.635355 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.635331 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 07 13:00:53.635871 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.635850 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 07 13:00:53.636375 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.636083 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 07 13:00:53.636375 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.636140 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 07 13:00:53.636496 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.636431 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qbm8k\"" Sep 07 13:00:53.636558 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.636543 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 07 13:00:53.636609 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.636584 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 07 13:00:53.655174 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.655144 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-85d2n" Sep 07 13:00:53.664087 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.663935 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-85d2n" Sep 07 13:00:53.696641 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.696601 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" event={"ID":"0c120f44b6917a67388de059e5a715a0","Type":"ContainerStarted","Data":"813c95d68e48d1a472cb6799b1bdc5502aab33647f3f486b0fcf364ad2b6b445"} Sep 07 13:00:53.698925 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.698903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" event={"ID":"da5e3a4c5eae8de2d6c17446168336e8","Type":"ContainerStarted","Data":"a819eea725f1fff6374357c09c225d5c22bdd5e04f0ec563e4694ca1d84e7058"} Sep 07 13:00:53.722229 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.722203 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 07 13:00:53.732064 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732035 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.732155 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732074 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-systemd-units\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.732155 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-env-overrides\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.732155 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732132 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovn-node-metrics-cert\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732159 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5911bf3-8084-4a00-a070-d18f1937f7e3-cni-binary-copy\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-conf-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-modprobe-d\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732218 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-kubernetes\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732242 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-conf-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732268 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732293 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovnkube-config\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732300 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-kubernetes\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732314 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96qpj\" (UniqueName: \"kubernetes.io/projected/8ea1952c-2544-4725-bbcd-37b14d329f00-kube-api-access-96qpj\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732334 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-hostroot\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732341 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-modprobe-d\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-kubelet\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732370 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-hostroot\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ea1952c-2544-4725-bbcd-37b14d329f00-iptables-alerter-script\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-cni-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysctl-d\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-sys\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732476 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-cni-binary-copy\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732490 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732520 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr8w2\" (UniqueName: \"kubernetes.io/projected/32fd61b2-4c97-4a05-b159-3392cc08620b-kube-api-access-gr8w2\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732541 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732541 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysctl-d\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732563 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-cni-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732589 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-sys\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.732824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732615 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732716 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-cni-multus\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732737 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732744 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f5911bf3-8084-4a00-a070-d18f1937f7e3-cni-binary-copy\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732751 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44675e1d-941e-4e2c-ba99-2efdbda04edf-kubelet-config\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732783 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/44675e1d-941e-4e2c-ba99-2efdbda04edf-kubelet-config\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732792 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-cni-multus\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732814 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07a8a0b6-0f52-4ace-8bac-404be420bebf-tmp-dir\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732815 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-run-netns\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732878 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-system-cni-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732897 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-cni-bin\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732910 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-run\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-host\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732942 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-tuned\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732968 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-cni-bin\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732975 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-run\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.732987 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-host\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.733635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733014 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-socket-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733020 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-system-cni-dir\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44675e1d-941e-4e2c-ba99-2efdbda04edf-dbus\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733102 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-cnibin\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733127 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-lib-modules\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733131 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-socket-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733159 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/44675e1d-941e-4e2c-ba99-2efdbda04edf-dbus\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733160 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/273c431c-d571-433b-b52d-ffa9a825c2be-konnectivity-ca\") pod \"konnectivity-agent-pbfpr\" (UID: \"273c431c-d571-433b-b52d-ffa9a825c2be\") " pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733185 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlkc7\" (UniqueName: \"kubernetes.io/projected/430f9a09-d445-4492-851a-1e9d70d99ff1-kube-api-access-qlkc7\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-log-socket\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-netns\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733195 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733233 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-daemon-config\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733246 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-netns\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733219 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-lib-modules\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ea1952c-2544-4725-bbcd-37b14d329f00-host-slash\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-cnibin\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733319 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-systemd\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.734491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-registration-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-sys-fs\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07a8a0b6-0f52-4ace-8bac-404be420bebf-hosts-file\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733397 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-cnibin\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733413 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-socket-dir-parent\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733396 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-systemd\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-etc-kubernetes\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733453 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-sys-fs\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733470 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8909dd03-0c85-40a4-9252-29a07ab443b7-host\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733494 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-etc-kubernetes\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8909dd03-0c85-40a4-9252-29a07ab443b7-serviceca\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733498 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-registration-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733532 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxzwq\" (UniqueName: \"kubernetes.io/projected/8909dd03-0c85-40a4-9252-29a07ab443b7-kube-api-access-kxzwq\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733539 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8909dd03-0c85-40a4-9252-29a07ab443b7-host\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733553 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-socket-dir-parent\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-ovn\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-cni-bin\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733614 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:53.735124 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxnjw\" (UniqueName: \"kubernetes.io/projected/07a8a0b6-0f52-4ace-8bac-404be420bebf-kube-api-access-cxnjw\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-cni-netd\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733693 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wh7c\" (UniqueName: \"kubernetes.io/projected/6fca8dfc-2405-49f9-85c4-a978b115ba9f-kube-api-access-9wh7c\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysctl-conf\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733766 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-system-cni-dir\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.733775 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733782 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f5911bf3-8084-4a00-a070-d18f1937f7e3-multus-daemon-config\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-slash\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/273c431c-d571-433b-b52d-ffa9a825c2be-konnectivity-ca\") pod \"konnectivity-agent-pbfpr\" (UID: \"273c431c-d571-433b-b52d-ffa9a825c2be\") " pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733809 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-var-lib-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.733858 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs podName:0dc9eb65-272c-4303-8892-bef137df8bd6 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:54.233817926 +0000 UTC m=+3.022122701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs") pod "network-metrics-daemon-j944k" (UID: "0dc9eb65-272c-4303-8892-bef137df8bd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.733874 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733926 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8909dd03-0c85-40a4-9252-29a07ab443b7-serviceca\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733932 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovnkube-script-lib\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.733966 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret podName:44675e1d-941e-4e2c-ba99-2efdbda04edf nodeName:}" failed. No retries permitted until 2026-09-07 13:00:54.233951158 +0000 UTC m=+3.022255933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret") pod "global-pull-secret-syncer-vbrfx" (UID: "44675e1d-941e-4e2c-ba99-2efdbda04edf") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:00:53.735808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733991 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-kubelet\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.733993 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysctl-conf\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysconfig\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734015 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-var-lib-kubelet\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734026 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-var-lib-kubelet\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32fd61b2-4c97-4a05-b159-3392cc08620b-tmp\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734078 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-sysconfig\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734090 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-device-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734081 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32fd61b2-4c97-4a05-b159-3392cc08620b-var-lib-kubelet\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734112 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/273c431c-d571-433b-b52d-ffa9a825c2be-agent-certs\") pod \"konnectivity-agent-pbfpr\" (UID: \"273c431c-d571-433b-b52d-ffa9a825c2be\") " pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734139 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734145 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6b673a25-15d6-4aaa-bda3-8fd6edb75494-device-dir\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-node-log\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734185 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-k8s-cni-cncf-io\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734209 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-multus-certs\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734212 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-k8s-cni-cncf-io\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734230 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsghg\" (UniqueName: \"kubernetes.io/projected/f5911bf3-8084-4a00-a070-d18f1937f7e3-kube-api-access-gsghg\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.736361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734241 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f5911bf3-8084-4a00-a070-d18f1937f7e3-host-run-multus-certs\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.737031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734254 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjwmx\" (UniqueName: \"kubernetes.io/projected/6b673a25-15d6-4aaa-bda3-8fd6edb75494-kube-api-access-sjwmx\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.737031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734279 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmvtv\" (UniqueName: \"kubernetes.io/projected/0dc9eb65-272c-4303-8892-bef137df8bd6-kube-api-access-pmvtv\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:53.737031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734303 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-systemd\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.737031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734323 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-etc-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.737031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.734347 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.737031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.736818 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32fd61b2-4c97-4a05-b159-3392cc08620b-etc-tuned\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.737031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.736833 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32fd61b2-4c97-4a05-b159-3392cc08620b-tmp\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.737031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.737028 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/273c431c-d571-433b-b52d-ffa9a825c2be-agent-certs\") pod \"konnectivity-agent-pbfpr\" (UID: \"273c431c-d571-433b-b52d-ffa9a825c2be\") " pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:00:53.739468 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.739446 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:00:53.739468 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.739467 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:00:53.739645 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.739478 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dt5zk for pod openshift-network-diagnostics/network-check-target-2tvj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:00:53.739645 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:53.739534 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk podName:fcde63d4-f722-4351-962d-65e4002bb83c nodeName:}" failed. No retries permitted until 2026-09-07 13:00:54.239519539 +0000 UTC m=+3.027824339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dt5zk" (UniqueName: "kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk") pod "network-check-target-2tvj7" (UID: "fcde63d4-f722-4351-962d-65e4002bb83c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:00:53.742142 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.742120 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxzwq\" (UniqueName: \"kubernetes.io/projected/8909dd03-0c85-40a4-9252-29a07ab443b7-kube-api-access-kxzwq\") pod \"node-ca-nzgwf\" (UID: \"8909dd03-0c85-40a4-9252-29a07ab443b7\") " pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.742252 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.742226 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr8w2\" (UniqueName: \"kubernetes.io/projected/32fd61b2-4c97-4a05-b159-3392cc08620b-kube-api-access-gr8w2\") pod \"tuned-cfp6f\" (UID: \"32fd61b2-4c97-4a05-b159-3392cc08620b\") " pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.743911 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.743772 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsghg\" (UniqueName: \"kubernetes.io/projected/f5911bf3-8084-4a00-a070-d18f1937f7e3-kube-api-access-gsghg\") pod \"multus-scfft\" (UID: \"f5911bf3-8084-4a00-a070-d18f1937f7e3\") " pod="openshift-multus/multus-scfft" Sep 07 13:00:53.743911 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.743875 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmvtv\" (UniqueName: \"kubernetes.io/projected/0dc9eb65-272c-4303-8892-bef137df8bd6-kube-api-access-pmvtv\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:53.745863 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.745839 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjwmx\" (UniqueName: \"kubernetes.io/projected/6b673a25-15d6-4aaa-bda3-8fd6edb75494-kube-api-access-sjwmx\") pod \"aws-ebs-csi-driver-node-qzwkl\" (UID: \"6b673a25-15d6-4aaa-bda3-8fd6edb75494\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.834808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-cni-netd\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.834808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wh7c\" (UniqueName: \"kubernetes.io/projected/6fca8dfc-2405-49f9-85c4-a978b115ba9f-kube-api-access-9wh7c\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.834937 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834829 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-system-cni-dir\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.834937 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-slash\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.834937 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-var-lib-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.834937 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834903 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovnkube-script-lib\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.834937 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834930 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835104 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834952 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-node-log\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835104 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.834977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-systemd\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835104 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-etc-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835104 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835104 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-systemd-units\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835104 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835072 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-env-overrides\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovn-node-metrics-cert\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835171 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovnkube-config\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96qpj\" (UniqueName: \"kubernetes.io/projected/8ea1952c-2544-4725-bbcd-37b14d329f00-kube-api-access-96qpj\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-kubelet\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ea1952c-2544-4725-bbcd-37b14d329f00-iptables-alerter-script\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-cni-binary-copy\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835299 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.835354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835344 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835369 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835397 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07a8a0b6-0f52-4ace-8bac-404be420bebf-tmp-dir\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-run-netns\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835463 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-cnibin\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835489 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlkc7\" (UniqueName: \"kubernetes.io/projected/430f9a09-d445-4492-851a-1e9d70d99ff1-kube-api-access-qlkc7\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835512 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-log-socket\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ea1952c-2544-4725-bbcd-37b14d329f00-host-slash\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07a8a0b6-0f52-4ace-8bac-404be420bebf-hosts-file\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835603 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-ovn\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.835660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835628 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-cni-bin\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836143 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835664 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxnjw\" (UniqueName: \"kubernetes.io/projected/07a8a0b6-0f52-4ace-8bac-404be420bebf-kube-api-access-cxnjw\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.836143 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835767 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-cni-netd\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836143 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.835948 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-system-cni-dir\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.836284 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836160 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-kubelet\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836332 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836297 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovnkube-config\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836379 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-node-log\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836433 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836398 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-systemd\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836433 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836416 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovnkube-script-lib\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836529 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836440 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-etc-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836529 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836459 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836529 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836483 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-run-ovn-kubernetes\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836716 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836697 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8ea1952c-2544-4725-bbcd-37b14d329f00-iptables-alerter-script\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.836855 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836834 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6fca8dfc-2405-49f9-85c4-a978b115ba9f-env-overrides\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.836936 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.836882 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-systemd-units\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.837198 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837179 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-cni-binary-copy\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.837267 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.837267 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837250 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-log-socket\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.837355 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.837424 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837382 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.837589 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837573 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07a8a0b6-0f52-4ace-8bac-404be420bebf-tmp-dir\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.837646 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837617 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-run-netns\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.837646 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837600 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/430f9a09-d445-4492-851a-1e9d70d99ff1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.837646 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837642 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/430f9a09-d445-4492-851a-1e9d70d99ff1-cnibin\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.837814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837696 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ea1952c-2544-4725-bbcd-37b14d329f00-host-slash\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.837814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837710 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-run-ovn\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.837814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837727 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07a8a0b6-0f52-4ace-8bac-404be420bebf-hosts-file\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.837814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837755 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-cni-bin\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.837814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837759 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-host-slash\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.837814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.837799 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6fca8dfc-2405-49f9-85c4-a978b115ba9f-var-lib-openvswitch\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.838837 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.838804 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6fca8dfc-2405-49f9-85c4-a978b115ba9f-ovn-node-metrics-cert\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.844788 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.844769 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxnjw\" (UniqueName: \"kubernetes.io/projected/07a8a0b6-0f52-4ace-8bac-404be420bebf-kube-api-access-cxnjw\") pod \"node-resolver-644ph\" (UID: \"07a8a0b6-0f52-4ace-8bac-404be420bebf\") " pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.845554 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.845097 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96qpj\" (UniqueName: \"kubernetes.io/projected/8ea1952c-2544-4725-bbcd-37b14d329f00-kube-api-access-96qpj\") pod \"iptables-alerter-j9bjw\" (UID: \"8ea1952c-2544-4725-bbcd-37b14d329f00\") " pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.845989 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.845970 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wh7c\" (UniqueName: \"kubernetes.io/projected/6fca8dfc-2405-49f9-85c4-a978b115ba9f-kube-api-access-9wh7c\") pod \"ovnkube-node-7vrt7\" (UID: \"6fca8dfc-2405-49f9-85c4-a978b115ba9f\") " pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.848081 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.848056 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlkc7\" (UniqueName: \"kubernetes.io/projected/430f9a09-d445-4492-851a-1e9d70d99ff1-kube-api-access-qlkc7\") pod \"multus-additional-cni-plugins-qtg4b\" (UID: \"430f9a09-d445-4492-851a-1e9d70d99ff1\") " pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.917795 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.917770 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" Sep 07 13:00:53.926613 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.926485 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-scfft" Sep 07 13:00:53.926841 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.926817 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b673a25_15d6_4aaa_bda3_8fd6edb75494.slice/crio-bbf7922bad35e512ead8a3051197947585a4e0ab75c927ef05a63895a3d092a9 WatchSource:0}: Error finding container bbf7922bad35e512ead8a3051197947585a4e0ab75c927ef05a63895a3d092a9: Status 404 returned error can't find the container with id bbf7922bad35e512ead8a3051197947585a4e0ab75c927ef05a63895a3d092a9 Sep 07 13:00:53.935342 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.935318 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5911bf3_8084_4a00_a070_d18f1937f7e3.slice/crio-e40f528993916b8da204e0182d9d3bae66324a975c5f448f8f428d1573424f65 WatchSource:0}: Error finding container e40f528993916b8da204e0182d9d3bae66324a975c5f448f8f428d1573424f65: Status 404 returned error can't find the container with id e40f528993916b8da204e0182d9d3bae66324a975c5f448f8f428d1573424f65 Sep 07 13:00:53.938992 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.938973 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:00:53.943670 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.943653 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nzgwf" Sep 07 13:00:53.947443 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.947425 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273c431c_d571_433b_b52d_ffa9a825c2be.slice/crio-5e74dcd6a9033aa961c013745c57d34b3ff833b0ab2a546fff90c6e0d6c63daa WatchSource:0}: Error finding container 5e74dcd6a9033aa961c013745c57d34b3ff833b0ab2a546fff90c6e0d6c63daa: Status 404 returned error can't find the container with id 5e74dcd6a9033aa961c013745c57d34b3ff833b0ab2a546fff90c6e0d6c63daa Sep 07 13:00:53.950602 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.950586 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" Sep 07 13:00:53.952333 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.952311 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8909dd03_0c85_40a4_9252_29a07ab443b7.slice/crio-eca025ed89deec028a509e644e37345e9e921d13d7577e0673d6fd806a9fba83 WatchSource:0}: Error finding container eca025ed89deec028a509e644e37345e9e921d13d7577e0673d6fd806a9fba83: Status 404 returned error can't find the container with id eca025ed89deec028a509e644e37345e9e921d13d7577e0673d6fd806a9fba83 Sep 07 13:00:53.959144 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.959121 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" Sep 07 13:00:53.960017 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.959994 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fd61b2_4c97_4a05_b159_3392cc08620b.slice/crio-7491e65b05ee49c7b2cf50a92a08183216f382af6bc27a18406e9c61d167bcfc WatchSource:0}: Error finding container 7491e65b05ee49c7b2cf50a92a08183216f382af6bc27a18406e9c61d167bcfc: Status 404 returned error can't find the container with id 7491e65b05ee49c7b2cf50a92a08183216f382af6bc27a18406e9c61d167bcfc Sep 07 13:00:53.966763 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.966741 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-644ph" Sep 07 13:00:53.971396 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.971377 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod430f9a09_d445_4492_851a_1e9d70d99ff1.slice/crio-c4b5d4847f8214d7038d8c029f6c84127370a4c6e3be8e007bdf12599116ea0e WatchSource:0}: Error finding container c4b5d4847f8214d7038d8c029f6c84127370a4c6e3be8e007bdf12599116ea0e: Status 404 returned error can't find the container with id c4b5d4847f8214d7038d8c029f6c84127370a4c6e3be8e007bdf12599116ea0e Sep 07 13:00:53.975603 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.975585 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a8a0b6_0f52_4ace_8bac_404be420bebf.slice/crio-4ffdf728badf3482a3a19c5a082725acdc6c90f2e2e0a1d39b0646899ee3d809 WatchSource:0}: Error finding container 4ffdf728badf3482a3a19c5a082725acdc6c90f2e2e0a1d39b0646899ee3d809: Status 404 returned error can't find the container with id 4ffdf728badf3482a3a19c5a082725acdc6c90f2e2e0a1d39b0646899ee3d809 Sep 07 13:00:53.976382 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.976364 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j9bjw" Sep 07 13:00:53.982287 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:53.982270 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:00:53.985427 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.985365 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ea1952c_2544_4725_bbcd_37b14d329f00.slice/crio-9608bb080d44923a2b54ebbf6c26406e69434aad7044643a721386d145ecc002 WatchSource:0}: Error finding container 9608bb080d44923a2b54ebbf6c26406e69434aad7044643a721386d145ecc002: Status 404 returned error can't find the container with id 9608bb080d44923a2b54ebbf6c26406e69434aad7044643a721386d145ecc002 Sep 07 13:00:53.992084 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:00:53.992065 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fca8dfc_2405_49f9_85c4_a978b115ba9f.slice/crio-463ed93e51d61f31cec3c3287eed7d5078fe9547cecd7b3e5564197adc76f2e4 WatchSource:0}: Error finding container 463ed93e51d61f31cec3c3287eed7d5078fe9547cecd7b3e5564197adc76f2e4: Status 404 returned error can't find the container with id 463ed93e51d61f31cec3c3287eed7d5078fe9547cecd7b3e5564197adc76f2e4 Sep 07 13:00:54.117830 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.117761 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:00:54.239076 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.239044 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:54.239220 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.239089 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:54.239220 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:54.239208 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:00:54.239294 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:54.239212 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:00:54.239294 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:54.239255 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret podName:44675e1d-941e-4e2c-ba99-2efdbda04edf nodeName:}" failed. No retries permitted until 2026-09-07 13:00:55.239243127 +0000 UTC m=+4.027547902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret") pod "global-pull-secret-syncer-vbrfx" (UID: "44675e1d-941e-4e2c-ba99-2efdbda04edf") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:00:54.239294 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:54.239277 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs podName:0dc9eb65-272c-4303-8892-bef137df8bd6 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:55.239261248 +0000 UTC m=+4.027566038 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs") pod "network-metrics-daemon-j944k" (UID: "0dc9eb65-272c-4303-8892-bef137df8bd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:00:54.339394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.339366 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:54.339577 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:54.339557 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:00:54.339636 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:54.339582 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:00:54.339636 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:54.339597 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dt5zk for pod openshift-network-diagnostics/network-check-target-2tvj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:00:54.339752 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:54.339652 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk podName:fcde63d4-f722-4351-962d-65e4002bb83c nodeName:}" failed. No retries permitted until 2026-09-07 13:00:55.339632661 +0000 UTC m=+4.127937451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dt5zk" (UniqueName: "kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk") pod "network-check-target-2tvj7" (UID: "fcde63d4-f722-4351-962d-65e4002bb83c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:00:54.654055 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.654030 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 07 13:00:54.667334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.667281 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:55:53 +0000 UTC" deadline="2028-03-15 14:41:50.584638479 +0000 UTC" Sep 07 13:00:54.667479 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.667351 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13321h40m55.917311681s" Sep 07 13:00:54.702612 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.702587 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"463ed93e51d61f31cec3c3287eed7d5078fe9547cecd7b3e5564197adc76f2e4"} Sep 07 13:00:54.703911 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.703882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-644ph" event={"ID":"07a8a0b6-0f52-4ace-8bac-404be420bebf","Type":"ContainerStarted","Data":"4ffdf728badf3482a3a19c5a082725acdc6c90f2e2e0a1d39b0646899ee3d809"} Sep 07 13:00:54.705230 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.705204 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" event={"ID":"430f9a09-d445-4492-851a-1e9d70d99ff1","Type":"ContainerStarted","Data":"c4b5d4847f8214d7038d8c029f6c84127370a4c6e3be8e007bdf12599116ea0e"} Sep 07 13:00:54.706533 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.706499 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nzgwf" event={"ID":"8909dd03-0c85-40a4-9252-29a07ab443b7","Type":"ContainerStarted","Data":"eca025ed89deec028a509e644e37345e9e921d13d7577e0673d6fd806a9fba83"} Sep 07 13:00:54.707810 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.707781 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pbfpr" event={"ID":"273c431c-d571-433b-b52d-ffa9a825c2be","Type":"ContainerStarted","Data":"5e74dcd6a9033aa961c013745c57d34b3ff833b0ab2a546fff90c6e0d6c63daa"} Sep 07 13:00:54.709048 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.709020 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" event={"ID":"6b673a25-15d6-4aaa-bda3-8fd6edb75494","Type":"ContainerStarted","Data":"bbf7922bad35e512ead8a3051197947585a4e0ab75c927ef05a63895a3d092a9"} Sep 07 13:00:54.710344 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.710315 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j9bjw" event={"ID":"8ea1952c-2544-4725-bbcd-37b14d329f00","Type":"ContainerStarted","Data":"9608bb080d44923a2b54ebbf6c26406e69434aad7044643a721386d145ecc002"} Sep 07 13:00:54.711560 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.711527 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" event={"ID":"32fd61b2-4c97-4a05-b159-3392cc08620b","Type":"ContainerStarted","Data":"7491e65b05ee49c7b2cf50a92a08183216f382af6bc27a18406e9c61d167bcfc"} Sep 07 13:00:54.712818 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:54.712797 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scfft" event={"ID":"f5911bf3-8084-4a00-a070-d18f1937f7e3","Type":"ContainerStarted","Data":"e40f528993916b8da204e0182d9d3bae66324a975c5f448f8f428d1573424f65"} Sep 07 13:00:55.247640 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:55.246889 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:55.247640 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:55.246936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:55.247640 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.247071 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:00:55.247640 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.247131 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret podName:44675e1d-941e-4e2c-ba99-2efdbda04edf nodeName:}" failed. No retries permitted until 2026-09-07 13:00:57.247113228 +0000 UTC m=+6.035418024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret") pod "global-pull-secret-syncer-vbrfx" (UID: "44675e1d-941e-4e2c-ba99-2efdbda04edf") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:00:55.247640 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.247556 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:00:55.247640 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.247609 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs podName:0dc9eb65-272c-4303-8892-bef137df8bd6 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:57.247593171 +0000 UTC m=+6.035897949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs") pod "network-metrics-daemon-j944k" (UID: "0dc9eb65-272c-4303-8892-bef137df8bd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:00:55.347729 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:55.347694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:55.347911 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.347894 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:00:55.347973 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.347919 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:00:55.347973 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.347931 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dt5zk for pod openshift-network-diagnostics/network-check-target-2tvj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:00:55.348082 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.348004 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk podName:fcde63d4-f722-4351-962d-65e4002bb83c nodeName:}" failed. No retries permitted until 2026-09-07 13:00:57.347968022 +0000 UTC m=+6.136272811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dt5zk" (UniqueName: "kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk") pod "network-check-target-2tvj7" (UID: "fcde63d4-f722-4351-962d-65e4002bb83c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:00:55.668294 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:55.667925 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:55:53 +0000 UTC" deadline="2028-05-20 15:59:00.641544566 +0000 UTC" Sep 07 13:00:55.668294 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:55.667958 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14906h58m4.973591364s" Sep 07 13:00:55.696360 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:55.696334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:55.696525 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.696499 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:00:55.696933 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:55.696915 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:55.697038 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.697013 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:00:55.697102 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:55.697082 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:55.697189 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:55.697170 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:00:56.725749 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:56.725438 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" event={"ID":"da5e3a4c5eae8de2d6c17446168336e8","Type":"ContainerStarted","Data":"9de1558b7077548e8950fab2a3a3dc8d93fac6b7783b0ba4c81fec30060af9c5"} Sep 07 13:00:56.735840 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:56.735150 2579 generic.go:356] "Generic (PLEG): container finished" podID="0c120f44b6917a67388de059e5a715a0" containerID="b2eabcab6719e9b3b61cae874637fb8858ab34d7ba62039cad83a7d5fb457618" exitCode=0 Sep 07 13:00:56.735840 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:56.735198 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" event={"ID":"0c120f44b6917a67388de059e5a715a0","Type":"ContainerDied","Data":"b2eabcab6719e9b3b61cae874637fb8858ab34d7ba62039cad83a7d5fb457618"} Sep 07 13:00:56.743303 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:56.743254 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-227.ec2.internal" podStartSLOduration=3.743237958 podStartE2EDuration="3.743237958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:56.742664806 +0000 UTC m=+5.530969603" watchObservedRunningTime="2026-09-07 13:00:56.743237958 +0000 UTC m=+5.531542756" Sep 07 13:00:57.264232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:57.264195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:57.264394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:57.264247 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:57.264394 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.264372 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:00:57.264494 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.264426 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret podName:44675e1d-941e-4e2c-ba99-2efdbda04edf nodeName:}" failed. No retries permitted until 2026-09-07 13:01:01.264408813 +0000 UTC m=+10.052713594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret") pod "global-pull-secret-syncer-vbrfx" (UID: "44675e1d-941e-4e2c-ba99-2efdbda04edf") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:00:57.264812 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.264793 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:00:57.264897 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.264849 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs podName:0dc9eb65-272c-4303-8892-bef137df8bd6 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:01.264832402 +0000 UTC m=+10.053137209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs") pod "network-metrics-daemon-j944k" (UID: "0dc9eb65-272c-4303-8892-bef137df8bd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:00:57.369012 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:57.368947 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:57.369170 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.369149 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:00:57.369170 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.369167 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:00:57.369283 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.369186 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dt5zk for pod openshift-network-diagnostics/network-check-target-2tvj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:00:57.369283 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.369248 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk podName:fcde63d4-f722-4351-962d-65e4002bb83c nodeName:}" failed. No retries permitted until 2026-09-07 13:01:01.369224112 +0000 UTC m=+10.157528905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dt5zk" (UniqueName: "kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk") pod "network-check-target-2tvj7" (UID: "fcde63d4-f722-4351-962d-65e4002bb83c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:00:57.699304 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:57.698496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:57.699304 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.698606 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:00:57.699304 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:57.698982 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:57.699304 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.699067 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:00:57.699304 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:57.699118 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:57.699304 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:57.699197 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:00:59.692579 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:59.692548 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:00:59.693033 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:59.692548 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:00:59.693033 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:00:59.692560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:00:59.693033 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:59.692731 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:00:59.693033 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:59.692796 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:00:59.693033 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:00:59.692870 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:01.300036 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:01.300000 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:01.300439 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:01.300050 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:01.300439 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.300167 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:01:01.300439 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.300171 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:01:01.300439 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.300230 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret podName:44675e1d-941e-4e2c-ba99-2efdbda04edf nodeName:}" failed. No retries permitted until 2026-09-07 13:01:09.30021312 +0000 UTC m=+18.088517902 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret") pod "global-pull-secret-syncer-vbrfx" (UID: "44675e1d-941e-4e2c-ba99-2efdbda04edf") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:01:01.300439 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.300250 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs podName:0dc9eb65-272c-4303-8892-bef137df8bd6 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:09.300239505 +0000 UTC m=+18.088544286 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs") pod "network-metrics-daemon-j944k" (UID: "0dc9eb65-272c-4303-8892-bef137df8bd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:01:01.401308 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:01.401274 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:01.401476 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.401430 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:01:01.401476 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.401476 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:01:01.401573 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.401489 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dt5zk for pod openshift-network-diagnostics/network-check-target-2tvj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:01:01.401573 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.401544 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk podName:fcde63d4-f722-4351-962d-65e4002bb83c nodeName:}" failed. No retries permitted until 2026-09-07 13:01:09.401526705 +0000 UTC m=+18.189831485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dt5zk" (UniqueName: "kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk") pod "network-check-target-2tvj7" (UID: "fcde63d4-f722-4351-962d-65e4002bb83c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:01:01.695022 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:01.694469 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:01.695022 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:01.694593 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:01.695022 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.694599 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:01.695022 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.694759 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:01.695022 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:01.694810 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:01.695022 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:01.694876 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:03.692238 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:03.692204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:03.692238 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:03.692227 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:03.692238 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:03.692209 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:03.692690 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:03.692350 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:03.692690 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:03.692437 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:03.692690 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:03.692526 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:05.691747 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:05.691710 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:05.692165 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:05.691753 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:05.692165 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:05.691823 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:05.692165 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:05.691723 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:05.692165 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:05.691938 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:05.692165 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:05.692035 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:07.692334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:07.692305 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:07.692692 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:07.692314 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:07.692692 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:07.692404 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:07.692692 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:07.692434 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:07.692692 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:07.692545 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:07.692692 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:07.692638 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:09.361205 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:09.360730 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:09.361205 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:09.360779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:09.361205 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.360847 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:01:09.361205 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.360901 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:01:09.361205 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.360905 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs podName:0dc9eb65-272c-4303-8892-bef137df8bd6 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:25.36088683 +0000 UTC m=+34.149191623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs") pod "network-metrics-daemon-j944k" (UID: "0dc9eb65-272c-4303-8892-bef137df8bd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:01:09.361205 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.360939 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret podName:44675e1d-941e-4e2c-ba99-2efdbda04edf nodeName:}" failed. No retries permitted until 2026-09-07 13:01:25.360930083 +0000 UTC m=+34.149234858 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret") pod "global-pull-secret-syncer-vbrfx" (UID: "44675e1d-941e-4e2c-ba99-2efdbda04edf") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:01:09.461735 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:09.461707 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:09.461898 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.461882 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:01:09.461965 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.461907 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:01:09.461965 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.461919 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dt5zk for pod openshift-network-diagnostics/network-check-target-2tvj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:01:09.462051 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.461979 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk podName:fcde63d4-f722-4351-962d-65e4002bb83c nodeName:}" failed. No retries permitted until 2026-09-07 13:01:25.461961795 +0000 UTC m=+34.250266573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dt5zk" (UniqueName: "kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk") pod "network-check-target-2tvj7" (UID: "fcde63d4-f722-4351-962d-65e4002bb83c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:01:09.691491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:09.691417 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:09.691491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:09.691450 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:09.691720 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:09.691417 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:09.691720 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.691527 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:09.691720 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.691619 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:09.691854 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:09.691727 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:11.692432 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:11.692394 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:11.692809 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:11.692492 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:11.692809 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:11.692499 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:11.692809 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:11.692628 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:11.692809 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:11.692696 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:11.692809 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:11.692762 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:13.691773 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.691594 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:13.692336 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:13.691841 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:13.692336 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.691610 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:13.692336 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:13.691897 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:13.692336 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.691599 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:13.692336 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:13.691956 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:13.773288 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.773254 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"aa75ad113d7a41b60eef2547aa9794eaf6bb97e92959309497b756909e2a3f04"} Sep 07 13:01:13.773388 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.773346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"7e26de82e233a0bf03c5d46d0984e38e5725983f56543f447f3a06ef206c8ebf"} Sep 07 13:01:13.773437 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.773398 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"52825e5a6e8c85270bf9cd4de16fde0e0bc336b716e3340efc984ea51730de40"} Sep 07 13:01:13.773473 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.773454 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"b52f4973d7d36748555a2e344fb7c8220f6f6b2daf8e8d21bd9d1299cf6d8ec6"} Sep 07 13:01:13.773513 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.773502 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"ec016863826b87f9d2f5af06ba55c7f188a093f6130a1db38c2629ab945835c9"} Sep 07 13:01:13.773561 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.773545 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"69d9add218fd6046ee01ff67e31d66e7a766823d5c7755389dc7aa1af6e50319"} Sep 07 13:01:13.775250 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.775221 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-644ph" event={"ID":"07a8a0b6-0f52-4ace-8bac-404be420bebf","Type":"ContainerStarted","Data":"dadf7310f497ddd6e476b26256aa33dcba0e09ed43f9771d0a5a4bc611153eb8"} Sep 07 13:01:13.777176 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.777148 2579 generic.go:356] "Generic (PLEG): container finished" podID="430f9a09-d445-4492-851a-1e9d70d99ff1" containerID="8bc74676c6aa9a1b0abd71f488b5e14e1267a3132ff228b5dfca538ae827a4b3" exitCode=0 Sep 07 13:01:13.777269 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.777239 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" event={"ID":"430f9a09-d445-4492-851a-1e9d70d99ff1","Type":"ContainerDied","Data":"8bc74676c6aa9a1b0abd71f488b5e14e1267a3132ff228b5dfca538ae827a4b3"} Sep 07 13:01:13.779908 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.779881 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nzgwf" event={"ID":"8909dd03-0c85-40a4-9252-29a07ab443b7","Type":"ContainerStarted","Data":"dcc00ba4caee3f594c77020f7c4425734f168ca094dc2506e70e05530e90d4b5"} Sep 07 13:01:13.781722 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.781697 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pbfpr" event={"ID":"273c431c-d571-433b-b52d-ffa9a825c2be","Type":"ContainerStarted","Data":"ed39711458224fee759ea1b642a33586de64bc85517b4a29642bb742fb3d5a5a"} Sep 07 13:01:13.784527 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.784467 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" event={"ID":"6b673a25-15d6-4aaa-bda3-8fd6edb75494","Type":"ContainerStarted","Data":"0cf8cbfe08e0fab0ddc25ec0447ce3fab5210e63628b3d305b2f6917cdf6b872"} Sep 07 13:01:13.786614 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.786323 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" event={"ID":"0c120f44b6917a67388de059e5a715a0","Type":"ContainerStarted","Data":"e51976b67f509f93fa58b04d8415f8ffadea3a8c1cc3ebc736ffd5dffb2b6f88"} Sep 07 13:01:13.787949 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.787926 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" event={"ID":"32fd61b2-4c97-4a05-b159-3392cc08620b","Type":"ContainerStarted","Data":"289a34944660987fbbacdca036c38de2ebd739da3992bd2265db58df70d5732d"} Sep 07 13:01:13.789814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.789790 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-scfft" event={"ID":"f5911bf3-8084-4a00-a070-d18f1937f7e3","Type":"ContainerStarted","Data":"cb5d3790604f1daba359aef173249b95eb259ec7a78986de9bb3988e68dfa6b8"} Sep 07 13:01:13.793145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.793078 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-644ph" podStartSLOduration=3.760203355 podStartE2EDuration="22.7930612s" totalImagesPullingTime="19.032857845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:13.792621198 +0000 UTC m=+22.580925996" watchObservedRunningTime="2026-09-07 13:01:13.7930612 +0000 UTC m=+22.581366002" Sep 07 13:01:13.810899 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.810859 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-227.ec2.internal" podStartSLOduration=20.810846387 podStartE2EDuration="20.810846387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:13.810516885 +0000 UTC m=+22.598821682" watchObservedRunningTime="2026-09-07 13:01:13.810846387 +0000 UTC m=+22.599151184" Sep 07 13:01:13.827943 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.827901 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pbfpr" podStartSLOduration=3.767177729 podStartE2EDuration="22.827892604s" totalImagesPullingTime="19.060714875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:13.827380862 +0000 UTC m=+22.615685660" watchObservedRunningTime="2026-09-07 13:01:13.827892604 +0000 UTC m=+22.616197398" Sep 07 13:01:13.870717 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.870617 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-scfft" podStartSLOduration=3.763144688 podStartE2EDuration="22.870601012s" totalImagesPullingTime="19.107456324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:13.870513451 +0000 UTC m=+22.658818249" watchObservedRunningTime="2026-09-07 13:01:13.870601012 +0000 UTC m=+22.658905809" Sep 07 13:01:13.904367 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.904334 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nzgwf" podStartSLOduration=11.363643795 podStartE2EDuration="22.904323154s" totalImagesPullingTime="11.540679359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:13.886326666 +0000 UTC m=+22.674631462" watchObservedRunningTime="2026-09-07 13:01:13.904323154 +0000 UTC m=+22.692627951" Sep 07 13:01:13.904580 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:13.904560 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cfp6f" podStartSLOduration=3.854245354 podStartE2EDuration="22.904554818s" totalImagesPullingTime="19.050309464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:13.903965951 +0000 UTC m=+22.692270749" watchObservedRunningTime="2026-09-07 13:01:13.904554818 +0000 UTC m=+22.692859615" Sep 07 13:01:14.560529 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:14.560503 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 07 13:01:14.683659 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:14.683574 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T13:01:14.560524876Z","UUID":"7a2748d0-0ce0-42b8-a9e6-05b9bb397659","Handler":null,"Name":"","Endpoint":""} Sep 07 13:01:14.685176 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:14.685158 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 07 13:01:14.685278 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:14.685187 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 07 13:01:14.793713 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:14.793633 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j9bjw" event={"ID":"8ea1952c-2544-4725-bbcd-37b14d329f00","Type":"ContainerStarted","Data":"f234425f5f6cdf54eae211221dbc20001fd36fcf98f390f4cf360cbba77c8d6e"} Sep 07 13:01:14.795732 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:14.795706 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" event={"ID":"6b673a25-15d6-4aaa-bda3-8fd6edb75494","Type":"ContainerStarted","Data":"8b70d8cba3bb34586b5fed456c0eb1b5171a4d07b2ecbcad1645e36df7a85902"} Sep 07 13:01:14.812137 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:14.812083 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j9bjw" podStartSLOduration=4.790905837 podStartE2EDuration="23.812064641s" totalImagesPullingTime="19.021158804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:14.811343019 +0000 UTC m=+23.599647816" watchObservedRunningTime="2026-09-07 13:01:14.812064641 +0000 UTC m=+23.600369442" Sep 07 13:01:15.691509 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:15.691471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:15.691631 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:15.691576 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:15.691631 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:15.691472 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:15.691767 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:15.691723 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:15.691767 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:15.691471 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:15.691865 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:15.691810 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:15.802633 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:15.802604 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" event={"ID":"6b673a25-15d6-4aaa-bda3-8fd6edb75494","Type":"ContainerStarted","Data":"5463204ff845234b4efcaffbe47de8eb71bf6a9313c36b7ec3bf3b0d0c2ad4c3"} Sep 07 13:01:16.501101 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:16.501056 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:01:16.807760 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:16.807664 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"495812cb8036173742c9747ec979eb6223669a8d5b8f572a07b16baac2166407"} Sep 07 13:01:16.829392 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:16.827713 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzwkl" podStartSLOduration=4.472199883 podStartE2EDuration="25.827672276s" totalImagesPullingTime="21.355472393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:16.827255928 +0000 UTC m=+25.615560727" watchObservedRunningTime="2026-09-07 13:01:16.827672276 +0000 UTC m=+25.615977074" Sep 07 13:01:17.427785 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:17.427754 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:01:17.428422 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:17.428400 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:01:17.691851 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:17.691783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:17.691851 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:17.691816 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:17.692063 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:17.691783 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:17.692063 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:17.691903 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:17.692063 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:17.692023 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:17.692237 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:17.692118 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:17.810556 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:17.810371 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pbfpr" Sep 07 13:01:18.815834 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:18.815805 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" event={"ID":"6fca8dfc-2405-49f9-85c4-a978b115ba9f","Type":"ContainerStarted","Data":"2b3a8272eb5a9d7196fbb85ef06580e9f84fe54fc5b648570aa10089b0dc57a1"} Sep 07 13:01:18.816299 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:18.816068 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:01:18.816299 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:18.816150 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:01:18.816299 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:18.816199 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:01:18.830790 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:18.830765 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:01:18.831074 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:18.831055 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:01:18.847753 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:18.847707 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" podStartSLOduration=8.773472851 podStartE2EDuration="27.847670099s" totalImagesPullingTime="19.074197248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:18.847240024 +0000 UTC m=+27.635544821" watchObservedRunningTime="2026-09-07 13:01:18.847670099 +0000 UTC m=+27.635974898" Sep 07 13:01:19.691639 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:19.691606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:19.691795 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:19.691610 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:19.691795 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:19.691610 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:19.691795 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:19.691776 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:19.691905 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:19.691876 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:19.691974 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:19.691958 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:19.819830 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:19.819803 2579 generic.go:356] "Generic (PLEG): container finished" podID="430f9a09-d445-4492-851a-1e9d70d99ff1" containerID="ceb5e10ce2bd436d36aad53972cd6568e32842d228d1b8fb8750a9deb77dbc10" exitCode=0 Sep 07 13:01:19.820322 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:19.819898 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" event={"ID":"430f9a09-d445-4492-851a-1e9d70d99ff1","Type":"ContainerDied","Data":"ceb5e10ce2bd436d36aad53972cd6568e32842d228d1b8fb8750a9deb77dbc10"} Sep 07 13:01:20.699997 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:20.699812 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j944k"] Sep 07 13:01:20.700119 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:20.700077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:20.700209 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:20.700186 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:20.702575 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:20.702550 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2tvj7"] Sep 07 13:01:20.702749 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:20.702637 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:20.702749 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:20.702722 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:20.714984 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:20.714936 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vbrfx"] Sep 07 13:01:20.715067 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:20.715013 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:20.715119 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:20.715101 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:21.826172 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:21.826142 2579 generic.go:356] "Generic (PLEG): container finished" podID="430f9a09-d445-4492-851a-1e9d70d99ff1" containerID="7ab37e68aadb41266847a228bbbda6bd90a3d9a39a9f787895758208754605d8" exitCode=0 Sep 07 13:01:21.826542 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:21.826190 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" event={"ID":"430f9a09-d445-4492-851a-1e9d70d99ff1","Type":"ContainerDied","Data":"7ab37e68aadb41266847a228bbbda6bd90a3d9a39a9f787895758208754605d8"} Sep 07 13:01:22.692157 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:22.692132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:22.692262 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:22.692227 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:22.692262 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:22.692241 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:22.692363 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:22.692130 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:22.692432 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:22.692329 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:22.692482 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:22.692455 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:23.833026 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:23.832954 2579 generic.go:356] "Generic (PLEG): container finished" podID="430f9a09-d445-4492-851a-1e9d70d99ff1" containerID="cf3a9211d9328e244e676e6dd4e06eff12191eded10fcfd619e437908e08cd9c" exitCode=0 Sep 07 13:01:23.833026 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:23.832989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" event={"ID":"430f9a09-d445-4492-851a-1e9d70d99ff1","Type":"ContainerDied","Data":"cf3a9211d9328e244e676e6dd4e06eff12191eded10fcfd619e437908e08cd9c"} Sep 07 13:01:24.691774 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:24.691505 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:24.691913 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:24.691538 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:24.691913 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:24.691815 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2tvj7" podUID="fcde63d4-f722-4351-962d-65e4002bb83c" Sep 07 13:01:24.692037 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:24.691917 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vbrfx" podUID="44675e1d-941e-4e2c-ba99-2efdbda04edf" Sep 07 13:01:24.692037 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:24.691587 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:24.692037 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:24.692007 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-j944k" podUID="0dc9eb65-272c-4303-8892-bef137df8bd6" Sep 07 13:01:25.385536 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:25.385503 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:25.385536 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:25.385539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:25.386044 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:25.385649 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 07 13:01:25.386044 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:25.385649 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:01:25.386044 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:25.385727 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs podName:0dc9eb65-272c-4303-8892-bef137df8bd6 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:57.385709057 +0000 UTC m=+66.174013832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs") pod "network-metrics-daemon-j944k" (UID: "0dc9eb65-272c-4303-8892-bef137df8bd6") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 07 13:01:25.386044 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:25.385745 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret podName:44675e1d-941e-4e2c-ba99-2efdbda04edf nodeName:}" failed. No retries permitted until 2026-09-07 13:01:57.385734194 +0000 UTC m=+66.174038990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret") pod "global-pull-secret-syncer-vbrfx" (UID: "44675e1d-941e-4e2c-ba99-2efdbda04edf") : object "kube-system"/"original-pull-secret" not registered Sep 07 13:01:25.486499 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:25.486471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:25.486664 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:25.486646 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 07 13:01:25.486747 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:25.486669 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 07 13:01:25.486747 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:25.486695 2579 projected.go:196] Error preparing data for projected volume kube-api-access-dt5zk for pod openshift-network-diagnostics/network-check-target-2tvj7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:01:25.486829 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:25.486750 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk podName:fcde63d4-f722-4351-962d-65e4002bb83c nodeName:}" failed. No retries permitted until 2026-09-07 13:01:57.486733541 +0000 UTC m=+66.275038319 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dt5zk" (UniqueName: "kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk") pod "network-check-target-2tvj7" (UID: "fcde63d4-f722-4351-962d-65e4002bb83c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 07 13:01:26.040795 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.040766 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-227.ec2.internal" event="NodeReady" Sep 07 13:01:26.040984 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.040894 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 07 13:01:26.088591 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.088560 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-82k98"] Sep 07 13:01:26.100866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.100844 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sgwbc"] Sep 07 13:01:26.101579 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.101093 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82k98" Sep 07 13:01:26.104946 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.104928 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p7csz\"" Sep 07 13:01:26.105352 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.105295 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 07 13:01:26.105584 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.105484 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 07 13:01:26.105878 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.105854 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 07 13:01:26.116837 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.116819 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82k98"] Sep 07 13:01:26.116941 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.116846 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sgwbc"] Sep 07 13:01:26.116941 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.116918 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.119880 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.119857 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77fxd\"" Sep 07 13:01:26.120042 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.120024 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 07 13:01:26.120259 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.120244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 07 13:01:26.192728 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.192701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c98e737-285d-4902-8f5f-b97ba1ae3423-config-volume\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.192905 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.192739 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c98e737-285d-4902-8f5f-b97ba1ae3423-tmp-dir\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.192905 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.192764 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.192905 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.192870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvzfs\" (UniqueName: \"kubernetes.io/projected/3c98e737-285d-4902-8f5f-b97ba1ae3423-kube-api-access-pvzfs\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.192905 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.192901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c45569e-b83b-4828-b86a-eb20a15e5646-cert\") pod \"ingress-canary-82k98\" (UID: \"8c45569e-b83b-4828-b86a-eb20a15e5646\") " pod="openshift-ingress-canary/ingress-canary-82k98" Sep 07 13:01:26.193088 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.192929 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j57gh\" (UniqueName: \"kubernetes.io/projected/8c45569e-b83b-4828-b86a-eb20a15e5646-kube-api-access-j57gh\") pod \"ingress-canary-82k98\" (UID: \"8c45569e-b83b-4828-b86a-eb20a15e5646\") " pod="openshift-ingress-canary/ingress-canary-82k98" Sep 07 13:01:26.294088 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.294031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c98e737-285d-4902-8f5f-b97ba1ae3423-config-volume\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.294088 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.294058 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c98e737-285d-4902-8f5f-b97ba1ae3423-tmp-dir\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.294088 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.294083 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.294315 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.294137 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvzfs\" (UniqueName: \"kubernetes.io/projected/3c98e737-285d-4902-8f5f-b97ba1ae3423-kube-api-access-pvzfs\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.294315 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:26.294225 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:01:26.294315 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:26.294289 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls podName:3c98e737-285d-4902-8f5f-b97ba1ae3423 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:26.794268954 +0000 UTC m=+35.582573738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls") pod "dns-default-sgwbc" (UID: "3c98e737-285d-4902-8f5f-b97ba1ae3423") : secret "dns-default-metrics-tls" not found Sep 07 13:01:26.294465 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.294316 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c45569e-b83b-4828-b86a-eb20a15e5646-cert\") pod \"ingress-canary-82k98\" (UID: \"8c45569e-b83b-4828-b86a-eb20a15e5646\") " pod="openshift-ingress-canary/ingress-canary-82k98" Sep 07 13:01:26.294465 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.294375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j57gh\" (UniqueName: \"kubernetes.io/projected/8c45569e-b83b-4828-b86a-eb20a15e5646-kube-api-access-j57gh\") pod \"ingress-canary-82k98\" (UID: \"8c45569e-b83b-4828-b86a-eb20a15e5646\") " pod="openshift-ingress-canary/ingress-canary-82k98" Sep 07 13:01:26.294465 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.294440 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c98e737-285d-4902-8f5f-b97ba1ae3423-tmp-dir\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.294656 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.294635 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3c98e737-285d-4902-8f5f-b97ba1ae3423-config-volume\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.299241 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.299220 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c45569e-b83b-4828-b86a-eb20a15e5646-cert\") pod \"ingress-canary-82k98\" (UID: \"8c45569e-b83b-4828-b86a-eb20a15e5646\") " pod="openshift-ingress-canary/ingress-canary-82k98" Sep 07 13:01:26.306560 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.306514 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvzfs\" (UniqueName: \"kubernetes.io/projected/3c98e737-285d-4902-8f5f-b97ba1ae3423-kube-api-access-pvzfs\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.306650 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.306619 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j57gh\" (UniqueName: \"kubernetes.io/projected/8c45569e-b83b-4828-b86a-eb20a15e5646-kube-api-access-j57gh\") pod \"ingress-canary-82k98\" (UID: \"8c45569e-b83b-4828-b86a-eb20a15e5646\") " pod="openshift-ingress-canary/ingress-canary-82k98" Sep 07 13:01:26.413723 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.413701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-82k98" Sep 07 13:01:26.691630 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.691561 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:26.691630 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.691585 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:26.691630 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.691605 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:26.695935 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.695916 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 13:01:26.696060 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.696000 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sgcc8\"" Sep 07 13:01:26.696294 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.696278 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 13:01:26.696414 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.696396 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 13:01:26.696659 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.696640 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x9nqz\"" Sep 07 13:01:26.697126 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.697107 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 13:01:26.748077 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.748053 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-82k98"] Sep 07 13:01:26.752971 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:01:26.752950 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c45569e_b83b_4828_b86a_eb20a15e5646.slice/crio-6ae17484f6b6551676ec2bb7e40de5bee9b599430602865c093d5144a223120c WatchSource:0}: Error finding container 6ae17484f6b6551676ec2bb7e40de5bee9b599430602865c093d5144a223120c: Status 404 returned error can't find the container with id 6ae17484f6b6551676ec2bb7e40de5bee9b599430602865c093d5144a223120c Sep 07 13:01:26.799569 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.799549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:26.799735 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:26.799709 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:01:26.799794 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:26.799778 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls podName:3c98e737-285d-4902-8f5f-b97ba1ae3423 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:27.799761976 +0000 UTC m=+36.588066755 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls") pod "dns-default-sgwbc" (UID: "3c98e737-285d-4902-8f5f-b97ba1ae3423") : secret "dns-default-metrics-tls" not found Sep 07 13:01:26.841576 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:26.841554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82k98" event={"ID":"8c45569e-b83b-4828-b86a-eb20a15e5646","Type":"ContainerStarted","Data":"6ae17484f6b6551676ec2bb7e40de5bee9b599430602865c093d5144a223120c"} Sep 07 13:01:27.809548 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:27.809506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:27.810235 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:27.809666 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:01:27.810235 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:27.809749 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls podName:3c98e737-285d-4902-8f5f-b97ba1ae3423 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:29.809729249 +0000 UTC m=+38.598034037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls") pod "dns-default-sgwbc" (UID: "3c98e737-285d-4902-8f5f-b97ba1ae3423") : secret "dns-default-metrics-tls" not found Sep 07 13:01:29.823935 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:29.823725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:29.824403 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:29.823873 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:01:29.824403 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:29.824015 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls podName:3c98e737-285d-4902-8f5f-b97ba1ae3423 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:33.823995963 +0000 UTC m=+42.612300737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls") pod "dns-default-sgwbc" (UID: "3c98e737-285d-4902-8f5f-b97ba1ae3423") : secret "dns-default-metrics-tls" not found Sep 07 13:01:29.851563 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:29.851537 2579 generic.go:356] "Generic (PLEG): container finished" podID="430f9a09-d445-4492-851a-1e9d70d99ff1" containerID="d8f4b40e617c370c5e1cd0c0693526891c9c31ff37b8251174fde7dfcd08b2db" exitCode=0 Sep 07 13:01:29.851712 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:29.851582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" event={"ID":"430f9a09-d445-4492-851a-1e9d70d99ff1","Type":"ContainerDied","Data":"d8f4b40e617c370c5e1cd0c0693526891c9c31ff37b8251174fde7dfcd08b2db"} Sep 07 13:01:30.856801 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:30.856776 2579 generic.go:356] "Generic (PLEG): container finished" podID="430f9a09-d445-4492-851a-1e9d70d99ff1" containerID="58b114e445b0293469fb3032e216df36bf2d94415250b756cd95bff60ee02b98" exitCode=0 Sep 07 13:01:30.857091 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:30.856825 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" event={"ID":"430f9a09-d445-4492-851a-1e9d70d99ff1","Type":"ContainerDied","Data":"58b114e445b0293469fb3032e216df36bf2d94415250b756cd95bff60ee02b98"} Sep 07 13:01:31.860944 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:31.860904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-82k98" event={"ID":"8c45569e-b83b-4828-b86a-eb20a15e5646","Type":"ContainerStarted","Data":"6ce857384f06d7c0faf3cb957e5a431c4cbe03ad61fae40b6cb2198d7b3855b4"} Sep 07 13:01:31.864278 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:31.864256 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" event={"ID":"430f9a09-d445-4492-851a-1e9d70d99ff1","Type":"ContainerStarted","Data":"3897712fcc9ab96ee317c44bfd9a59569836b0614d5d2c91cdac2dd2a8956b15"} Sep 07 13:01:31.880356 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:31.880309 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-82k98" podStartSLOduration=1.694646977 podStartE2EDuration="5.880294535s" totalImagesPullingTime="4.185647558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:31.879201532 +0000 UTC m=+40.667506357" watchObservedRunningTime="2026-09-07 13:01:31.880294535 +0000 UTC m=+40.668599326" Sep 07 13:01:31.904328 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:31.904286 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qtg4b" podStartSLOduration=8.511173091 podStartE2EDuration="40.904271608s" totalImagesPullingTime="32.393098517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:31.90372661 +0000 UTC m=+40.692031408" watchObservedRunningTime="2026-09-07 13:01:31.904271608 +0000 UTC m=+40.692576396" Sep 07 13:01:33.851492 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:33.851458 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:33.851932 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:33.851574 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:01:33.851932 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:33.851627 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls podName:3c98e737-285d-4902-8f5f-b97ba1ae3423 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:41.851613286 +0000 UTC m=+50.639918061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls") pod "dns-default-sgwbc" (UID: "3c98e737-285d-4902-8f5f-b97ba1ae3423") : secret "dns-default-metrics-tls" not found Sep 07 13:01:41.900032 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:41.899978 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:41.900449 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:41.900127 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:01:41.900449 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:41.900209 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls podName:3c98e737-285d-4902-8f5f-b97ba1ae3423 nodeName:}" failed. No retries permitted until 2026-09-07 13:01:57.90019178 +0000 UTC m=+66.688496555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls") pod "dns-default-sgwbc" (UID: "3c98e737-285d-4902-8f5f-b97ba1ae3423") : secret "dns-default-metrics-tls" not found Sep 07 13:01:50.834214 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:50.834179 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7vrt7" Sep 07 13:01:57.405338 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.405301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:01:57.405338 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.405339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:57.408587 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.408565 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 07 13:01:57.408753 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.408734 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 07 13:01:57.415931 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:57.415908 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 07 13:01:57.416067 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:57.415966 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs podName:0dc9eb65-272c-4303-8892-bef137df8bd6 nodeName:}" failed. No retries permitted until 2026-09-07 13:03:01.415950973 +0000 UTC m=+130.204255751 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs") pod "network-metrics-daemon-j944k" (UID: "0dc9eb65-272c-4303-8892-bef137df8bd6") : secret "metrics-daemon-secret" not found Sep 07 13:01:57.419767 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.419747 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/44675e1d-941e-4e2c-ba99-2efdbda04edf-original-pull-secret\") pod \"global-pull-secret-syncer-vbrfx\" (UID: \"44675e1d-941e-4e2c-ba99-2efdbda04edf\") " pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:57.506232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.506201 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:57.509235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.509208 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 07 13:01:57.519546 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.519525 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 07 13:01:57.529121 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.529096 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt5zk\" (UniqueName: \"kubernetes.io/projected/fcde63d4-f722-4351-962d-65e4002bb83c-kube-api-access-dt5zk\") pod \"network-check-target-2tvj7\" (UID: \"fcde63d4-f722-4351-962d-65e4002bb83c\") " pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:57.613991 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.613969 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x9nqz\"" Sep 07 13:01:57.617701 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.617672 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vbrfx" Sep 07 13:01:57.623162 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.621663 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:01:57.905372 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.905309 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2tvj7"] Sep 07 13:01:57.906076 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.906056 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vbrfx"] Sep 07 13:01:57.908104 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:01:57.908078 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcde63d4_f722_4351_962d_65e4002bb83c.slice/crio-e078969b9627c74c308b9c4f38dac9b059f62c58c268bc566182b5b52f108811 WatchSource:0}: Error finding container e078969b9627c74c308b9c4f38dac9b059f62c58c268bc566182b5b52f108811: Status 404 returned error can't find the container with id e078969b9627c74c308b9c4f38dac9b059f62c58c268bc566182b5b52f108811 Sep 07 13:01:57.909007 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.908982 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:01:57.909141 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:57.909103 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 07 13:01:57.909193 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:01:57.909177 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls podName:3c98e737-285d-4902-8f5f-b97ba1ae3423 nodeName:}" failed. No retries permitted until 2026-09-07 13:02:29.909157293 +0000 UTC m=+98.697462070 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls") pod "dns-default-sgwbc" (UID: "3c98e737-285d-4902-8f5f-b97ba1ae3423") : secret "dns-default-metrics-tls" not found Sep 07 13:01:57.909345 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:01:57.909326 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44675e1d_941e_4e2c_ba99_2efdbda04edf.slice/crio-71e759fa67f3931b7793fbd31572fec34687604dc03ce78e1fa4d42405e85780 WatchSource:0}: Error finding container 71e759fa67f3931b7793fbd31572fec34687604dc03ce78e1fa4d42405e85780: Status 404 returned error can't find the container with id 71e759fa67f3931b7793fbd31572fec34687604dc03ce78e1fa4d42405e85780 Sep 07 13:01:57.927246 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.927195 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2tvj7" event={"ID":"fcde63d4-f722-4351-962d-65e4002bb83c","Type":"ContainerStarted","Data":"e078969b9627c74c308b9c4f38dac9b059f62c58c268bc566182b5b52f108811"} Sep 07 13:01:57.928381 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:01:57.928363 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vbrfx" event={"ID":"44675e1d-941e-4e2c-ba99-2efdbda04edf","Type":"ContainerStarted","Data":"71e759fa67f3931b7793fbd31572fec34687604dc03ce78e1fa4d42405e85780"} Sep 07 13:02:01.522913 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.522877 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5"] Sep 07 13:02:01.525826 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.525803 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.528727 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.528709 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 07 13:02:01.528924 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.528905 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fqxk8\"" Sep 07 13:02:01.529792 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.529775 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 07 13:02:01.530078 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.530061 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 07 13:02:01.530078 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.530074 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:02:01.538402 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.538384 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5"] Sep 07 13:02:01.633547 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.633522 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db85bc12-ba78-4952-874b-d18f318a738a-serving-cert\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.633730 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.633583 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jqw\" (UniqueName: \"kubernetes.io/projected/db85bc12-ba78-4952-874b-d18f318a738a-kube-api-access-89jqw\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.633730 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.633611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db85bc12-ba78-4952-874b-d18f318a738a-config\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.730842 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.730808 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pwm62"] Sep 07 13:02:01.733771 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.733749 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-d7kvx"] Sep 07 13:02:01.734159 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.734125 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db85bc12-ba78-4952-874b-d18f318a738a-serving-cert\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.734265 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.734204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89jqw\" (UniqueName: \"kubernetes.io/projected/db85bc12-ba78-4952-874b-d18f318a738a-kube-api-access-89jqw\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.734265 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.734240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db85bc12-ba78-4952-874b-d18f318a738a-config\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.734778 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.734749 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-pwm62" Sep 07 13:02:01.734874 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.734847 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db85bc12-ba78-4952-874b-d18f318a738a-config\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.736760 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.736740 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-29kxx"] Sep 07 13:02:01.736864 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.736816 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.737362 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.737340 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-b7q6z\"" Sep 07 13:02:01.737449 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.737436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db85bc12-ba78-4952-874b-d18f318a738a-serving-cert\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.739499 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.739478 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.740192 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.739762 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 07 13:02:01.740192 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.740002 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 07 13:02:01.740336 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.740323 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qxdzn\"" Sep 07 13:02:01.743361 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.743341 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 07 13:02:01.743449 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.743359 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 07 13:02:01.743592 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.743572 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 07 13:02:01.743699 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.743655 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 07 13:02:01.743877 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.743861 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 07 13:02:01.744598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.744580 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9f6gc\"" Sep 07 13:02:01.744731 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.744581 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 07 13:02:01.747274 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.747255 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pwm62"] Sep 07 13:02:01.748541 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.748510 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 07 13:02:01.750783 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.750717 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jqw\" (UniqueName: \"kubernetes.io/projected/db85bc12-ba78-4952-874b-d18f318a738a-kube-api-access-89jqw\") pod \"service-ca-operator-859f94c4b-zkzk5\" (UID: \"db85bc12-ba78-4952-874b-d18f318a738a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.756482 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.756460 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-d7kvx"] Sep 07 13:02:01.757362 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.757321 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-29kxx"] Sep 07 13:02:01.757857 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.757839 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 07 13:02:01.835232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce23da70-f89a-4b06-9b18-472f812bc78f-snapshots\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.835232 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835204 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqw5s\" (UniqueName: \"kubernetes.io/projected/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-kube-api-access-qqw5s\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.835400 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835237 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce23da70-f89a-4b06-9b18-472f812bc78f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.835400 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-config\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.835400 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835297 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-trusted-ca\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.835400 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce23da70-f89a-4b06-9b18-472f812bc78f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.835400 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835334 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce23da70-f89a-4b06-9b18-472f812bc78f-serving-cert\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.835400 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835350 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dks9\" (UniqueName: \"kubernetes.io/projected/ce23da70-f89a-4b06-9b18-472f812bc78f-kube-api-access-8dks9\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.835400 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835374 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce23da70-f89a-4b06-9b18-472f812bc78f-tmp\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.835640 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835426 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwnjp\" (UniqueName: \"kubernetes.io/projected/051c4ecd-6019-489b-84ec-411778c62ad3-kube-api-access-rwnjp\") pod \"network-check-source-685456655f-pwm62\" (UID: \"051c4ecd-6019-489b-84ec-411778c62ad3\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pwm62" Sep 07 13:02:01.835640 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.835464 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-serving-cert\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.838183 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.838160 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" Sep 07 13:02:01.936282 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-serving-cert\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.936418 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936302 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce23da70-f89a-4b06-9b18-472f812bc78f-snapshots\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.936418 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936410 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqw5s\" (UniqueName: \"kubernetes.io/projected/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-kube-api-access-qqw5s\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.936524 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce23da70-f89a-4b06-9b18-472f812bc78f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.936524 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936500 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-config\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.936524 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936518 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-trusted-ca\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.936669 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936538 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce23da70-f89a-4b06-9b18-472f812bc78f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.936669 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936563 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce23da70-f89a-4b06-9b18-472f812bc78f-serving-cert\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.936669 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936586 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dks9\" (UniqueName: \"kubernetes.io/projected/ce23da70-f89a-4b06-9b18-472f812bc78f-kube-api-access-8dks9\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.936669 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce23da70-f89a-4b06-9b18-472f812bc78f-tmp\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.936669 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936637 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwnjp\" (UniqueName: \"kubernetes.io/projected/051c4ecd-6019-489b-84ec-411778c62ad3-kube-api-access-rwnjp\") pod \"network-check-source-685456655f-pwm62\" (UID: \"051c4ecd-6019-489b-84ec-411778c62ad3\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pwm62" Sep 07 13:02:01.937263 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.936981 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ce23da70-f89a-4b06-9b18-472f812bc78f-snapshots\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.937263 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.937221 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce23da70-f89a-4b06-9b18-472f812bc78f-tmp\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.937397 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.937364 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-config\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.937500 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.937475 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce23da70-f89a-4b06-9b18-472f812bc78f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.937561 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.937489 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce23da70-f89a-4b06-9b18-472f812bc78f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.937905 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.937881 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-trusted-ca\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.939203 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.939185 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-serving-cert\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:01.939428 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.939410 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce23da70-f89a-4b06-9b18-472f812bc78f-serving-cert\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.946497 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.946454 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwnjp\" (UniqueName: \"kubernetes.io/projected/051c4ecd-6019-489b-84ec-411778c62ad3-kube-api-access-rwnjp\") pod \"network-check-source-685456655f-pwm62\" (UID: \"051c4ecd-6019-489b-84ec-411778c62ad3\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pwm62" Sep 07 13:02:01.946989 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.946957 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dks9\" (UniqueName: \"kubernetes.io/projected/ce23da70-f89a-4b06-9b18-472f812bc78f-kube-api-access-8dks9\") pod \"insights-operator-76bcd6ccf5-29kxx\" (UID: \"ce23da70-f89a-4b06-9b18-472f812bc78f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:01.947078 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:01.946994 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqw5s\" (UniqueName: \"kubernetes.io/projected/750136a1-c5a0-4d33-a83d-c0d3d3eeed5f-kube-api-access-qqw5s\") pod \"console-operator-85b454874b-d7kvx\" (UID: \"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f\") " pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:02.060002 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.059971 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-pwm62" Sep 07 13:02:02.066546 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.066526 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:02.074132 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.074114 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" Sep 07 13:02:02.701808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.701738 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5"] Sep 07 13:02:02.704730 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:02.704668 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb85bc12_ba78_4952_874b_d18f318a738a.slice/crio-25918112c8ea7af06ab9c845f6c54037bc60517baea83af58a47f6f8331191c1 WatchSource:0}: Error finding container 25918112c8ea7af06ab9c845f6c54037bc60517baea83af58a47f6f8331191c1: Status 404 returned error can't find the container with id 25918112c8ea7af06ab9c845f6c54037bc60517baea83af58a47f6f8331191c1 Sep 07 13:02:02.705347 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.705329 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pwm62"] Sep 07 13:02:02.708332 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:02.708313 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051c4ecd_6019_489b_84ec_411778c62ad3.slice/crio-fd12752c45ab9f8c7c1035b5076613b630a5316809f921b3628a487ed36df153 WatchSource:0}: Error finding container fd12752c45ab9f8c7c1035b5076613b630a5316809f921b3628a487ed36df153: Status 404 returned error can't find the container with id fd12752c45ab9f8c7c1035b5076613b630a5316809f921b3628a487ed36df153 Sep 07 13:02:02.718222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.718202 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-29kxx"] Sep 07 13:02:02.721574 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:02.721548 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce23da70_f89a_4b06_9b18_472f812bc78f.slice/crio-85a8f4d87a12e70b5750c300617506ed495a166a46066e1760de9bbddca3da1a WatchSource:0}: Error finding container 85a8f4d87a12e70b5750c300617506ed495a166a46066e1760de9bbddca3da1a: Status 404 returned error can't find the container with id 85a8f4d87a12e70b5750c300617506ed495a166a46066e1760de9bbddca3da1a Sep 07 13:02:02.721574 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.721563 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-d7kvx"] Sep 07 13:02:02.946098 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.946062 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" event={"ID":"db85bc12-ba78-4952-874b-d18f318a738a","Type":"ContainerStarted","Data":"25918112c8ea7af06ab9c845f6c54037bc60517baea83af58a47f6f8331191c1"} Sep 07 13:02:02.947599 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.947577 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2tvj7" event={"ID":"fcde63d4-f722-4351-962d-65e4002bb83c","Type":"ContainerStarted","Data":"4045754a0e6ad274a2fbc2ca5b5b7b700f70e077c86299b0f219de6e8f883c98"} Sep 07 13:02:02.947733 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.947708 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:02:02.949311 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.949290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-pwm62" event={"ID":"051c4ecd-6019-489b-84ec-411778c62ad3","Type":"ContainerStarted","Data":"541ef81dd1b10c38cea045807d3b7e0a82e601100e35fb550bb3ee17e8878363"} Sep 07 13:02:02.949412 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.949325 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-pwm62" event={"ID":"051c4ecd-6019-489b-84ec-411778c62ad3","Type":"ContainerStarted","Data":"fd12752c45ab9f8c7c1035b5076613b630a5316809f921b3628a487ed36df153"} Sep 07 13:02:02.950576 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.950554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" event={"ID":"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f","Type":"ContainerStarted","Data":"35e3e42ff78a5066314aeb055fc85ed3dffc0112765e97bb7f4b6e31a498ef1e"} Sep 07 13:02:02.952216 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.952163 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vbrfx" event={"ID":"44675e1d-941e-4e2c-ba99-2efdbda04edf","Type":"ContainerStarted","Data":"4a4eef646c340583423b2118b5dd12392e8a94e62da92ff39df103cfc9403a86"} Sep 07 13:02:02.953284 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.953266 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" event={"ID":"ce23da70-f89a-4b06-9b18-472f812bc78f","Type":"ContainerStarted","Data":"85a8f4d87a12e70b5750c300617506ed495a166a46066e1760de9bbddca3da1a"} Sep 07 13:02:02.970169 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.970126 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2tvj7" podStartSLOduration=67.458100613 podStartE2EDuration="1m11.970110842s" totalImagesPullingTime="4.512010229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:02.969967286 +0000 UTC m=+71.758272084" watchObservedRunningTime="2026-09-07 13:02:02.970110842 +0000 UTC m=+71.758415640" Sep 07 13:02:02.988383 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:02.988344 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-pwm62" podStartSLOduration=1.9883324629999999 podStartE2EDuration="1.988332463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:02.987901772 +0000 UTC m=+71.776206569" watchObservedRunningTime="2026-09-07 13:02:02.988332463 +0000 UTC m=+71.776637260" Sep 07 13:02:03.006245 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:03.006199 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vbrfx" podStartSLOduration=67.484444129 podStartE2EDuration="1m12.006189721s" totalImagesPullingTime="4.521745592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:03.005905155 +0000 UTC m=+71.794209952" watchObservedRunningTime="2026-09-07 13:02:03.006189721 +0000 UTC m=+71.794494518" Sep 07 13:02:05.532902 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.532871 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l"] Sep 07 13:02:05.537064 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.537042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" Sep 07 13:02:05.542012 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.541987 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Sep 07 13:02:05.542128 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.542032 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lhprs\"" Sep 07 13:02:05.542900 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.542860 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Sep 07 13:02:05.549498 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.549476 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l"] Sep 07 13:02:05.564146 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.564119 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzm8\" (UniqueName: \"kubernetes.io/projected/b726bc14-ba52-4c9f-a4e3-2e13164cd6d2-kube-api-access-jdzm8\") pod \"migrator-fdbb8fdff-l8p6l\" (UID: \"b726bc14-ba52-4c9f-a4e3-2e13164cd6d2\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" Sep 07 13:02:05.664575 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.664541 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzm8\" (UniqueName: \"kubernetes.io/projected/b726bc14-ba52-4c9f-a4e3-2e13164cd6d2-kube-api-access-jdzm8\") pod \"migrator-fdbb8fdff-l8p6l\" (UID: \"b726bc14-ba52-4c9f-a4e3-2e13164cd6d2\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" Sep 07 13:02:05.674295 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.674271 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzm8\" (UniqueName: \"kubernetes.io/projected/b726bc14-ba52-4c9f-a4e3-2e13164cd6d2-kube-api-access-jdzm8\") pod \"migrator-fdbb8fdff-l8p6l\" (UID: \"b726bc14-ba52-4c9f-a4e3-2e13164cd6d2\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" Sep 07 13:02:05.847257 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.847089 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" Sep 07 13:02:05.964902 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.964875 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/0.log" Sep 07 13:02:05.965049 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.964907 2579 generic.go:356] "Generic (PLEG): container finished" podID="750136a1-c5a0-4d33-a83d-c0d3d3eeed5f" containerID="2f3409eec072e9153cbd40f700e0573d0db1e90d2623eefcefe0c54fef1bcfd3" exitCode=255 Sep 07 13:02:05.965329 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.965134 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" event={"ID":"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f","Type":"ContainerDied","Data":"2f3409eec072e9153cbd40f700e0573d0db1e90d2623eefcefe0c54fef1bcfd3"} Sep 07 13:02:05.965329 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.965241 2579 scope.go:117] "RemoveContainer" containerID="2f3409eec072e9153cbd40f700e0573d0db1e90d2623eefcefe0c54fef1bcfd3" Sep 07 13:02:05.966798 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.966760 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" event={"ID":"ce23da70-f89a-4b06-9b18-472f812bc78f","Type":"ContainerStarted","Data":"caa6c01d2c07389a4539a2c1da6fd507161e6512dbfed28c4ef520f0f857a6e6"} Sep 07 13:02:05.968323 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.968292 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" event={"ID":"db85bc12-ba78-4952-874b-d18f318a738a","Type":"ContainerStarted","Data":"df192c296314505002b5ba3c2c35519740cce1c5ba6797ad8789185de41c9bb4"} Sep 07 13:02:05.993261 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:05.993213 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l"] Sep 07 13:02:05.999798 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:05.999773 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb726bc14_ba52_4c9f_a4e3_2e13164cd6d2.slice/crio-e8dc87c332232ffe6f47e704b3b7c813404b39a06f29fb877d03b8a9b19da1f4 WatchSource:0}: Error finding container e8dc87c332232ffe6f47e704b3b7c813404b39a06f29fb877d03b8a9b19da1f4: Status 404 returned error can't find the container with id e8dc87c332232ffe6f47e704b3b7c813404b39a06f29fb877d03b8a9b19da1f4 Sep 07 13:02:06.026028 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.025976 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" podStartSLOduration=1.971338292 podStartE2EDuration="5.025961167s" totalImagesPullingTime="3.054622875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:06.021029227 +0000 UTC m=+74.809334052" watchObservedRunningTime="2026-09-07 13:02:06.025961167 +0000 UTC m=+74.814265964" Sep 07 13:02:06.845580 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.845529 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" podStartSLOduration=2.80264786 podStartE2EDuration="5.845511619s" totalImagesPullingTime="3.042863759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:06.064433397 +0000 UTC m=+74.852738195" watchObservedRunningTime="2026-09-07 13:02:06.845511619 +0000 UTC m=+75.633816416" Sep 07 13:02:06.846288 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.846240 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-877rr"] Sep 07 13:02:06.849584 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.849567 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.854481 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.854457 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 07 13:02:06.854803 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.854782 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 07 13:02:06.854903 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.854837 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gzntm\"" Sep 07 13:02:06.868027 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.868000 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-877rr"] Sep 07 13:02:06.874269 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.874246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-crio-socket\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.874342 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.874282 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-data-volume\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.874342 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.874311 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.874428 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.874373 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgh6\" (UniqueName: \"kubernetes.io/projected/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-api-access-4bgh6\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.874428 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.874407 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.974828 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.974774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-crio-socket\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.974828 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.974805 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-data-volume\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.974994 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.974827 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.974994 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.974892 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgh6\" (UniqueName: \"kubernetes.io/projected/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-api-access-4bgh6\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.974994 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.974907 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-crio-socket\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.974994 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.974926 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.974994 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:06.974989 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:02:06.975224 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:06.975055 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:07.475034452 +0000 UTC m=+76.263339249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : configmap "kube-rbac-proxy" not found Sep 07 13:02:06.975224 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:06.975057 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:02:06.975224 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:06.975113 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:07.475098434 +0000 UTC m=+76.263403210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : secret "insights-runtime-extractor-tls" not found Sep 07 13:02:06.975711 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.975693 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-data-volume\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:06.976116 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.976102 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/1.log" Sep 07 13:02:06.976545 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.976531 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/0.log" Sep 07 13:02:06.976619 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.976567 2579 generic.go:356] "Generic (PLEG): container finished" podID="750136a1-c5a0-4d33-a83d-c0d3d3eeed5f" containerID="9e0735e00b63b10520b797459acc7de8e74cb557eaf79a41be57983035d09329" exitCode=255 Sep 07 13:02:06.976707 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.976668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" event={"ID":"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f","Type":"ContainerDied","Data":"9e0735e00b63b10520b797459acc7de8e74cb557eaf79a41be57983035d09329"} Sep 07 13:02:06.976757 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.976741 2579 scope.go:117] "RemoveContainer" containerID="2f3409eec072e9153cbd40f700e0573d0db1e90d2623eefcefe0c54fef1bcfd3" Sep 07 13:02:06.976954 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.976940 2579 scope.go:117] "RemoveContainer" containerID="9e0735e00b63b10520b797459acc7de8e74cb557eaf79a41be57983035d09329" Sep 07 13:02:06.977107 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:06.977085 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-d7kvx_openshift-console-operator(750136a1-c5a0-4d33-a83d-c0d3d3eeed5f)\"" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" podUID="750136a1-c5a0-4d33-a83d-c0d3d3eeed5f" Sep 07 13:02:06.978339 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.978174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" event={"ID":"b726bc14-ba52-4c9f-a4e3-2e13164cd6d2","Type":"ContainerStarted","Data":"e8dc87c332232ffe6f47e704b3b7c813404b39a06f29fb877d03b8a9b19da1f4"} Sep 07 13:02:06.986978 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:06.986953 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgh6\" (UniqueName: \"kubernetes.io/projected/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-api-access-4bgh6\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:07.477854 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:07.477828 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:07.477975 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:07.477870 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:07.477975 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:07.477940 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:02:07.477975 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:07.477948 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:02:07.478088 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:07.477985 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:08.477972308 +0000 UTC m=+77.266277084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : secret "insights-runtime-extractor-tls" not found Sep 07 13:02:07.478088 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:07.478018 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:08.478000423 +0000 UTC m=+77.266305205 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : configmap "kube-rbac-proxy" not found Sep 07 13:02:07.983957 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:07.983928 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/1.log" Sep 07 13:02:07.984286 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:07.984269 2579 scope.go:117] "RemoveContainer" containerID="9e0735e00b63b10520b797459acc7de8e74cb557eaf79a41be57983035d09329" Sep 07 13:02:07.984446 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:07.984426 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-d7kvx_openshift-console-operator(750136a1-c5a0-4d33-a83d-c0d3d3eeed5f)\"" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" podUID="750136a1-c5a0-4d33-a83d-c0d3d3eeed5f" Sep 07 13:02:08.484433 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:08.484396 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:08.484594 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:08.484452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:08.484594 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:08.484543 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:02:08.484594 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:08.484568 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:02:08.484725 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:08.484620 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:10.484600434 +0000 UTC m=+79.272905251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : configmap "kube-rbac-proxy" not found Sep 07 13:02:08.484725 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:08.484639 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:10.484630351 +0000 UTC m=+79.272935134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : secret "insights-runtime-extractor-tls" not found Sep 07 13:02:09.394366 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:09.394333 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-644ph_07a8a0b6-0f52-4ace-8bac-404be420bebf/dns-node-resolver/0.log" Sep 07 13:02:10.498887 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:10.498846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:10.499246 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:10.498901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:10.499246 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:10.498966 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:02:10.499246 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:10.498992 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:02:10.499246 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:10.499026 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:14.499010897 +0000 UTC m=+83.287315671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : configmap "kube-rbac-proxy" not found Sep 07 13:02:10.499246 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:10.499040 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:14.499033907 +0000 UTC m=+83.287338682 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : secret "insights-runtime-extractor-tls" not found Sep 07 13:02:10.794235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:10.794199 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzgwf_8909dd03-0c85-40a4-9252-29a07ab443b7/node-ca/0.log" Sep 07 13:02:10.995957 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:10.995924 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" event={"ID":"b726bc14-ba52-4c9f-a4e3-2e13164cd6d2","Type":"ContainerStarted","Data":"f0fe4525673d640554236dfc0cb384eea2bca6ac07ccc4fae1ac66149c8638eb"} Sep 07 13:02:10.996095 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:10.995983 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" event={"ID":"b726bc14-ba52-4c9f-a4e3-2e13164cd6d2","Type":"ContainerStarted","Data":"78e963818e637d9be24f2deb0154d9fea9c830e65db40c374b65c9fac9982a1b"} Sep 07 13:02:11.013814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:11.013722 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-l8p6l" podStartSLOduration=2.069639883 podStartE2EDuration="6.013707115s" totalImagesPullingTime="3.944067232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:11.012913524 +0000 UTC m=+79.801218321" watchObservedRunningTime="2026-09-07 13:02:11.013707115 +0000 UTC m=+79.802011908" Sep 07 13:02:11.394734 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:11.394702 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82k98_8c45569e-b83b-4828-b86a-eb20a15e5646/serve-healthcheck-canary/0.log" Sep 07 13:02:11.798757 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:11.798732 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-l8p6l_b726bc14-ba52-4c9f-a4e3-2e13164cd6d2/migrator/0.log" Sep 07 13:02:11.994107 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:11.994083 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-l8p6l_b726bc14-ba52-4c9f-a4e3-2e13164cd6d2/graceful-termination/0.log" Sep 07 13:02:12.066930 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:12.066880 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:12.066930 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:12.066918 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:12.067186 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:12.067170 2579 scope.go:117] "RemoveContainer" containerID="9e0735e00b63b10520b797459acc7de8e74cb557eaf79a41be57983035d09329" Sep 07 13:02:12.067350 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:12.067331 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-d7kvx_openshift-console-operator(750136a1-c5a0-4d33-a83d-c0d3d3eeed5f)\"" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" podUID="750136a1-c5a0-4d33-a83d-c0d3d3eeed5f" Sep 07 13:02:14.531041 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:14.530881 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:14.531041 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:14.530936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:14.531041 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:14.531021 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 07 13:02:14.531041 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:14.531043 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:02:14.531642 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:14.531113 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:22.531087563 +0000 UTC m=+91.319392341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : configmap "kube-rbac-proxy" not found Sep 07 13:02:14.531642 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:14.531135 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:22.531125209 +0000 UTC m=+91.319429983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : secret "insights-runtime-extractor-tls" not found Sep 07 13:02:22.585243 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:22.585205 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:22.585729 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:22.585261 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:22.585729 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:22.585354 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 07 13:02:22.585729 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:22.585410 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls podName:341eb6c7-3c7b-4e3e-845e-d118ff21cb4a nodeName:}" failed. No retries permitted until 2026-09-07 13:02:38.585395842 +0000 UTC m=+107.373700617 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-877rr" (UID: "341eb6c7-3c7b-4e3e-845e-d118ff21cb4a") : secret "insights-runtime-extractor-tls" not found Sep 07 13:02:22.585868 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:22.585805 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:24.692446 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:24.692412 2579 scope.go:117] "RemoveContainer" containerID="9e0735e00b63b10520b797459acc7de8e74cb557eaf79a41be57983035d09329" Sep 07 13:02:25.045862 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:25.045831 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:02:25.046271 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:25.046256 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/1.log" Sep 07 13:02:25.046325 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:25.046290 2579 generic.go:356] "Generic (PLEG): container finished" podID="750136a1-c5a0-4d33-a83d-c0d3d3eeed5f" containerID="2eca691d5bdef285cab7b7ec28e9d173c04411e94e0854ac8d2c885571427a4a" exitCode=255 Sep 07 13:02:25.046357 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:25.046320 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" event={"ID":"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f","Type":"ContainerDied","Data":"2eca691d5bdef285cab7b7ec28e9d173c04411e94e0854ac8d2c885571427a4a"} Sep 07 13:02:25.046394 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:25.046369 2579 scope.go:117] "RemoveContainer" containerID="9e0735e00b63b10520b797459acc7de8e74cb557eaf79a41be57983035d09329" Sep 07 13:02:25.046658 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:25.046636 2579 scope.go:117] "RemoveContainer" containerID="2eca691d5bdef285cab7b7ec28e9d173c04411e94e0854ac8d2c885571427a4a" Sep 07 13:02:25.046876 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:25.046852 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-d7kvx_openshift-console-operator(750136a1-c5a0-4d33-a83d-c0d3d3eeed5f)\"" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" podUID="750136a1-c5a0-4d33-a83d-c0d3d3eeed5f" Sep 07 13:02:26.052003 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:26.051974 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:02:29.938911 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:29.938864 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:02:29.941488 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:29.941464 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3c98e737-285d-4902-8f5f-b97ba1ae3423-metrics-tls\") pod \"dns-default-sgwbc\" (UID: \"3c98e737-285d-4902-8f5f-b97ba1ae3423\") " pod="openshift-dns/dns-default-sgwbc" Sep 07 13:02:30.030729 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:30.030705 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77fxd\"" Sep 07 13:02:30.039006 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:30.038979 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sgwbc" Sep 07 13:02:30.312734 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:30.312708 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sgwbc"] Sep 07 13:02:30.315770 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:30.315745 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c98e737_285d_4902_8f5f_b97ba1ae3423.slice/crio-5fbd0550baa268182effc06a9f60668e5b0311c05c9f22b887e7d5e49592b368 WatchSource:0}: Error finding container 5fbd0550baa268182effc06a9f60668e5b0311c05c9f22b887e7d5e49592b368: Status 404 returned error can't find the container with id 5fbd0550baa268182effc06a9f60668e5b0311c05c9f22b887e7d5e49592b368 Sep 07 13:02:31.069526 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:31.069490 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgwbc" event={"ID":"3c98e737-285d-4902-8f5f-b97ba1ae3423","Type":"ContainerStarted","Data":"5fbd0550baa268182effc06a9f60668e5b0311c05c9f22b887e7d5e49592b368"} Sep 07 13:02:32.066853 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.066819 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:32.067179 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.066878 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:32.067285 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.067214 2579 scope.go:117] "RemoveContainer" containerID="2eca691d5bdef285cab7b7ec28e9d173c04411e94e0854ac8d2c885571427a4a" Sep 07 13:02:32.067468 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:02:32.067428 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-85b454874b-d7kvx_openshift-console-operator(750136a1-c5a0-4d33-a83d-c0d3d3eeed5f)\"" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" podUID="750136a1-c5a0-4d33-a83d-c0d3d3eeed5f" Sep 07 13:02:32.075996 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.075962 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgwbc" event={"ID":"3c98e737-285d-4902-8f5f-b97ba1ae3423","Type":"ContainerStarted","Data":"7f0ab8bcf6e9ba72d4dd19ad2e0057bdc966739162a0719ae289fdf6a05ec965"} Sep 07 13:02:32.695036 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.695008 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97"] Sep 07 13:02:32.735188 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.735168 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97"] Sep 07 13:02:32.735288 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.735258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.738315 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.738296 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 07 13:02:32.738429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.738339 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 07 13:02:32.738429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.738343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 07 13:02:32.738543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.738343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 07 13:02:32.739492 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.739473 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 07 13:02:32.739597 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.739503 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 07 13:02:32.739597 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.739556 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 07 13:02:32.862487 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.862453 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-ca\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.862598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.862514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.862598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.862562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ww58\" (UniqueName: \"kubernetes.io/projected/faa0903e-f1eb-4db0-8a4d-da45b5eada13-kube-api-access-8ww58\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.862736 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.862604 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-hub\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.862736 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.862621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.862736 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.862637 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/faa0903e-f1eb-4db0-8a4d-da45b5eada13-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.963367 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.963313 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-hub\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.963367 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.963338 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.963367 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.963356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/faa0903e-f1eb-4db0-8a4d-da45b5eada13-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.963557 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.963387 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-ca\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.963557 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.963420 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.963557 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.963439 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ww58\" (UniqueName: \"kubernetes.io/projected/faa0903e-f1eb-4db0-8a4d-da45b5eada13-kube-api-access-8ww58\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.964114 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.964076 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/faa0903e-f1eb-4db0-8a4d-da45b5eada13-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.966223 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.966200 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-ca\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.966317 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.966275 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.966425 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.966406 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.966601 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.966582 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/faa0903e-f1eb-4db0-8a4d-da45b5eada13-hub\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:32.972808 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:32.972788 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ww58\" (UniqueName: \"kubernetes.io/projected/faa0903e-f1eb-4db0-8a4d-da45b5eada13-kube-api-access-8ww58\") pod \"cluster-proxy-proxy-agent-68bd99df49-nwd97\" (UID: \"faa0903e-f1eb-4db0-8a4d-da45b5eada13\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:33.051945 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:33.051922 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" Sep 07 13:02:33.081848 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:33.081821 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgwbc" event={"ID":"3c98e737-285d-4902-8f5f-b97ba1ae3423","Type":"ContainerStarted","Data":"a919b5f85e42879e9c6f23878cd084d894385bec76743d5c50d49f8e39879e39"} Sep 07 13:02:33.082136 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:33.081895 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sgwbc" Sep 07 13:02:33.105322 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:33.105274 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sgwbc" podStartSLOduration=65.472376433 podStartE2EDuration="1m7.105260135s" totalImagesPullingTime="1.632883702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:33.104011569 +0000 UTC m=+101.892316367" watchObservedRunningTime="2026-09-07 13:02:33.105260135 +0000 UTC m=+101.893564940" Sep 07 13:02:33.350979 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:33.350957 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97"] Sep 07 13:02:33.353176 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:33.353146 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfaa0903e_f1eb_4db0_8a4d_da45b5eada13.slice/crio-e52c54c485d114f4a8fd097fb058cd1ec973f9ec890846d24f68b5a172733a5e WatchSource:0}: Error finding container e52c54c485d114f4a8fd097fb058cd1ec973f9ec890846d24f68b5a172733a5e: Status 404 returned error can't find the container with id e52c54c485d114f4a8fd097fb058cd1ec973f9ec890846d24f68b5a172733a5e Sep 07 13:02:33.959655 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:33.959620 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2tvj7" Sep 07 13:02:34.087088 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:34.087044 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" event={"ID":"faa0903e-f1eb-4db0-8a4d-da45b5eada13","Type":"ContainerStarted","Data":"e52c54c485d114f4a8fd097fb058cd1ec973f9ec890846d24f68b5a172733a5e"} Sep 07 13:02:38.103380 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:38.103346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" event={"ID":"faa0903e-f1eb-4db0-8a4d-da45b5eada13","Type":"ContainerStarted","Data":"d945e93ada2d9bef851329671a78a78e24afafca519c9cca592fae805a2d3657"} Sep 07 13:02:38.103851 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:38.103398 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" event={"ID":"faa0903e-f1eb-4db0-8a4d-da45b5eada13","Type":"ContainerStarted","Data":"bc846dde5f3923c9e8a51983ebb5422022294c23da8725ca4a6b19e937dd11d5"} Sep 07 13:02:38.103851 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:38.103416 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" event={"ID":"faa0903e-f1eb-4db0-8a4d-da45b5eada13","Type":"ContainerStarted","Data":"3e2020eed9bb57257acd4b25cb71ca6ca32c68d07fa6f3a1525cfc3ccab4c54b"} Sep 07 13:02:38.127169 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:38.127117 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bd99df49-nwd97" podStartSLOduration=2.088439047 podStartE2EDuration="6.127101988s" totalImagesPullingTime="4.038662941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:38.126495582 +0000 UTC m=+106.914800379" watchObservedRunningTime="2026-09-07 13:02:38.127101988 +0000 UTC m=+106.915406785" Sep 07 13:02:38.605893 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:38.605862 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:38.608364 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:38.608342 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/341eb6c7-3c7b-4e3e-845e-d118ff21cb4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-877rr\" (UID: \"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a\") " pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:38.658454 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:38.658431 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-877rr" Sep 07 13:02:38.948490 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:38.948416 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-877rr"] Sep 07 13:02:38.951182 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:38.951150 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341eb6c7_3c7b_4e3e_845e_d118ff21cb4a.slice/crio-9f20dfe40078fa0548de9123daf0c3cb6fca9b7d9c003e120619b5d7d3871bc8 WatchSource:0}: Error finding container 9f20dfe40078fa0548de9123daf0c3cb6fca9b7d9c003e120619b5d7d3871bc8: Status 404 returned error can't find the container with id 9f20dfe40078fa0548de9123daf0c3cb6fca9b7d9c003e120619b5d7d3871bc8 Sep 07 13:02:39.107793 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:39.107765 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-877rr" event={"ID":"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a","Type":"ContainerStarted","Data":"1a39728d8da3b68be79b929cb4525551087a1af1252595fbfaf28867654419ac"} Sep 07 13:02:39.108112 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:39.107821 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-877rr" event={"ID":"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a","Type":"ContainerStarted","Data":"9f20dfe40078fa0548de9123daf0c3cb6fca9b7d9c003e120619b5d7d3871bc8"} Sep 07 13:02:40.113242 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:40.113214 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-877rr" event={"ID":"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a","Type":"ContainerStarted","Data":"958b67193e5c27b0b57f3e6e6595ead357dd2f175e90faa73f6bae62c70bb76f"} Sep 07 13:02:42.122616 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:42.122576 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-877rr" event={"ID":"341eb6c7-3c7b-4e3e-845e-d118ff21cb4a","Type":"ContainerStarted","Data":"336054c6c5d94e15029809f8e72756732e2763d3c37782d7cf3a00224ffae374"} Sep 07 13:02:42.145854 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:42.145806 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-877rr" podStartSLOduration=33.916971344 podStartE2EDuration="36.145790503s" totalImagesPullingTime="2.228819159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:02:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:42.145451484 +0000 UTC m=+110.933756281" watchObservedRunningTime="2026-09-07 13:02:42.145790503 +0000 UTC m=+110.934095300" Sep 07 13:02:43.089273 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:43.089233 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sgwbc" Sep 07 13:02:45.922574 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.922540 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2w766"] Sep 07 13:02:45.927117 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.927099 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:45.929989 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.929968 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 07 13:02:45.930464 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.930446 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgwh9\"" Sep 07 13:02:45.931280 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.931253 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 07 13:02:45.931520 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.931501 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 07 13:02:45.931622 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.931535 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 07 13:02:45.931622 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.931545 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 07 13:02:45.931622 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:45.931578 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 07 13:02:46.050828 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.050805 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh6qs\" (UniqueName: \"kubernetes.io/projected/e8184954-02cd-4324-87fe-8ad0de5dd77d-kube-api-access-sh6qs\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.050828 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.050830 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-textfile\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.050987 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.050852 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-sys\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.050987 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.050870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-tls\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.050987 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.050966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-accelerators-collector-config\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.051142 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.050999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-wtmp\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.051142 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.051032 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8184954-02cd-4324-87fe-8ad0de5dd77d-metrics-client-ca\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.051142 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.051070 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-root\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.051142 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.051105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151479 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151452 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-sys\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151594 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151486 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-tls\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151594 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-accelerators-collector-config\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151594 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151554 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-sys\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151594 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151565 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-wtmp\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151842 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151595 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8184954-02cd-4324-87fe-8ad0de5dd77d-metrics-client-ca\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151842 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151624 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-root\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151842 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151661 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151842 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151724 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh6qs\" (UniqueName: \"kubernetes.io/projected/e8184954-02cd-4324-87fe-8ad0de5dd77d-kube-api-access-sh6qs\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151842 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151753 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-textfile\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151842 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151752 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-wtmp\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.151842 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.151750 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e8184954-02cd-4324-87fe-8ad0de5dd77d-root\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.152156 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.152122 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-textfile\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.152335 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.152227 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-accelerators-collector-config\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.152335 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.152303 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e8184954-02cd-4324-87fe-8ad0de5dd77d-metrics-client-ca\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.153966 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.153941 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-tls\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.154074 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.154055 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e8184954-02cd-4324-87fe-8ad0de5dd77d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.160744 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.160725 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh6qs\" (UniqueName: \"kubernetes.io/projected/e8184954-02cd-4324-87fe-8ad0de5dd77d-kube-api-access-sh6qs\") pod \"node-exporter-2w766\" (UID: \"e8184954-02cd-4324-87fe-8ad0de5dd77d\") " pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.236468 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.236424 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2w766" Sep 07 13:02:46.248018 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:46.247993 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8184954_02cd_4324_87fe_8ad0de5dd77d.slice/crio-f1173235c7e8924926cf14bd18b6d1756a0a55a4e2a89fb3a139ca2d85479a8c WatchSource:0}: Error finding container f1173235c7e8924926cf14bd18b6d1756a0a55a4e2a89fb3a139ca2d85479a8c: Status 404 returned error can't find the container with id f1173235c7e8924926cf14bd18b6d1756a0a55a4e2a89fb3a139ca2d85479a8c Sep 07 13:02:46.692505 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:46.692482 2579 scope.go:117] "RemoveContainer" containerID="2eca691d5bdef285cab7b7ec28e9d173c04411e94e0854ac8d2c885571427a4a" Sep 07 13:02:47.143835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:47.142713 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:02:47.143835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:47.142839 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" event={"ID":"750136a1-c5a0-4d33-a83d-c0d3d3eeed5f","Type":"ContainerStarted","Data":"0156a37aa8ebf1969279ea6a47cf85598a2f0667e25a3a43b746f2e70ddcaea9"} Sep 07 13:02:47.143835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:47.143779 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:47.145457 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:47.145419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2w766" event={"ID":"e8184954-02cd-4324-87fe-8ad0de5dd77d","Type":"ContainerStarted","Data":"f1173235c7e8924926cf14bd18b6d1756a0a55a4e2a89fb3a139ca2d85479a8c"} Sep 07 13:02:47.191670 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:47.191621 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" podStartSLOduration=43.154197232 podStartE2EDuration="46.191603844s" totalImagesPullingTime="3.037406612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:47.189409918 +0000 UTC m=+115.977714716" watchObservedRunningTime="2026-09-07 13:02:47.191603844 +0000 UTC m=+115.979908642" Sep 07 13:02:47.357395 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:47.357364 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-d7kvx" Sep 07 13:02:48.150267 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:48.150233 2579 generic.go:356] "Generic (PLEG): container finished" podID="e8184954-02cd-4324-87fe-8ad0de5dd77d" containerID="c252fbcd1fdd0b0b28abecba634d6fecba45033827e42e7347711157f652507a" exitCode=0 Sep 07 13:02:48.150615 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:48.150327 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2w766" event={"ID":"e8184954-02cd-4324-87fe-8ad0de5dd77d","Type":"ContainerDied","Data":"c252fbcd1fdd0b0b28abecba634d6fecba45033827e42e7347711157f652507a"} Sep 07 13:02:49.156518 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:49.156479 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2w766" event={"ID":"e8184954-02cd-4324-87fe-8ad0de5dd77d","Type":"ContainerStarted","Data":"1918ebea4a155d63c0135237b38c366bedb9a84f28ed843524a7696609c21929"} Sep 07 13:02:49.157044 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:49.156539 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2w766" event={"ID":"e8184954-02cd-4324-87fe-8ad0de5dd77d","Type":"ContainerStarted","Data":"19a73fb97376e01b029bee104ba214ef5e578c107a795efc05cadde0151a2e02"} Sep 07 13:02:49.185025 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:49.184972 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2w766" podStartSLOduration=2.862675546 podStartE2EDuration="4.184955193s" totalImagesPullingTime="1.249150209s" totalInitContainerRuntime="73.129438ms" isStatefulPod=true podCreationTimestamp="2026-09-07 13:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:49.183460569 +0000 UTC m=+117.971765358" watchObservedRunningTime="2026-09-07 13:02:49.184955193 +0000 UTC m=+117.973259989" Sep 07 13:02:50.242776 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.242743 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54447957f8-q4fxv"] Sep 07 13:02:50.245998 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.245976 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.248717 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.248689 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 07 13:02:50.248824 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.248756 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 07 13:02:50.249796 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.249774 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8mvdivaqapr6h\"" Sep 07 13:02:50.249921 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.249795 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 07 13:02:50.250272 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.250244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t6p9z\"" Sep 07 13:02:50.250272 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.250256 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 07 13:02:50.256414 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.256390 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54447957f8-q4fxv"] Sep 07 13:02:50.385004 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.384979 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91763165-6363-411b-9840-044fadc6a3ce-metrics-server-audit-profiles\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.385110 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.385040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-client-ca-bundle\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.385110 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.385071 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-secret-metrics-server-tls\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.385110 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.385087 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91763165-6363-411b-9840-044fadc6a3ce-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.385110 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.385104 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l82gq\" (UniqueName: \"kubernetes.io/projected/91763165-6363-411b-9840-044fadc6a3ce-kube-api-access-l82gq\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.385260 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.385131 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-secret-metrics-server-client-certs\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.385260 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.385160 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91763165-6363-411b-9840-044fadc6a3ce-audit-log\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.486360 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.486329 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91763165-6363-411b-9840-044fadc6a3ce-audit-log\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.486487 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.486364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91763165-6363-411b-9840-044fadc6a3ce-metrics-server-audit-profiles\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.486487 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.486405 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-client-ca-bundle\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.486487 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.486428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-secret-metrics-server-tls\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.486487 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.486454 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91763165-6363-411b-9840-044fadc6a3ce-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.486487 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.486478 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l82gq\" (UniqueName: \"kubernetes.io/projected/91763165-6363-411b-9840-044fadc6a3ce-kube-api-access-l82gq\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.486792 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.486506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-secret-metrics-server-client-certs\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.486922 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.486893 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91763165-6363-411b-9840-044fadc6a3ce-audit-log\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.487297 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.487269 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91763165-6363-411b-9840-044fadc6a3ce-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.487497 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.487480 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91763165-6363-411b-9840-044fadc6a3ce-metrics-server-audit-profiles\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.489352 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.489321 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-secret-metrics-server-tls\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.489455 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.489427 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-secret-metrics-server-client-certs\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.489851 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.489828 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91763165-6363-411b-9840-044fadc6a3ce-client-ca-bundle\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.495645 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.495591 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l82gq\" (UniqueName: \"kubernetes.io/projected/91763165-6363-411b-9840-044fadc6a3ce-kube-api-access-l82gq\") pod \"metrics-server-54447957f8-q4fxv\" (UID: \"91763165-6363-411b-9840-044fadc6a3ce\") " pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.556732 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.556705 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:02:50.860597 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:50.860574 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54447957f8-q4fxv"] Sep 07 13:02:50.862827 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:02:50.862795 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91763165_6363_411b_9840_044fadc6a3ce.slice/crio-fd64a96674428bcc2ce396d7fc9580e7849ad572df8fd2c7f2ea6bd8698de300 WatchSource:0}: Error finding container fd64a96674428bcc2ce396d7fc9580e7849ad572df8fd2c7f2ea6bd8698de300: Status 404 returned error can't find the container with id fd64a96674428bcc2ce396d7fc9580e7849ad572df8fd2c7f2ea6bd8698de300 Sep 07 13:02:51.169970 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:51.169896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" event={"ID":"91763165-6363-411b-9840-044fadc6a3ce","Type":"ContainerStarted","Data":"fd64a96674428bcc2ce396d7fc9580e7849ad572df8fd2c7f2ea6bd8698de300"} Sep 07 13:02:54.182174 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:54.182137 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" event={"ID":"91763165-6363-411b-9840-044fadc6a3ce","Type":"ContainerStarted","Data":"0869b3c1bd979790e547ea2426642a76c6cec9b8fcb568b5377e86130fd50f05"} Sep 07 13:02:54.227772 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:02:54.227728 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" podStartSLOduration=1.803396418 podStartE2EDuration="4.227711736s" totalImagesPullingTime="2.424315318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:54.227581719 +0000 UTC m=+123.015886527" watchObservedRunningTime="2026-09-07 13:02:54.227711736 +0000 UTC m=+123.016016592" Sep 07 13:03:01.469850 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:01.469803 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:03:01.472721 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:01.472660 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0dc9eb65-272c-4303-8892-bef137df8bd6-metrics-certs\") pod \"network-metrics-daemon-j944k\" (UID: \"0dc9eb65-272c-4303-8892-bef137df8bd6\") " pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:03:01.508548 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:01.508517 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sgcc8\"" Sep 07 13:03:01.516006 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:01.515985 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-j944k" Sep 07 13:03:01.792296 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:01.792272 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-j944k"] Sep 07 13:03:01.794612 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:03:01.794588 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc9eb65_272c_4303_8892_bef137df8bd6.slice/crio-571ba9e844825b4a8ff94a44f00a3adfb270cf4af4ab08577e7994a69136b58f WatchSource:0}: Error finding container 571ba9e844825b4a8ff94a44f00a3adfb270cf4af4ab08577e7994a69136b58f: Status 404 returned error can't find the container with id 571ba9e844825b4a8ff94a44f00a3adfb270cf4af4ab08577e7994a69136b58f Sep 07 13:03:02.212435 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:02.212346 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j944k" event={"ID":"0dc9eb65-272c-4303-8892-bef137df8bd6","Type":"ContainerStarted","Data":"571ba9e844825b4a8ff94a44f00a3adfb270cf4af4ab08577e7994a69136b58f"} Sep 07 13:03:03.217932 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:03.217896 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j944k" event={"ID":"0dc9eb65-272c-4303-8892-bef137df8bd6","Type":"ContainerStarted","Data":"4945482dc5d1a405942623b7082d4962667263329900e8b59e0afb907232c630"} Sep 07 13:03:03.218354 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:03.217958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-j944k" event={"ID":"0dc9eb65-272c-4303-8892-bef137df8bd6","Type":"ContainerStarted","Data":"246c45f7cf3cfdbc1e13c0a781b1ebb50f6d8b1d0e08114e92f7346930b79de7"} Sep 07 13:03:03.241259 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:03.241213 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-j944k" podStartSLOduration=131.313261763 podStartE2EDuration="2m12.241200241s" totalImagesPullingTime="927.938478ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:03:03.239251744 +0000 UTC m=+132.027556542" watchObservedRunningTime="2026-09-07 13:03:03.241200241 +0000 UTC m=+132.029505100" Sep 07 13:03:04.306201 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.306172 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-684dcb6774-q8slq"] Sep 07 13:03:04.309152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.309136 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.315298 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.315071 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 13:03:04.316113 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.316089 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 13:03:04.316286 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.316093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 13:03:04.316399 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.316093 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 13:03:04.316399 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.316378 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 13:03:04.316506 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.316161 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 13:03:04.316506 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.316154 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jwmrq\"" Sep 07 13:03:04.316743 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.316726 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 13:03:04.322182 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.322165 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 07 13:03:04.327085 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.327067 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684dcb6774-q8slq"] Sep 07 13:03:04.493438 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.493410 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-trusted-ca-bundle\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.493438 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.493445 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-oauth-serving-cert\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.493598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.493463 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnkqq\" (UniqueName: \"kubernetes.io/projected/4a491823-c0d2-43d9-8584-3b18f3b6e855-kube-api-access-mnkqq\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.493598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.493516 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-oauth-config\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.493598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.493554 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-serving-cert\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.493598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.493574 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-service-ca\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.493749 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.493626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-config\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.594759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-trusted-ca-bundle\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.594812 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-oauth-serving-cert\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.594846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnkqq\" (UniqueName: \"kubernetes.io/projected/4a491823-c0d2-43d9-8584-3b18f3b6e855-kube-api-access-mnkqq\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.594895 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-oauth-config\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.594936 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-serving-cert\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.594964 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-service-ca\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.595004 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-config\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.595794 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-config\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.596803 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-trusted-ca-bundle\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.599442 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.597366 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-oauth-serving-cert\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.600190 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.599730 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-service-ca\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.600623 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.600594 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-oauth-config\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.601801 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.601779 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-serving-cert\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.609416 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.609387 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnkqq\" (UniqueName: \"kubernetes.io/projected/4a491823-c0d2-43d9-8584-3b18f3b6e855-kube-api-access-mnkqq\") pod \"console-684dcb6774-q8slq\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.618098 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.618076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:04.908287 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:04.908264 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684dcb6774-q8slq"] Sep 07 13:03:04.910030 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:03:04.910004 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a491823_c0d2_43d9_8584_3b18f3b6e855.slice/crio-2ac0f81651a46ac74c332b825c2e4625ca93800aa54d93fad635e514f0b08c4b WatchSource:0}: Error finding container 2ac0f81651a46ac74c332b825c2e4625ca93800aa54d93fad635e514f0b08c4b: Status 404 returned error can't find the container with id 2ac0f81651a46ac74c332b825c2e4625ca93800aa54d93fad635e514f0b08c4b Sep 07 13:03:05.228569 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:05.228487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684dcb6774-q8slq" event={"ID":"4a491823-c0d2-43d9-8584-3b18f3b6e855","Type":"ContainerStarted","Data":"2ac0f81651a46ac74c332b825c2e4625ca93800aa54d93fad635e514f0b08c4b"} Sep 07 13:03:08.243476 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:08.243443 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684dcb6774-q8slq" event={"ID":"4a491823-c0d2-43d9-8584-3b18f3b6e855","Type":"ContainerStarted","Data":"88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1"} Sep 07 13:03:08.263782 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:08.263736 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-684dcb6774-q8slq" podStartSLOduration=1.411682866 podStartE2EDuration="4.263720511s" totalImagesPullingTime="2.852037645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:03:08.263648501 +0000 UTC m=+137.051953299" watchObservedRunningTime="2026-09-07 13:03:08.263720511 +0000 UTC m=+137.052025308" Sep 07 13:03:10.556775 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:10.556742 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:03:10.557133 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:10.556819 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:03:14.618704 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:14.618642 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:14.619209 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:14.618775 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:14.623969 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:14.623943 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:15.272471 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:15.272444 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:03:22.294730 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:22.294668 2579 generic.go:356] "Generic (PLEG): container finished" podID="db85bc12-ba78-4952-874b-d18f318a738a" containerID="df192c296314505002b5ba3c2c35519740cce1c5ba6797ad8789185de41c9bb4" exitCode=0 Sep 07 13:03:22.295199 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:22.294749 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" event={"ID":"db85bc12-ba78-4952-874b-d18f318a738a","Type":"ContainerDied","Data":"df192c296314505002b5ba3c2c35519740cce1c5ba6797ad8789185de41c9bb4"} Sep 07 13:03:22.295199 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:22.295162 2579 scope.go:117] "RemoveContainer" containerID="df192c296314505002b5ba3c2c35519740cce1c5ba6797ad8789185de41c9bb4" Sep 07 13:03:23.301633 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:23.301599 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-zkzk5" event={"ID":"db85bc12-ba78-4952-874b-d18f318a738a","Type":"ContainerStarted","Data":"3a15d103d3aece70da1fb6994d4807dd6fab3f10d9f6994c61244ac7c8fdaeb2"} Sep 07 13:03:30.563159 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:30.563127 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:03:30.567146 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:30.567122 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54447957f8-q4fxv" Sep 07 13:03:36.351749 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:36.351712 2579 generic.go:356] "Generic (PLEG): container finished" podID="ce23da70-f89a-4b06-9b18-472f812bc78f" containerID="caa6c01d2c07389a4539a2c1da6fd507161e6512dbfed28c4ef520f0f857a6e6" exitCode=0 Sep 07 13:03:36.352077 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:36.351779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" event={"ID":"ce23da70-f89a-4b06-9b18-472f812bc78f","Type":"ContainerDied","Data":"caa6c01d2c07389a4539a2c1da6fd507161e6512dbfed28c4ef520f0f857a6e6"} Sep 07 13:03:36.352121 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:36.352101 2579 scope.go:117] "RemoveContainer" containerID="caa6c01d2c07389a4539a2c1da6fd507161e6512dbfed28c4ef520f0f857a6e6" Sep 07 13:03:37.357715 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:03:37.357668 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-29kxx" event={"ID":"ce23da70-f89a-4b06-9b18-472f812bc78f","Type":"ContainerStarted","Data":"e70bbed14ba2ddfa5519f694e3050f1d355ff42b1c306c92d031a78bf8fdfe19"} Sep 07 13:04:24.960057 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:24.960019 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684dcb6774-q8slq"] Sep 07 13:04:49.980697 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:49.980642 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-684dcb6774-q8slq" podUID="4a491823-c0d2-43d9-8584-3b18f3b6e855" containerName="console" containerID="cri-o://88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1" gracePeriod=15 Sep 07 13:04:50.219481 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.219459 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:04:50.319098 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319074 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-oauth-config\") pod \"4a491823-c0d2-43d9-8584-3b18f3b6e855\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " Sep 07 13:04:50.319209 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319111 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-service-ca\") pod \"4a491823-c0d2-43d9-8584-3b18f3b6e855\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " Sep 07 13:04:50.319209 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319134 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-trusted-ca-bundle\") pod \"4a491823-c0d2-43d9-8584-3b18f3b6e855\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " Sep 07 13:04:50.319279 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319262 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-config\") pod \"4a491823-c0d2-43d9-8584-3b18f3b6e855\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " Sep 07 13:04:50.319333 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319315 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnkqq\" (UniqueName: \"kubernetes.io/projected/4a491823-c0d2-43d9-8584-3b18f3b6e855-kube-api-access-mnkqq\") pod \"4a491823-c0d2-43d9-8584-3b18f3b6e855\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " Sep 07 13:04:50.319395 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319344 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-serving-cert\") pod \"4a491823-c0d2-43d9-8584-3b18f3b6e855\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " Sep 07 13:04:50.319395 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319383 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-oauth-serving-cert\") pod \"4a491823-c0d2-43d9-8584-3b18f3b6e855\" (UID: \"4a491823-c0d2-43d9-8584-3b18f3b6e855\") " Sep 07 13:04:50.319602 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319567 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a491823-c0d2-43d9-8584-3b18f3b6e855" (UID: "4a491823-c0d2-43d9-8584-3b18f3b6e855"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:04:50.319759 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319603 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4a491823-c0d2-43d9-8584-3b18f3b6e855" (UID: "4a491823-c0d2-43d9-8584-3b18f3b6e855"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:04:50.319896 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319872 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a491823-c0d2-43d9-8584-3b18f3b6e855" (UID: "4a491823-c0d2-43d9-8584-3b18f3b6e855"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:04:50.319987 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.319721 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-config" (OuterVolumeSpecName: "console-config") pod "4a491823-c0d2-43d9-8584-3b18f3b6e855" (UID: "4a491823-c0d2-43d9-8584-3b18f3b6e855"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:04:50.321579 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.321559 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a491823-c0d2-43d9-8584-3b18f3b6e855" (UID: "4a491823-c0d2-43d9-8584-3b18f3b6e855"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:04:50.321694 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.321648 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a491823-c0d2-43d9-8584-3b18f3b6e855" (UID: "4a491823-c0d2-43d9-8584-3b18f3b6e855"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:04:50.321742 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.321656 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a491823-c0d2-43d9-8584-3b18f3b6e855-kube-api-access-mnkqq" (OuterVolumeSpecName: "kube-api-access-mnkqq") pod "4a491823-c0d2-43d9-8584-3b18f3b6e855" (UID: "4a491823-c0d2-43d9-8584-3b18f3b6e855"). InnerVolumeSpecName "kube-api-access-mnkqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:04:50.420496 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.420471 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-oauth-config\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:04:50.420496 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.420491 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-service-ca\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:04:50.420605 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.420501 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-trusted-ca-bundle\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:04:50.420605 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.420509 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-config\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:04:50.420605 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.420518 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnkqq\" (UniqueName: \"kubernetes.io/projected/4a491823-c0d2-43d9-8584-3b18f3b6e855-kube-api-access-mnkqq\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:04:50.420605 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.420526 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a491823-c0d2-43d9-8584-3b18f3b6e855-console-serving-cert\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:04:50.420605 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.420534 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a491823-c0d2-43d9-8584-3b18f3b6e855-oauth-serving-cert\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:04:50.635351 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.635281 2579 generic.go:356] "Generic (PLEG): container finished" podID="4a491823-c0d2-43d9-8584-3b18f3b6e855" containerID="88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1" exitCode=0 Sep 07 13:04:50.635351 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.635326 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684dcb6774-q8slq" Sep 07 13:04:50.635475 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.635365 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684dcb6774-q8slq" event={"ID":"4a491823-c0d2-43d9-8584-3b18f3b6e855","Type":"ContainerDied","Data":"88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1"} Sep 07 13:04:50.635475 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.635410 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684dcb6774-q8slq" event={"ID":"4a491823-c0d2-43d9-8584-3b18f3b6e855","Type":"ContainerDied","Data":"2ac0f81651a46ac74c332b825c2e4625ca93800aa54d93fad635e514f0b08c4b"} Sep 07 13:04:50.635475 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.635434 2579 scope.go:117] "RemoveContainer" containerID="88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1" Sep 07 13:04:50.644261 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.644239 2579 scope.go:117] "RemoveContainer" containerID="88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1" Sep 07 13:04:50.644573 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:04:50.644549 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1\": container with ID starting with 88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1 not found: ID does not exist" containerID="88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1" Sep 07 13:04:50.644646 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.644580 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1"} err="failed to get container status \"88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1\": rpc error: code = NotFound desc = could not find container \"88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1\": container with ID starting with 88e28a851595415ae123bf82cf24e31922463d02be24ccf14c1ea41057f293b1 not found: ID does not exist" Sep 07 13:04:50.657881 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.657852 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684dcb6774-q8slq"] Sep 07 13:04:50.660728 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:50.660705 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-684dcb6774-q8slq"] Sep 07 13:04:51.700885 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:04:51.700851 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a491823-c0d2-43d9-8584-3b18f3b6e855" path="/var/lib/kubelet/pods/4a491823-c0d2-43d9-8584-3b18f3b6e855/volumes" Sep 07 13:05:47.767806 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.767776 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f9bc9764d-qk49p"] Sep 07 13:05:47.768225 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.768055 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a491823-c0d2-43d9-8584-3b18f3b6e855" containerName="console" Sep 07 13:05:47.768225 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.768072 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a491823-c0d2-43d9-8584-3b18f3b6e855" containerName="console" Sep 07 13:05:47.768225 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.768150 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a491823-c0d2-43d9-8584-3b18f3b6e855" containerName="console" Sep 07 13:05:47.771043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.771021 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.773826 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.773800 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 07 13:05:47.774913 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.774893 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 07 13:05:47.775041 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.774970 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 07 13:05:47.775041 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.774982 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 07 13:05:47.775041 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.774983 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 07 13:05:47.775041 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.775011 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 07 13:05:47.775333 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.775313 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 07 13:05:47.775410 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.775322 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jwmrq\"" Sep 07 13:05:47.780822 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.780803 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 07 13:05:47.783624 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.783600 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9bc9764d-qk49p"] Sep 07 13:05:47.793213 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.793189 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-service-ca\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.793318 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.793244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-oauth-serving-cert\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.793318 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.793274 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-trusted-ca-bundle\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.793318 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.793304 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-console-config\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.793461 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.793348 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts247\" (UniqueName: \"kubernetes.io/projected/e636a679-cc5a-4f38-b326-74109befc9bd-kube-api-access-ts247\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.793461 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.793400 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-serving-cert\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.793461 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.793440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-oauth-config\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.893923 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.893900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-oauth-config\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.894044 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.893937 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-service-ca\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.894044 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.893962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-oauth-serving-cert\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.894044 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.893977 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-trusted-ca-bundle\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.894182 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.894102 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-console-config\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.894182 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.894144 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts247\" (UniqueName: \"kubernetes.io/projected/e636a679-cc5a-4f38-b326-74109befc9bd-kube-api-access-ts247\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.894287 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.894188 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-serving-cert\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.894766 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.894740 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-service-ca\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.894868 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.894837 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-console-config\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.895005 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.894986 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-oauth-serving-cert\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.895196 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.895177 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-trusted-ca-bundle\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.896532 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.896504 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-oauth-config\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.896749 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.896734 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-serving-cert\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:47.903459 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:47.903436 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts247\" (UniqueName: \"kubernetes.io/projected/e636a679-cc5a-4f38-b326-74109befc9bd-kube-api-access-ts247\") pod \"console-6f9bc9764d-qk49p\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:48.082002 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:48.081977 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:48.357477 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:48.357412 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f9bc9764d-qk49p"] Sep 07 13:05:48.360225 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:05:48.360200 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode636a679_cc5a_4f38_b326_74109befc9bd.slice/crio-d7a9d0d3a51c4d4afec3d6d4a8127c0865883c0c313131bbeb39a233e4a1c3e3 WatchSource:0}: Error finding container d7a9d0d3a51c4d4afec3d6d4a8127c0865883c0c313131bbeb39a233e4a1c3e3: Status 404 returned error can't find the container with id d7a9d0d3a51c4d4afec3d6d4a8127c0865883c0c313131bbeb39a233e4a1c3e3 Sep 07 13:05:48.842401 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:48.842372 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9bc9764d-qk49p" event={"ID":"e636a679-cc5a-4f38-b326-74109befc9bd","Type":"ContainerStarted","Data":"f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715"} Sep 07 13:05:48.842770 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:48.842422 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9bc9764d-qk49p" event={"ID":"e636a679-cc5a-4f38-b326-74109befc9bd","Type":"ContainerStarted","Data":"d7a9d0d3a51c4d4afec3d6d4a8127c0865883c0c313131bbeb39a233e4a1c3e3"} Sep 07 13:05:48.877071 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:48.877031 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f9bc9764d-qk49p" podStartSLOduration=1.877016303 podStartE2EDuration="1.877016303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:05:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:05:48.876868118 +0000 UTC m=+297.665172914" watchObservedRunningTime="2026-09-07 13:05:48.877016303 +0000 UTC m=+297.665321100" Sep 07 13:05:51.631288 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:51.631256 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:05:51.642616 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:51.636332 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:05:51.651502 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:51.651482 2579 kubelet.go:1648] "Image garbage collection succeeded" Sep 07 13:05:58.082470 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:58.082426 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:58.085209 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:58.082489 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:58.087372 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:58.087345 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:05:58.881518 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:05:58.881489 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:08:30.889093 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:30.889064 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9bc9764d-qk49p"] Sep 07 13:08:55.910319 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:55.910259 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f9bc9764d-qk49p" podUID="e636a679-cc5a-4f38-b326-74109befc9bd" containerName="console" containerID="cri-o://f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715" gracePeriod=15 Sep 07 13:08:56.157118 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.157096 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:08:56.268764 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.268740 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-oauth-serving-cert\") pod \"e636a679-cc5a-4f38-b326-74109befc9bd\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " Sep 07 13:08:56.268892 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.268795 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts247\" (UniqueName: \"kubernetes.io/projected/e636a679-cc5a-4f38-b326-74109befc9bd-kube-api-access-ts247\") pod \"e636a679-cc5a-4f38-b326-74109befc9bd\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " Sep 07 13:08:56.268892 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.268819 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-service-ca\") pod \"e636a679-cc5a-4f38-b326-74109befc9bd\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " Sep 07 13:08:56.268892 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.268843 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-console-config\") pod \"e636a679-cc5a-4f38-b326-74109befc9bd\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " Sep 07 13:08:56.268892 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.268867 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-trusted-ca-bundle\") pod \"e636a679-cc5a-4f38-b326-74109befc9bd\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " Sep 07 13:08:56.269106 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.268909 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-serving-cert\") pod \"e636a679-cc5a-4f38-b326-74109befc9bd\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " Sep 07 13:08:56.269106 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.268963 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-oauth-config\") pod \"e636a679-cc5a-4f38-b326-74109befc9bd\" (UID: \"e636a679-cc5a-4f38-b326-74109befc9bd\") " Sep 07 13:08:56.269255 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.269229 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e636a679-cc5a-4f38-b326-74109befc9bd" (UID: "e636a679-cc5a-4f38-b326-74109befc9bd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:08:56.269255 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.269242 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-service-ca" (OuterVolumeSpecName: "service-ca") pod "e636a679-cc5a-4f38-b326-74109befc9bd" (UID: "e636a679-cc5a-4f38-b326-74109befc9bd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:08:56.269358 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.269327 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-console-config" (OuterVolumeSpecName: "console-config") pod "e636a679-cc5a-4f38-b326-74109befc9bd" (UID: "e636a679-cc5a-4f38-b326-74109befc9bd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:08:56.269502 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.269479 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e636a679-cc5a-4f38-b326-74109befc9bd" (UID: "e636a679-cc5a-4f38-b326-74109befc9bd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:08:56.271002 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.270980 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e636a679-cc5a-4f38-b326-74109befc9bd-kube-api-access-ts247" (OuterVolumeSpecName: "kube-api-access-ts247") pod "e636a679-cc5a-4f38-b326-74109befc9bd" (UID: "e636a679-cc5a-4f38-b326-74109befc9bd"). InnerVolumeSpecName "kube-api-access-ts247". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:08:56.271154 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.271134 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e636a679-cc5a-4f38-b326-74109befc9bd" (UID: "e636a679-cc5a-4f38-b326-74109befc9bd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:08:56.271214 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.271155 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e636a679-cc5a-4f38-b326-74109befc9bd" (UID: "e636a679-cc5a-4f38-b326-74109befc9bd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:08:56.370334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.370312 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts247\" (UniqueName: \"kubernetes.io/projected/e636a679-cc5a-4f38-b326-74109befc9bd-kube-api-access-ts247\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:08:56.370334 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.370332 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-service-ca\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:08:56.370455 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.370340 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-console-config\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:08:56.370455 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.370348 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-trusted-ca-bundle\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:08:56.370455 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.370357 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-serving-cert\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:08:56.370455 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.370364 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e636a679-cc5a-4f38-b326-74109befc9bd-console-oauth-config\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:08:56.370455 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.370375 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e636a679-cc5a-4f38-b326-74109befc9bd-oauth-serving-cert\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:08:56.528327 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.528262 2579 generic.go:356] "Generic (PLEG): container finished" podID="e636a679-cc5a-4f38-b326-74109befc9bd" containerID="f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715" exitCode=0 Sep 07 13:08:56.528327 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.528299 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9bc9764d-qk49p" event={"ID":"e636a679-cc5a-4f38-b326-74109befc9bd","Type":"ContainerDied","Data":"f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715"} Sep 07 13:08:56.528327 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.528316 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f9bc9764d-qk49p" Sep 07 13:08:56.528528 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.528333 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f9bc9764d-qk49p" event={"ID":"e636a679-cc5a-4f38-b326-74109befc9bd","Type":"ContainerDied","Data":"d7a9d0d3a51c4d4afec3d6d4a8127c0865883c0c313131bbeb39a233e4a1c3e3"} Sep 07 13:08:56.528528 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.528353 2579 scope.go:117] "RemoveContainer" containerID="f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715" Sep 07 13:08:56.536632 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.536618 2579 scope.go:117] "RemoveContainer" containerID="f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715" Sep 07 13:08:56.536915 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:08:56.536896 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715\": container with ID starting with f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715 not found: ID does not exist" containerID="f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715" Sep 07 13:08:56.536979 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.536922 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715"} err="failed to get container status \"f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715\": rpc error: code = NotFound desc = could not find container \"f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715\": container with ID starting with f9ac7e44f59fbd5331bbd79763c29267e908c9871237a41ebdb07137103dc715 not found: ID does not exist" Sep 07 13:08:56.550790 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.550769 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f9bc9764d-qk49p"] Sep 07 13:08:56.555785 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:56.555766 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f9bc9764d-qk49p"] Sep 07 13:08:57.697075 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:08:57.697040 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e636a679-cc5a-4f38-b326-74109befc9bd" path="/var/lib/kubelet/pods/e636a679-cc5a-4f38-b326-74109befc9bd/volumes" Sep 07 13:10:51.665308 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:10:51.665258 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:10:51.667655 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:10:51.667629 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:14:20.330950 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.330873 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-rrv6m"] Sep 07 13:14:20.331344 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.331152 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e636a679-cc5a-4f38-b326-74109befc9bd" containerName="console" Sep 07 13:14:20.331344 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.331163 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e636a679-cc5a-4f38-b326-74109befc9bd" containerName="console" Sep 07 13:14:20.331344 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.331206 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e636a679-cc5a-4f38-b326-74109befc9bd" containerName="console" Sep 07 13:14:20.333917 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.333896 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-rrv6m" Sep 07 13:14:20.336511 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.336491 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 07 13:14:20.336634 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.336494 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-zhgfh\"" Sep 07 13:14:20.337617 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.337602 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 07 13:14:20.342164 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.342144 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rrv6m"] Sep 07 13:14:20.406548 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.406519 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6j59\" (UniqueName: \"kubernetes.io/projected/8841d2ca-bf2c-4043-9c20-c79488656431-kube-api-access-j6j59\") pod \"redis-69bbd798b6-rrv6m\" (UID: \"8841d2ca-bf2c-4043-9c20-c79488656431\") " pod="test-ns-feast/redis-69bbd798b6-rrv6m" Sep 07 13:14:20.507849 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.507813 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6j59\" (UniqueName: \"kubernetes.io/projected/8841d2ca-bf2c-4043-9c20-c79488656431-kube-api-access-j6j59\") pod \"redis-69bbd798b6-rrv6m\" (UID: \"8841d2ca-bf2c-4043-9c20-c79488656431\") " pod="test-ns-feast/redis-69bbd798b6-rrv6m" Sep 07 13:14:20.517288 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.517263 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6j59\" (UniqueName: \"kubernetes.io/projected/8841d2ca-bf2c-4043-9c20-c79488656431-kube-api-access-j6j59\") pod \"redis-69bbd798b6-rrv6m\" (UID: \"8841d2ca-bf2c-4043-9c20-c79488656431\") " pod="test-ns-feast/redis-69bbd798b6-rrv6m" Sep 07 13:14:20.643712 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.643636 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-rrv6m" Sep 07 13:14:20.914632 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.914615 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rrv6m"] Sep 07 13:14:20.917029 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:14:20.917005 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8841d2ca_bf2c_4043_9c20_c79488656431.slice/crio-a59a864d5685cbf085ed320dbe78b562a6b5fda5a0327c68287983301d84c1af WatchSource:0}: Error finding container a59a864d5685cbf085ed320dbe78b562a6b5fda5a0327c68287983301d84c1af: Status 404 returned error can't find the container with id a59a864d5685cbf085ed320dbe78b562a6b5fda5a0327c68287983301d84c1af Sep 07 13:14:20.918854 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:20.918838 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 13:14:21.704167 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:21.704130 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-rrv6m" event={"ID":"8841d2ca-bf2c-4043-9c20-c79488656431","Type":"ContainerStarted","Data":"a59a864d5685cbf085ed320dbe78b562a6b5fda5a0327c68287983301d84c1af"} Sep 07 13:14:22.709097 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:22.709061 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-rrv6m" event={"ID":"8841d2ca-bf2c-4043-9c20-c79488656431","Type":"ContainerStarted","Data":"2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740"} Sep 07 13:14:22.726892 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:22.726839 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-rrv6m" podStartSLOduration=1.400336622 podStartE2EDuration="2.726821363s" totalImagesPullingTime="1.326484741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:14:22.726055655 +0000 UTC m=+811.514360453" watchObservedRunningTime="2026-09-07 13:14:22.726821363 +0000 UTC m=+811.515126159" Sep 07 13:14:55.937528 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:55.937495 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-ppbsm"] Sep 07 13:14:55.943225 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:55.943204 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ppbsm" Sep 07 13:14:55.946370 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:55.946350 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 07 13:14:55.946452 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:55.946401 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-j8xc8\"" Sep 07 13:14:55.948970 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:55.948949 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-ppbsm"] Sep 07 13:14:56.036611 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:56.036587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xnsk\" (UniqueName: \"kubernetes.io/projected/48b14b43-a3c7-4905-9285-4a496425563b-kube-api-access-5xnsk\") pod \"feast-test-apply-ppbsm\" (UID: \"48b14b43-a3c7-4905-9285-4a496425563b\") " pod="test-ns-feast/feast-test-apply-ppbsm" Sep 07 13:14:56.137106 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:56.137073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xnsk\" (UniqueName: \"kubernetes.io/projected/48b14b43-a3c7-4905-9285-4a496425563b-kube-api-access-5xnsk\") pod \"feast-test-apply-ppbsm\" (UID: \"48b14b43-a3c7-4905-9285-4a496425563b\") " pod="test-ns-feast/feast-test-apply-ppbsm" Sep 07 13:14:56.146840 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:56.146810 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xnsk\" (UniqueName: \"kubernetes.io/projected/48b14b43-a3c7-4905-9285-4a496425563b-kube-api-access-5xnsk\") pod \"feast-test-apply-ppbsm\" (UID: \"48b14b43-a3c7-4905-9285-4a496425563b\") " pod="test-ns-feast/feast-test-apply-ppbsm" Sep 07 13:14:56.252852 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:56.252794 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ppbsm" Sep 07 13:14:56.525869 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:56.525844 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-ppbsm"] Sep 07 13:14:56.528984 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:14:56.528963 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48b14b43_a3c7_4905_9285_4a496425563b.slice/crio-b687029b735363533e7819c564bad95984f11a378ed1369080a8c3d0da95a708 WatchSource:0}: Error finding container b687029b735363533e7819c564bad95984f11a378ed1369080a8c3d0da95a708: Status 404 returned error can't find the container with id b687029b735363533e7819c564bad95984f11a378ed1369080a8c3d0da95a708 Sep 07 13:14:56.843914 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:14:56.843851 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ppbsm" event={"ID":"48b14b43-a3c7-4905-9285-4a496425563b","Type":"ContainerStarted","Data":"b687029b735363533e7819c564bad95984f11a378ed1369080a8c3d0da95a708"} Sep 07 13:15:01.863768 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:01.863731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ppbsm" event={"ID":"48b14b43-a3c7-4905-9285-4a496425563b","Type":"ContainerStarted","Data":"9c454e98d99d5ebc0c945abce2294dc866e861cc57c76daae3c65ffec00d68cd"} Sep 07 13:15:08.890389 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:08.890351 2579 generic.go:356] "Generic (PLEG): container finished" podID="48b14b43-a3c7-4905-9285-4a496425563b" containerID="9c454e98d99d5ebc0c945abce2294dc866e861cc57c76daae3c65ffec00d68cd" exitCode=0 Sep 07 13:15:08.890389 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:08.890391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ppbsm" event={"ID":"48b14b43-a3c7-4905-9285-4a496425563b","Type":"ContainerDied","Data":"9c454e98d99d5ebc0c945abce2294dc866e861cc57c76daae3c65ffec00d68cd"} Sep 07 13:15:09.897077 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:09.897034 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ppbsm" event={"ID":"48b14b43-a3c7-4905-9285-4a496425563b","Type":"ContainerStarted","Data":"2dc99653742f929be501b0576779303775727bff339c2bedd7c7afa17c2c0a4a"} Sep 07 13:15:09.917338 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:09.917286 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-ppbsm" podStartSLOduration=3.322055937 podStartE2EDuration="14.917269578s" totalImagesPullingTime="5.126325303s" totalInitContainerRuntime="6.468888338s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:15:09.916161273 +0000 UTC m=+858.704466052" watchObservedRunningTime="2026-09-07 13:15:09.917269578 +0000 UTC m=+858.705574375" Sep 07 13:15:18.931881 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:18.931843 2579 generic.go:356] "Generic (PLEG): container finished" podID="48b14b43-a3c7-4905-9285-4a496425563b" containerID="2dc99653742f929be501b0576779303775727bff339c2bedd7c7afa17c2c0a4a" exitCode=0 Sep 07 13:15:18.932288 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:18.931904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ppbsm" event={"ID":"48b14b43-a3c7-4905-9285-4a496425563b","Type":"ContainerDied","Data":"2dc99653742f929be501b0576779303775727bff339c2bedd7c7afa17c2c0a4a"} Sep 07 13:15:20.060691 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:20.060654 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ppbsm" Sep 07 13:15:20.102580 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:20.102553 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xnsk\" (UniqueName: \"kubernetes.io/projected/48b14b43-a3c7-4905-9285-4a496425563b-kube-api-access-5xnsk\") pod \"48b14b43-a3c7-4905-9285-4a496425563b\" (UID: \"48b14b43-a3c7-4905-9285-4a496425563b\") " Sep 07 13:15:20.104714 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:20.104667 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48b14b43-a3c7-4905-9285-4a496425563b-kube-api-access-5xnsk" (OuterVolumeSpecName: "kube-api-access-5xnsk") pod "48b14b43-a3c7-4905-9285-4a496425563b" (UID: "48b14b43-a3c7-4905-9285-4a496425563b"). InnerVolumeSpecName "kube-api-access-5xnsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:15:20.203434 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:20.203379 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xnsk\" (UniqueName: \"kubernetes.io/projected/48b14b43-a3c7-4905-9285-4a496425563b-kube-api-access-5xnsk\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:15:20.941398 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:20.941368 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-ppbsm" Sep 07 13:15:20.941567 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:20.941391 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-ppbsm" event={"ID":"48b14b43-a3c7-4905-9285-4a496425563b","Type":"ContainerDied","Data":"b687029b735363533e7819c564bad95984f11a378ed1369080a8c3d0da95a708"} Sep 07 13:15:20.941567 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:20.941434 2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b687029b735363533e7819c564bad95984f11a378ed1369080a8c3d0da95a708" Sep 07 13:15:21.137176 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:21.137152 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-ppbsm_48b14b43-a3c7-4905-9285-4a496425563b/feast-0/0.log" Sep 07 13:15:21.143755 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:21.143702 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-ppbsm_48b14b43-a3c7-4905-9285-4a496425563b/feast-1/0.log" Sep 07 13:15:51.690051 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:51.690020 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:15:51.690473 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:51.690114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:15:59.416139 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.416088 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-ppbsm"] Sep 07 13:15:59.425196 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.425157 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-ppbsm"] Sep 07 13:15:59.435987 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.435962 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rrv6m"] Sep 07 13:15:59.436216 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.436176 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-rrv6m" podUID="8841d2ca-bf2c-4043-9c20-c79488656431" containerName="redis" containerID="cri-o://2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740" gracePeriod=30 Sep 07 13:15:59.680994 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.680971 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-rrv6m" Sep 07 13:15:59.696443 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.696420 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48b14b43-a3c7-4905-9285-4a496425563b" path="/var/lib/kubelet/pods/48b14b43-a3c7-4905-9285-4a496425563b/volumes" Sep 07 13:15:59.765924 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.765894 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6j59\" (UniqueName: \"kubernetes.io/projected/8841d2ca-bf2c-4043-9c20-c79488656431-kube-api-access-j6j59\") pod \"8841d2ca-bf2c-4043-9c20-c79488656431\" (UID: \"8841d2ca-bf2c-4043-9c20-c79488656431\") " Sep 07 13:15:59.767924 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.767899 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8841d2ca-bf2c-4043-9c20-c79488656431-kube-api-access-j6j59" (OuterVolumeSpecName: "kube-api-access-j6j59") pod "8841d2ca-bf2c-4043-9c20-c79488656431" (UID: "8841d2ca-bf2c-4043-9c20-c79488656431"). InnerVolumeSpecName "kube-api-access-j6j59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:15:59.867141 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:15:59.867115 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6j59\" (UniqueName: \"kubernetes.io/projected/8841d2ca-bf2c-4043-9c20-c79488656431-kube-api-access-j6j59\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:16:00.085113 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.085083 2579 generic.go:356] "Generic (PLEG): container finished" podID="8841d2ca-bf2c-4043-9c20-c79488656431" containerID="2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740" exitCode=0 Sep 07 13:16:00.085240 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.085126 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-rrv6m" event={"ID":"8841d2ca-bf2c-4043-9c20-c79488656431","Type":"ContainerDied","Data":"2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740"} Sep 07 13:16:00.085240 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.085127 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-rrv6m" Sep 07 13:16:00.085240 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.085165 2579 scope.go:117] "RemoveContainer" containerID="2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740" Sep 07 13:16:00.085240 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.085155 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-rrv6m" event={"ID":"8841d2ca-bf2c-4043-9c20-c79488656431","Type":"ContainerDied","Data":"a59a864d5685cbf085ed320dbe78b562a6b5fda5a0327c68287983301d84c1af"} Sep 07 13:16:00.093642 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.093600 2579 scope.go:117] "RemoveContainer" containerID="2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740" Sep 07 13:16:00.093920 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:16:00.093902 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740\": container with ID starting with 2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740 not found: ID does not exist" containerID="2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740" Sep 07 13:16:00.093975 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.093929 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740"} err="failed to get container status \"2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740\": rpc error: code = NotFound desc = could not find container \"2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740\": container with ID starting with 2989a089fba8c597f2cd4f0cf1ccd9b0a469a4feb2f86ac3ef60d0fd3479c740 not found: ID does not exist" Sep 07 13:16:00.107170 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.107145 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rrv6m"] Sep 07 13:16:00.110923 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:00.110903 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-rrv6m"] Sep 07 13:16:01.698767 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:16:01.698706 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8841d2ca-bf2c-4043-9c20-c79488656431" path="/var/lib/kubelet/pods/8841d2ca-bf2c-4043-9c20-c79488656431/volumes" Sep 07 13:20:51.719430 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:20:51.719396 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:20:51.720185 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:20:51.720158 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:21:14.290635 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290597 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc"] Sep 07 13:21:14.293043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290882 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8841d2ca-bf2c-4043-9c20-c79488656431" containerName="redis" Sep 07 13:21:14.293043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290894 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8841d2ca-bf2c-4043-9c20-c79488656431" containerName="redis" Sep 07 13:21:14.293043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290905 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b14b43-a3c7-4905-9285-4a496425563b" containerName="feast-0" Sep 07 13:21:14.293043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290911 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b14b43-a3c7-4905-9285-4a496425563b" containerName="feast-0" Sep 07 13:21:14.293043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290917 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48b14b43-a3c7-4905-9285-4a496425563b" containerName="feast-1" Sep 07 13:21:14.293043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290922 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="48b14b43-a3c7-4905-9285-4a496425563b" containerName="feast-1" Sep 07 13:21:14.293043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290964 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="48b14b43-a3c7-4905-9285-4a496425563b" containerName="feast-1" Sep 07 13:21:14.293043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.290973 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8841d2ca-bf2c-4043-9c20-c79488656431" containerName="redis" Sep 07 13:21:14.293918 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.293902 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:21:14.297204 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.297183 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 07 13:21:14.298218 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.298200 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 07 13:21:14.298367 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.298239 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-2tjfj\"" Sep 07 13:21:14.305659 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.305638 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc"] Sep 07 13:21:14.433315 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.433287 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mss7q\" (UniqueName: \"kubernetes.io/projected/2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06-kube-api-access-mss7q\") pod \"feast-operator-controller-manager-689b877b4b-sqmcc\" (UID: \"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:21:14.533731 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.533701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mss7q\" (UniqueName: \"kubernetes.io/projected/2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06-kube-api-access-mss7q\") pod \"feast-operator-controller-manager-689b877b4b-sqmcc\" (UID: \"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:21:14.544122 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.544072 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mss7q\" (UniqueName: \"kubernetes.io/projected/2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06-kube-api-access-mss7q\") pod \"feast-operator-controller-manager-689b877b4b-sqmcc\" (UID: \"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:21:14.604729 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.604704 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:21:14.881636 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.881576 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc"] Sep 07 13:21:14.884293 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:21:14.884269 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bfdb8b1_dd46_49ed_bf94_aada9d4a2f06.slice/crio-2261c1c1af28d16507fd6ec7016e2d562ed2cffa4725ffd9fb27a90d5e2e8b43 WatchSource:0}: Error finding container 2261c1c1af28d16507fd6ec7016e2d562ed2cffa4725ffd9fb27a90d5e2e8b43: Status 404 returned error can't find the container with id 2261c1c1af28d16507fd6ec7016e2d562ed2cffa4725ffd9fb27a90d5e2e8b43 Sep 07 13:21:14.886090 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:14.886073 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 13:21:15.231085 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:15.231023 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" event={"ID":"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06","Type":"ContainerStarted","Data":"2261c1c1af28d16507fd6ec7016e2d562ed2cffa4725ffd9fb27a90d5e2e8b43"} Sep 07 13:21:17.239835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:17.239748 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" event={"ID":"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06","Type":"ContainerStarted","Data":"5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d"} Sep 07 13:21:17.240199 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:17.239897 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:21:17.282716 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:17.282655 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" podStartSLOduration=1.3364116990000001 podStartE2EDuration="3.282641134s" totalImagesPullingTime="1.946229435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:21:17.282253915 +0000 UTC m=+1226.070558712" watchObservedRunningTime="2026-09-07 13:21:17.282641134 +0000 UTC m=+1226.070945949" Sep 07 13:21:28.245787 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:28.245745 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:21:29.339556 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.339521 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c"] Sep 07 13:21:29.343230 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.343208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.348627 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.348601 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 07 13:21:29.348755 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.348640 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 07 13:21:29.348755 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.348706 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 07 13:21:29.349526 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.349507 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 07 13:21:29.349914 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.349896 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 07 13:21:29.350552 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.350536 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4xsk9\"" Sep 07 13:21:29.351599 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.351580 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 07 13:21:29.367719 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.367693 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c"] Sep 07 13:21:29.435170 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.435148 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.435273 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.435177 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85793645-7596-4b9c-8b45-b8fa49fd5546-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.435273 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.435200 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.435347 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.435279 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.435347 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.435313 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w29t9\" (UniqueName: \"kubernetes.io/projected/85793645-7596-4b9c-8b45-b8fa49fd5546-kube-api-access-w29t9\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.435347 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.435343 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.536563 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.536535 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.536663 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.536576 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.536663 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.536597 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w29t9\" (UniqueName: \"kubernetes.io/projected/85793645-7596-4b9c-8b45-b8fa49fd5546-kube-api-access-w29t9\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.536663 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.536630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.536845 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.536663 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.536845 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:21:29.536697 2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 07 13:21:29.536845 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.536713 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85793645-7596-4b9c-8b45-b8fa49fd5546-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.536845 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:21:29.536766 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls podName:85793645-7596-4b9c-8b45-b8fa49fd5546 nodeName:}" failed. No retries permitted until 2026-09-07 13:21:30.036744231 +0000 UTC m=+1238.825049017 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-prg5c" (UID: "85793645-7596-4b9c-8b45-b8fa49fd5546") : secret "feast-simple-feast-setup-registry-tls" not found Sep 07 13:21:29.537095 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.537076 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85793645-7596-4b9c-8b45-b8fa49fd5546-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.539294 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.539266 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.539294 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.539282 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.539413 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.539294 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:29.546495 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:29.546477 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w29t9\" (UniqueName: \"kubernetes.io/projected/85793645-7596-4b9c-8b45-b8fa49fd5546-kube-api-access-w29t9\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:30.041628 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:30.041601 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:30.044006 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:30.043983 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-prg5c\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:30.252642 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:30.252606 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:30.540740 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:30.540714 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c"] Sep 07 13:21:30.541939 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:21:30.541903 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85793645_7596_4b9c_8b45_b8fa49fd5546.slice/crio-97b566cfde3d2fb028c2acb36904e04ade682ae05e83f7607edcb58932855e8f WatchSource:0}: Error finding container 97b566cfde3d2fb028c2acb36904e04ade682ae05e83f7607edcb58932855e8f: Status 404 returned error can't find the container with id 97b566cfde3d2fb028c2acb36904e04ade682ae05e83f7607edcb58932855e8f Sep 07 13:21:31.291328 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:31.291290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerStarted","Data":"97b566cfde3d2fb028c2acb36904e04ade682ae05e83f7607edcb58932855e8f"} Sep 07 13:21:45.357210 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:45.357172 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerStarted","Data":"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f"} Sep 07 13:21:49.374137 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:49.374100 2579 generic.go:356] "Generic (PLEG): container finished" podID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerID="3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f" exitCode=0 Sep 07 13:21:49.374445 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:49.374154 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerDied","Data":"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f"} Sep 07 13:21:50.380356 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:50.380320 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerStarted","Data":"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b"} Sep 07 13:21:51.739693 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:51.739643 2579 scope.go:117] "RemoveContainer" containerID="2dc99653742f929be501b0576779303775727bff339c2bedd7c7afa17c2c0a4a" Sep 07 13:21:51.750753 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:51.750729 2579 scope.go:117] "RemoveContainer" containerID="9c454e98d99d5ebc0c945abce2294dc866e861cc57c76daae3c65ffec00d68cd" Sep 07 13:21:55.401714 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:55.401612 2579 generic.go:356] "Generic (PLEG): container finished" podID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerID="386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b" exitCode=0 Sep 07 13:21:55.401714 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:55.401699 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerDied","Data":"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b"} Sep 07 13:21:56.411470 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:56.411432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerStarted","Data":"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1"} Sep 07 13:21:56.411979 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:56.411492 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerStarted","Data":"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8"} Sep 07 13:21:56.411979 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:56.411516 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerStarted","Data":"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a"} Sep 07 13:21:56.411979 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:56.411537 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerStarted","Data":"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22"} Sep 07 13:21:56.442229 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:56.442170 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podStartSLOduration=13.548371166999999 podStartE2EDuration="27.442147973s" totalImagesPullingTime="13.893776806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:21:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:21:56.441106932 +0000 UTC m=+1265.229411731" watchObservedRunningTime="2026-09-07 13:21:56.442147973 +0000 UTC m=+1265.230452770" Sep 07 13:21:57.253712 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:57.253656 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:57.253913 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:57.253733 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:57.253913 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:57.253753 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:57.253913 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:57.253771 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:21:57.255982 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:57.255920 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused" Sep 07 13:21:57.255982 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:57.255970 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 07 13:21:57.256166 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:57.255927 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused" Sep 07 13:21:57.256166 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:21:57.256010 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 07 13:22:00.253830 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:00.253790 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:00.254391 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:00.254366 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:00.254514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:00.254409 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:00.254514 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:00.254432 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:00.254651 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:00.254556 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused" Sep 07 13:22:00.254651 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:00.254568 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 07 13:22:00.254797 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:00.254646 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused" Sep 07 13:22:00.254797 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:00.254713 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 07 13:22:03.253932 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:03.253888 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 07 13:22:03.254814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:03.254791 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:03.254970 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:03.254957 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:03.255769 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:03.255737 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:03.255866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:03.255854 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:03.259649 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:03.259632 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:03.451744 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:03.451713 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:06.253947 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:06.253909 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:22:06.460828 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:22:06.460800 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:23:07.803756 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:07.803723 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c"] Sep 07 13:23:07.804736 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:07.804642 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="registry" containerID="cri-o://8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22" gracePeriod=30 Sep 07 13:23:07.805102 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:07.805076 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="offline" containerID="cri-o://c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8" gracePeriod=30 Sep 07 13:23:07.805726 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:07.805116 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" containerID="cri-o://3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1" gracePeriod=30 Sep 07 13:23:07.805896 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:07.805196 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" containerID="cri-o://9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a" gracePeriod=30 Sep 07 13:23:08.254552 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.254470 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6"] Sep 07 13:23:08.258267 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.258245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.261480 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.261459 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-mcbw8\"" Sep 07 13:23:08.280515 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.280483 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6"] Sep 07 13:23:08.355926 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.355901 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.356024 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.355957 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44zt8\" (UniqueName: \"kubernetes.io/projected/3c989862-0a15-4f90-bee7-8dbc91c3fc67-kube-api-access-44zt8\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.356024 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.355977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c989862-0a15-4f90-bee7-8dbc91c3fc67-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.356024 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.355997 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.356139 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.356038 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.356139 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.356055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.456548 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.456511 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.456548 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.456556 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.456791 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:08.456661 2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 07 13:23:08.456791 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.456701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44zt8\" (UniqueName: \"kubernetes.io/projected/3c989862-0a15-4f90-bee7-8dbc91c3fc67-kube-api-access-44zt8\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.456791 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.456739 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c989862-0a15-4f90-bee7-8dbc91c3fc67-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.456791 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:08.456752 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls podName:3c989862-0a15-4f90-bee7-8dbc91c3fc67 nodeName:}" failed. No retries permitted until 2026-09-07 13:23:08.956735632 +0000 UTC m=+1337.745040407 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-m98d6" (UID: "3c989862-0a15-4f90-bee7-8dbc91c3fc67") : secret "feast-simple-feast-setup-registry-tls" not found Sep 07 13:23:08.456791 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.456786 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.457023 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.456826 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.457023 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:08.456911 2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 07 13:23:08.457023 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:08.456958 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls podName:3c989862-0a15-4f90-bee7-8dbc91c3fc67 nodeName:}" failed. No retries permitted until 2026-09-07 13:23:08.956943688 +0000 UTC m=+1337.745248477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-m98d6" (UID: "3c989862-0a15-4f90-bee7-8dbc91c3fc67") : secret "feast-simple-feast-setup-offline-tls" not found Sep 07 13:23:08.457180 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.457113 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c989862-0a15-4f90-bee7-8dbc91c3fc67-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.459276 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.459249 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.459415 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.459335 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.468262 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.468242 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44zt8\" (UniqueName: \"kubernetes.io/projected/3c989862-0a15-4f90-bee7-8dbc91c3fc67-kube-api-access-44zt8\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.700555 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.700530 2579 generic.go:356] "Generic (PLEG): container finished" podID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerID="3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1" exitCode=0 Sep 07 13:23:08.700555 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.700552 2579 generic.go:356] "Generic (PLEG): container finished" podID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerID="9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a" exitCode=0 Sep 07 13:23:08.700726 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.700592 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerDied","Data":"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1"} Sep 07 13:23:08.700726 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.700647 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerDied","Data":"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a"} Sep 07 13:23:08.961856 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.961792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.961856 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.961836 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.964155 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.964134 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:08.964227 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:08.964203 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-m98d6\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:09.167783 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:09.167756 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:09.460255 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:09.460215 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6"] Sep 07 13:23:09.468778 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:23:09.468742 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c989862_0a15_4f90_bee7_8dbc91c3fc67.slice/crio-4246557e30ec1fb214d292028f57c7a59d40a2aeb330ed322d87c6698c008fe7 WatchSource:0}: Error finding container 4246557e30ec1fb214d292028f57c7a59d40a2aeb330ed322d87c6698c008fe7: Status 404 returned error can't find the container with id 4246557e30ec1fb214d292028f57c7a59d40a2aeb330ed322d87c6698c008fe7 Sep 07 13:23:09.710803 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:09.710769 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerStarted","Data":"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56"} Sep 07 13:23:09.711025 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:09.711005 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerStarted","Data":"4246557e30ec1fb214d292028f57c7a59d40a2aeb330ed322d87c6698c008fe7"} Sep 07 13:23:13.448769 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:13.448665 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 07 13:23:14.731084 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:14.731007 2579 generic.go:356] "Generic (PLEG): container finished" podID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerID="5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56" exitCode=0 Sep 07 13:23:14.731417 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:14.731079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerDied","Data":"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56"} Sep 07 13:23:15.736585 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:15.736554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerStarted","Data":"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30"} Sep 07 13:23:16.460953 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:16.460910 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 07 13:23:20.758696 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:20.758610 2579 generic.go:356] "Generic (PLEG): container finished" podID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerID="172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30" exitCode=0 Sep 07 13:23:20.759029 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:20.758698 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerDied","Data":"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30"} Sep 07 13:23:21.768915 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:21.768866 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerStarted","Data":"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002"} Sep 07 13:23:21.769376 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:21.768938 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerStarted","Data":"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542"} Sep 07 13:23:21.769376 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:21.768962 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerStarted","Data":"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf"} Sep 07 13:23:21.769376 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:21.768979 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerStarted","Data":"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df"} Sep 07 13:23:21.796618 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:21.796553 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podStartSLOduration=13.796519087 podStartE2EDuration="13.796519087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:23:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:23:21.793978518 +0000 UTC m=+1350.582283317" watchObservedRunningTime="2026-09-07 13:23:21.796519087 +0000 UTC m=+1350.584823885" Sep 07 13:23:23.449256 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:23.449208 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 07 13:23:24.168145 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:24.168108 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:24.168452 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:24.168430 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:24.168452 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:24.168461 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:24.168720 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:24.168480 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:24.170284 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:24.170252 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Sep 07 13:23:24.170483 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:24.170275 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 07 13:23:24.170555 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:24.170280 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 07 13:23:24.170555 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:24.170368 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 07 13:23:26.461491 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:26.461433 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 07 13:23:27.168434 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:27.168390 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 07 13:23:27.168721 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:27.168425 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Sep 07 13:23:27.168827 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:27.168455 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 07 13:23:27.168827 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:27.168528 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 07 13:23:29.168731 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:29.168668 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:29.169182 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:29.168753 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:29.169182 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:29.168770 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:29.169182 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:29.168784 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:30.169436 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:30.169408 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:30.169848 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:30.169527 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:30.169848 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:30.169780 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:30.170415 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:30.170387 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:30.170546 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:30.170462 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:30.170805 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:30.170785 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:30.174815 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:30.174796 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:30.821661 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:30.821630 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:23:33.449466 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:33.449419 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 07 13:23:33.449953 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:33.449551 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:23:36.461465 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:36.461409 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 07 13:23:36.461974 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:36.461563 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:23:38.449651 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.449628 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:23:38.584767 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.584704 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85793645-7596-4b9c-8b45-b8fa49fd5546-feast-data\") pod \"85793645-7596-4b9c-8b45-b8fa49fd5546\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " Sep 07 13:23:38.584767 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.584742 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-offline-tls\") pod \"85793645-7596-4b9c-8b45-b8fa49fd5546\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " Sep 07 13:23:38.584767 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.584758 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-online-tls\") pod \"85793645-7596-4b9c-8b45-b8fa49fd5546\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " Sep 07 13:23:38.585111 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.584780 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-ui-tls\") pod \"85793645-7596-4b9c-8b45-b8fa49fd5546\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " Sep 07 13:23:38.585111 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.584894 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w29t9\" (UniqueName: \"kubernetes.io/projected/85793645-7596-4b9c-8b45-b8fa49fd5546-kube-api-access-w29t9\") pod \"85793645-7596-4b9c-8b45-b8fa49fd5546\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " Sep 07 13:23:38.585111 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.584933 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls\") pod \"85793645-7596-4b9c-8b45-b8fa49fd5546\" (UID: \"85793645-7596-4b9c-8b45-b8fa49fd5546\") " Sep 07 13:23:38.585268 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.585155 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85793645-7596-4b9c-8b45-b8fa49fd5546-feast-data" (OuterVolumeSpecName: "feast-data") pod "85793645-7596-4b9c-8b45-b8fa49fd5546" (UID: "85793645-7596-4b9c-8b45-b8fa49fd5546"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:23:38.587221 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.587191 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "85793645-7596-4b9c-8b45-b8fa49fd5546" (UID: "85793645-7596-4b9c-8b45-b8fa49fd5546"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:23:38.587340 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.587212 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "85793645-7596-4b9c-8b45-b8fa49fd5546" (UID: "85793645-7596-4b9c-8b45-b8fa49fd5546"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:23:38.587340 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.587224 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "85793645-7596-4b9c-8b45-b8fa49fd5546" (UID: "85793645-7596-4b9c-8b45-b8fa49fd5546"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:23:38.587483 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.587466 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-online-tls" (OuterVolumeSpecName: "online-tls") pod "85793645-7596-4b9c-8b45-b8fa49fd5546" (UID: "85793645-7596-4b9c-8b45-b8fa49fd5546"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:23:38.587483 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.587477 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85793645-7596-4b9c-8b45-b8fa49fd5546-kube-api-access-w29t9" (OuterVolumeSpecName: "kube-api-access-w29t9") pod "85793645-7596-4b9c-8b45-b8fa49fd5546" (UID: "85793645-7596-4b9c-8b45-b8fa49fd5546"). InnerVolumeSpecName "kube-api-access-w29t9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:23:38.686026 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.685999 2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/85793645-7596-4b9c-8b45-b8fa49fd5546-feast-data\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:23:38.686026 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.686023 2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-offline-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:23:38.686026 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.686033 2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-online-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:23:38.686228 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.686041 2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-ui-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:23:38.686228 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.686048 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w29t9\" (UniqueName: \"kubernetes.io/projected/85793645-7596-4b9c-8b45-b8fa49fd5546-kube-api-access-w29t9\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:23:38.686228 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.686057 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/85793645-7596-4b9c-8b45-b8fa49fd5546-registry-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:23:38.853225 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.853164 2579 generic.go:356] "Generic (PLEG): container finished" podID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerID="c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8" exitCode=137 Sep 07 13:23:38.853225 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.853186 2579 generic.go:356] "Generic (PLEG): container finished" podID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerID="8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22" exitCode=137 Sep 07 13:23:38.853652 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.853232 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" Sep 07 13:23:38.853652 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.853245 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerDied","Data":"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8"} Sep 07 13:23:38.853652 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.853298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerDied","Data":"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22"} Sep 07 13:23:38.853652 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.853317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c" event={"ID":"85793645-7596-4b9c-8b45-b8fa49fd5546","Type":"ContainerDied","Data":"97b566cfde3d2fb028c2acb36904e04ade682ae05e83f7607edcb58932855e8f"} Sep 07 13:23:38.853652 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.853338 2579 scope.go:117] "RemoveContainer" containerID="3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1" Sep 07 13:23:38.861571 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.861553 2579 scope.go:117] "RemoveContainer" containerID="c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8" Sep 07 13:23:38.868349 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.868333 2579 scope.go:117] "RemoveContainer" containerID="9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a" Sep 07 13:23:38.875653 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.875633 2579 scope.go:117] "RemoveContainer" containerID="8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22" Sep 07 13:23:38.876203 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.876184 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c"] Sep 07 13:23:38.883048 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.883029 2579 scope.go:117] "RemoveContainer" containerID="386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b" Sep 07 13:23:38.883203 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.883184 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-prg5c"] Sep 07 13:23:38.889697 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.889651 2579 scope.go:117] "RemoveContainer" containerID="3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f" Sep 07 13:23:38.896474 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.896458 2579 scope.go:117] "RemoveContainer" containerID="3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1" Sep 07 13:23:38.896737 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:38.896717 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1\": container with ID starting with 3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1 not found: ID does not exist" containerID="3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1" Sep 07 13:23:38.896825 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.896742 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1"} err="failed to get container status \"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1\": rpc error: code = NotFound desc = could not find container \"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1\": container with ID starting with 3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1 not found: ID does not exist" Sep 07 13:23:38.896825 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.896760 2579 scope.go:117] "RemoveContainer" containerID="c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8" Sep 07 13:23:38.897052 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:38.897036 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8\": container with ID starting with c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8 not found: ID does not exist" containerID="c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8" Sep 07 13:23:38.897091 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.897058 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8"} err="failed to get container status \"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8\": rpc error: code = NotFound desc = could not find container \"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8\": container with ID starting with c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8 not found: ID does not exist" Sep 07 13:23:38.897091 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.897073 2579 scope.go:117] "RemoveContainer" containerID="9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a" Sep 07 13:23:38.897321 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:38.897304 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a\": container with ID starting with 9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a not found: ID does not exist" containerID="9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a" Sep 07 13:23:38.897390 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.897326 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a"} err="failed to get container status \"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a\": rpc error: code = NotFound desc = could not find container \"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a\": container with ID starting with 9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a not found: ID does not exist" Sep 07 13:23:38.897390 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.897339 2579 scope.go:117] "RemoveContainer" containerID="8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22" Sep 07 13:23:38.897589 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:38.897573 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22\": container with ID starting with 8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22 not found: ID does not exist" containerID="8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22" Sep 07 13:23:38.897630 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.897594 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22"} err="failed to get container status \"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22\": rpc error: code = NotFound desc = could not find container \"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22\": container with ID starting with 8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22 not found: ID does not exist" Sep 07 13:23:38.897630 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.897610 2579 scope.go:117] "RemoveContainer" containerID="386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b" Sep 07 13:23:38.897955 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:38.897938 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b\": container with ID starting with 386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b not found: ID does not exist" containerID="386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b" Sep 07 13:23:38.898025 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.897955 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b"} err="failed to get container status \"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b\": rpc error: code = NotFound desc = could not find container \"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b\": container with ID starting with 386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b not found: ID does not exist" Sep 07 13:23:38.898025 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.897966 2579 scope.go:117] "RemoveContainer" containerID="3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f" Sep 07 13:23:38.898167 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:23:38.898153 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f\": container with ID starting with 3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f not found: ID does not exist" containerID="3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f" Sep 07 13:23:38.898202 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.898169 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f"} err="failed to get container status \"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f\": rpc error: code = NotFound desc = could not find container \"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f\": container with ID starting with 3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f not found: ID does not exist" Sep 07 13:23:38.898202 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.898181 2579 scope.go:117] "RemoveContainer" containerID="3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1" Sep 07 13:23:38.898369 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.898349 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1"} err="failed to get container status \"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1\": rpc error: code = NotFound desc = could not find container \"3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1\": container with ID starting with 3799cdfb5a8a88a2ee531d65bb4f9cb4d7c6ea3bf2eaa3ec66a75a226fba67c1 not found: ID does not exist" Sep 07 13:23:38.898369 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.898362 2579 scope.go:117] "RemoveContainer" containerID="c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8" Sep 07 13:23:38.898559 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.898544 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8"} err="failed to get container status \"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8\": rpc error: code = NotFound desc = could not find container \"c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8\": container with ID starting with c8b23f3bead17954939842695ec3dd74b615f720495c3cb39675c12883a50ea8 not found: ID does not exist" Sep 07 13:23:38.898600 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.898559 2579 scope.go:117] "RemoveContainer" containerID="9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a" Sep 07 13:23:38.898810 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.898793 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a"} err="failed to get container status \"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a\": rpc error: code = NotFound desc = could not find container \"9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a\": container with ID starting with 9e754b4a45ff423cf9ee362af7494e9dd5382c5b18537997f8592188af6c877a not found: ID does not exist" Sep 07 13:23:38.898861 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.898812 2579 scope.go:117] "RemoveContainer" containerID="8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22" Sep 07 13:23:38.899027 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.899011 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22"} err="failed to get container status \"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22\": rpc error: code = NotFound desc = could not find container \"8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22\": container with ID starting with 8e6a93a425b043e509ae213b43ffab266f52c03fb99de821486cc6e9b70dde22 not found: ID does not exist" Sep 07 13:23:38.899071 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.899027 2579 scope.go:117] "RemoveContainer" containerID="386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b" Sep 07 13:23:38.899256 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.899237 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b"} err="failed to get container status \"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b\": rpc error: code = NotFound desc = could not find container \"386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b\": container with ID starting with 386fa4e6fd02a165639a376d6a41e30b3c434b68483f5d890cffc6f52599705b not found: ID does not exist" Sep 07 13:23:38.899299 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.899258 2579 scope.go:117] "RemoveContainer" containerID="3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f" Sep 07 13:23:38.899476 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:38.899460 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f"} err="failed to get container status \"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f\": rpc error: code = NotFound desc = could not find container \"3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f\": container with ID starting with 3b7eeb3c991bd9089d3fd7a948f236725a6debd61a545964790fc34fa9b6686f not found: ID does not exist" Sep 07 13:23:39.696980 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:23:39.696943 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" path="/var/lib/kubelet/pods/85793645-7596-4b9c-8b45-b8fa49fd5546/volumes" Sep 07 13:24:33.326694 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326657 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw"] Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326918 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="offline" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326929 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="offline" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326950 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="feast-apply" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326955 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="feast-apply" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326964 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326969 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326975 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="feast-init" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326980 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="feast-init" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326990 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="registry" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.326995 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="registry" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.327001 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.327006 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.327048 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="online" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.327056 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="registry" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.327062 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="ui" Sep 07 13:24:33.327152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.327068 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="85793645-7596-4b9c-8b45-b8fa49fd5546" containerName="offline" Sep 07 13:24:33.330191 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.330173 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.333208 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.333185 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 07 13:24:33.333315 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.333187 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 07 13:24:33.333315 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.333226 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 07 13:24:33.333447 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.333433 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 07 13:24:33.333503 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.333452 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 07 13:24:33.333558 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.333503 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 07 13:24:33.333558 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.333521 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-j8m9r\"" Sep 07 13:24:33.346982 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.346953 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw"] Sep 07 13:24:33.448508 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.448480 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.448611 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.448517 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.448611 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.448539 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.448725 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.448647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b6e39bd0-6f17-4059-b85a-949dc7c46925-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.448725 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.448697 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e39bd0-6f17-4059-b85a-949dc7c46925-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.448803 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.448723 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kqd6\" (UniqueName: \"kubernetes.io/projected/b6e39bd0-6f17-4059-b85a-949dc7c46925-kube-api-access-8kqd6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.549666 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.549638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b6e39bd0-6f17-4059-b85a-949dc7c46925-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.549666 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.549667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e39bd0-6f17-4059-b85a-949dc7c46925-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.549835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.549705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kqd6\" (UniqueName: \"kubernetes.io/projected/b6e39bd0-6f17-4059-b85a-949dc7c46925-kube-api-access-8kqd6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.549835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.549738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.549835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.549784 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.549835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.549821 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.550035 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:24:33.549919 2579 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 07 13:24:33.550035 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:24:33.550006 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls podName:b6e39bd0-6f17-4059-b85a-949dc7c46925 nodeName:}" failed. No retries permitted until 2026-09-07 13:24:34.049985411 +0000 UTC m=+1422.838290190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" (UID: "b6e39bd0-6f17-4059-b85a-949dc7c46925") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 07 13:24:33.550133 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.550111 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e39bd0-6f17-4059-b85a-949dc7c46925-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.550358 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.550332 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b6e39bd0-6f17-4059-b85a-949dc7c46925-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.552453 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.552433 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.552549 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.552473 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:33.559269 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:33.559247 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kqd6\" (UniqueName: \"kubernetes.io/projected/b6e39bd0-6f17-4059-b85a-949dc7c46925-kube-api-access-8kqd6\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:34.052574 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:34.052548 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:34.054782 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:34.054762 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-5c2nw\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:34.238954 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:34.238929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:24:34.517268 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:34.517238 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw"] Sep 07 13:24:34.518973 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:24:34.518939 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6e39bd0_6f17_4059_b85a_949dc7c46925.slice/crio-d813bd682af304a0502eac347cb3f1652688967603e5a9ce6fc3c600b683fb67 WatchSource:0}: Error finding container d813bd682af304a0502eac347cb3f1652688967603e5a9ce6fc3c600b683fb67: Status 404 returned error can't find the container with id d813bd682af304a0502eac347cb3f1652688967603e5a9ce6fc3c600b683fb67 Sep 07 13:24:35.068544 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:35.068505 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerStarted","Data":"1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2"} Sep 07 13:24:35.068746 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:35.068558 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerStarted","Data":"d813bd682af304a0502eac347cb3f1652688967603e5a9ce6fc3c600b683fb67"} Sep 07 13:24:40.089152 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:40.089115 2579 generic.go:356] "Generic (PLEG): container finished" podID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerID="1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2" exitCode=0 Sep 07 13:24:40.089640 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:40.089193 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerDied","Data":"1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2"} Sep 07 13:24:41.095122 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:24:41.095088 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerStarted","Data":"09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb"} Sep 07 13:25:06.188261 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:06.188221 2579 generic.go:356] "Generic (PLEG): container finished" podID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerID="09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb" exitCode=0 Sep 07 13:25:06.188819 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:06.188306 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerDied","Data":"09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb"} Sep 07 13:25:07.197989 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.197942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerStarted","Data":"6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9"} Sep 07 13:25:07.198374 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.198010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerStarted","Data":"55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732"} Sep 07 13:25:07.198374 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.198032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerStarted","Data":"e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa"} Sep 07 13:25:07.239857 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.239821 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:07.240029 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.239875 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:07.240029 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.239897 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:07.240992 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.240947 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused" Sep 07 13:25:07.241112 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.240995 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 07 13:25:07.241112 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:07.240997 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 07 13:25:10.239921 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:10.239884 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused" Sep 07 13:25:10.239921 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:10.239910 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 07 13:25:10.240473 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:10.239888 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 07 13:25:13.239282 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:13.239236 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused" Sep 07 13:25:13.239282 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:13.239263 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 07 13:25:13.239845 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:13.239245 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 07 13:25:14.239611 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:14.239578 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:14.240009 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:14.239628 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:14.240009 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:14.239642 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:16.240837 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:16.240806 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:16.241356 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:16.240948 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:16.241875 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:16.241848 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:16.242010 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:16.241910 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:16.268030 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:16.267987 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podStartSLOduration=43.267973383 podStartE2EDuration="43.267973383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:25:07.235601293 +0000 UTC m=+1456.023906091" watchObservedRunningTime="2026-09-07 13:25:16.267973383 +0000 UTC m=+1465.056278180" Sep 07 13:25:17.132108 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:17.132075 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:18.146551 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:18.146518 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:25:51.750590 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:51.750562 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:25:51.753220 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:25:51.753195 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:26:18.245811 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:18.245771 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 07 13:26:19.784173 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.784128 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw"] Sep 07 13:26:19.784623 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.784442 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" containerID="cri-o://e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa" gracePeriod=30 Sep 07 13:26:19.784623 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.784467 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="offline" containerID="cri-o://55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732" gracePeriod=30 Sep 07 13:26:19.784623 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.784472 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" containerID="cri-o://6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9" gracePeriod=30 Sep 07 13:26:19.921043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.921004 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6"] Sep 07 13:26:19.921358 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.921321 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="registry" containerID="cri-o://07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df" gracePeriod=30 Sep 07 13:26:19.921499 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.921397 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="offline" containerID="cri-o://caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542" gracePeriod=30 Sep 07 13:26:19.921499 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.921419 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" containerID="cri-o://38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002" gracePeriod=30 Sep 07 13:26:19.921499 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:19.921493 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" containerID="cri-o://8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf" gracePeriod=30 Sep 07 13:26:20.171276 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:20.171170 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 07 13:26:20.484341 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:20.484245 2579 generic.go:356] "Generic (PLEG): container finished" podID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerID="6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9" exitCode=0 Sep 07 13:26:20.484341 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:20.484300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerDied","Data":"6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9"} Sep 07 13:26:20.818994 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:20.818961 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 07 13:26:21.492306 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:21.492270 2579 generic.go:356] "Generic (PLEG): container finished" podID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerID="38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002" exitCode=0 Sep 07 13:26:21.492306 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:21.492297 2579 generic.go:356] "Generic (PLEG): container finished" podID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerID="8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf" exitCode=0 Sep 07 13:26:21.492554 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:21.492347 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerDied","Data":"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002"} Sep 07 13:26:21.492554 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:21.492409 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerDied","Data":"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf"} Sep 07 13:26:21.495341 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:21.495319 2579 generic.go:356] "Generic (PLEG): container finished" podID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerID="e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa" exitCode=0 Sep 07 13:26:21.495475 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:21.495356 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerDied","Data":"e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa"} Sep 07 13:26:26.241650 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:26.241599 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 07 13:26:27.242167 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:27.242124 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 07 13:26:30.170972 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:30.170920 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 07 13:26:30.818718 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:30.818659 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 07 13:26:36.241920 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:36.241871 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 07 13:26:37.242839 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:37.242804 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 07 13:26:37.243203 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:37.242963 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:26:40.170811 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:40.170753 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 07 13:26:40.171316 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:40.170957 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:26:40.819396 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:40.819352 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 07 13:26:40.819592 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:40.819485 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:26:46.242321 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:46.242262 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 07 13:26:46.242920 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:46.242424 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:26:47.242115 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:47.242077 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 07 13:26:50.014773 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.014749 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:26:50.089217 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.089152 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-offline-tls\") pod \"b6e39bd0-6f17-4059-b85a-949dc7c46925\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " Sep 07 13:26:50.089217 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.089186 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e39bd0-6f17-4059-b85a-949dc7c46925-feast-data\") pod \"b6e39bd0-6f17-4059-b85a-949dc7c46925\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " Sep 07 13:26:50.089407 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.089231 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-online-tls\") pod \"b6e39bd0-6f17-4059-b85a-949dc7c46925\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " Sep 07 13:26:50.089462 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.089419 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b6e39bd0-6f17-4059-b85a-949dc7c46925-registry-tls\") pod \"b6e39bd0-6f17-4059-b85a-949dc7c46925\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " Sep 07 13:26:50.089520 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.089503 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls\") pod \"b6e39bd0-6f17-4059-b85a-949dc7c46925\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " Sep 07 13:26:50.089568 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.089553 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kqd6\" (UniqueName: \"kubernetes.io/projected/b6e39bd0-6f17-4059-b85a-949dc7c46925-kube-api-access-8kqd6\") pod \"b6e39bd0-6f17-4059-b85a-949dc7c46925\" (UID: \"b6e39bd0-6f17-4059-b85a-949dc7c46925\") " Sep 07 13:26:50.089800 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.089772 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6e39bd0-6f17-4059-b85a-949dc7c46925-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b6e39bd0-6f17-4059-b85a-949dc7c46925" (UID: "b6e39bd0-6f17-4059-b85a-949dc7c46925"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:26:50.090109 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.090086 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6e39bd0-6f17-4059-b85a-949dc7c46925-feast-data" (OuterVolumeSpecName: "feast-data") pod "b6e39bd0-6f17-4059-b85a-949dc7c46925" (UID: "b6e39bd0-6f17-4059-b85a-949dc7c46925"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:26:50.091612 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.091585 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b6e39bd0-6f17-4059-b85a-949dc7c46925" (UID: "b6e39bd0-6f17-4059-b85a-949dc7c46925"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:26:50.091745 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.091618 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b6e39bd0-6f17-4059-b85a-949dc7c46925" (UID: "b6e39bd0-6f17-4059-b85a-949dc7c46925"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:26:50.091745 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.091631 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-online-tls" (OuterVolumeSpecName: "online-tls") pod "b6e39bd0-6f17-4059-b85a-949dc7c46925" (UID: "b6e39bd0-6f17-4059-b85a-949dc7c46925"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:26:50.091849 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.091822 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6e39bd0-6f17-4059-b85a-949dc7c46925-kube-api-access-8kqd6" (OuterVolumeSpecName: "kube-api-access-8kqd6") pod "b6e39bd0-6f17-4059-b85a-949dc7c46925" (UID: "b6e39bd0-6f17-4059-b85a-949dc7c46925"). InnerVolumeSpecName "kube-api-access-8kqd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:26:50.170548 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.170517 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Sep 07 13:26:50.170636 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.170518 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 07 13:26:50.170713 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.170523 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 07 13:26:50.190129 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.190109 2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-offline-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.190129 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.190127 2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b6e39bd0-6f17-4059-b85a-949dc7c46925-feast-data\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.190222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.190135 2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-online-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.190222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.190143 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b6e39bd0-6f17-4059-b85a-949dc7c46925-registry-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.190222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.190151 2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b6e39bd0-6f17-4059-b85a-949dc7c46925-ui-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.190222 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.190158 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kqd6\" (UniqueName: \"kubernetes.io/projected/b6e39bd0-6f17-4059-b85a-949dc7c46925-kube-api-access-8kqd6\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.557164 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.557140 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:26:50.615747 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.615719 2579 generic.go:356] "Generic (PLEG): container finished" podID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerID="caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542" exitCode=137 Sep 07 13:26:50.615747 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.615742 2579 generic.go:356] "Generic (PLEG): container finished" podID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerID="07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df" exitCode=137 Sep 07 13:26:50.615944 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.615780 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" Sep 07 13:26:50.615944 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.615795 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerDied","Data":"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542"} Sep 07 13:26:50.615944 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.615838 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerDied","Data":"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df"} Sep 07 13:26:50.615944 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.615859 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6" event={"ID":"3c989862-0a15-4f90-bee7-8dbc91c3fc67","Type":"ContainerDied","Data":"4246557e30ec1fb214d292028f57c7a59d40a2aeb330ed322d87c6698c008fe7"} Sep 07 13:26:50.615944 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.615884 2579 scope.go:117] "RemoveContainer" containerID="38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002" Sep 07 13:26:50.618461 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.618435 2579 generic.go:356] "Generic (PLEG): container finished" podID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerID="55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732" exitCode=137 Sep 07 13:26:50.618563 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.618487 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" Sep 07 13:26:50.618563 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.618521 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerDied","Data":"55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732"} Sep 07 13:26:50.618563 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.618559 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw" event={"ID":"b6e39bd0-6f17-4059-b85a-949dc7c46925","Type":"ContainerDied","Data":"d813bd682af304a0502eac347cb3f1652688967603e5a9ce6fc3c600b683fb67"} Sep 07 13:26:50.625939 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.625910 2579 scope.go:117] "RemoveContainer" containerID="caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542" Sep 07 13:26:50.634467 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.634448 2579 scope.go:117] "RemoveContainer" containerID="8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf" Sep 07 13:26:50.641888 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.641870 2579 scope.go:117] "RemoveContainer" containerID="07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df" Sep 07 13:26:50.645485 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.645465 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw"] Sep 07 13:26:50.649541 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.649525 2579 scope.go:117] "RemoveContainer" containerID="172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30" Sep 07 13:26:50.649643 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.649620 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-5c2nw"] Sep 07 13:26:50.656288 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.656272 2579 scope.go:117] "RemoveContainer" containerID="5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56" Sep 07 13:26:50.663252 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.663238 2579 scope.go:117] "RemoveContainer" containerID="38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002" Sep 07 13:26:50.663495 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.663479 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002\": container with ID starting with 38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002 not found: ID does not exist" containerID="38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002" Sep 07 13:26:50.663550 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.663501 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002"} err="failed to get container status \"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002\": rpc error: code = NotFound desc = could not find container \"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002\": container with ID starting with 38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002 not found: ID does not exist" Sep 07 13:26:50.663550 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.663516 2579 scope.go:117] "RemoveContainer" containerID="caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542" Sep 07 13:26:50.663729 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.663712 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542\": container with ID starting with caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542 not found: ID does not exist" containerID="caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542" Sep 07 13:26:50.663779 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.663733 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542"} err="failed to get container status \"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542\": rpc error: code = NotFound desc = could not find container \"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542\": container with ID starting with caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542 not found: ID does not exist" Sep 07 13:26:50.663779 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.663744 2579 scope.go:117] "RemoveContainer" containerID="8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf" Sep 07 13:26:50.663970 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.663955 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf\": container with ID starting with 8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf not found: ID does not exist" containerID="8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf" Sep 07 13:26:50.664017 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.663973 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf"} err="failed to get container status \"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf\": rpc error: code = NotFound desc = could not find container \"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf\": container with ID starting with 8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf not found: ID does not exist" Sep 07 13:26:50.664017 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.663985 2579 scope.go:117] "RemoveContainer" containerID="07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df" Sep 07 13:26:50.664190 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.664175 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df\": container with ID starting with 07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df not found: ID does not exist" containerID="07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df" Sep 07 13:26:50.664231 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.664192 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df"} err="failed to get container status \"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df\": rpc error: code = NotFound desc = could not find container \"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df\": container with ID starting with 07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df not found: ID does not exist" Sep 07 13:26:50.664231 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.664203 2579 scope.go:117] "RemoveContainer" containerID="172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30" Sep 07 13:26:50.664396 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.664382 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30\": container with ID starting with 172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30 not found: ID does not exist" containerID="172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30" Sep 07 13:26:50.664434 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.664399 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30"} err="failed to get container status \"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30\": rpc error: code = NotFound desc = could not find container \"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30\": container with ID starting with 172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30 not found: ID does not exist" Sep 07 13:26:50.664434 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.664410 2579 scope.go:117] "RemoveContainer" containerID="5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56" Sep 07 13:26:50.664597 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.664583 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56\": container with ID starting with 5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56 not found: ID does not exist" containerID="5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56" Sep 07 13:26:50.664636 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.664600 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56"} err="failed to get container status \"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56\": rpc error: code = NotFound desc = could not find container \"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56\": container with ID starting with 5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56 not found: ID does not exist" Sep 07 13:26:50.664636 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.664611 2579 scope.go:117] "RemoveContainer" containerID="38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002" Sep 07 13:26:50.664827 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.664812 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002"} err="failed to get container status \"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002\": rpc error: code = NotFound desc = could not find container \"38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002\": container with ID starting with 38b6607abab2cb41b430baa177e1e481710a5b8f4428aa599842c1d9180c9002 not found: ID does not exist" Sep 07 13:26:50.664870 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.664827 2579 scope.go:117] "RemoveContainer" containerID="caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542" Sep 07 13:26:50.665043 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.665024 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542"} err="failed to get container status \"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542\": rpc error: code = NotFound desc = could not find container \"caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542\": container with ID starting with caa1c5cceee20a55ba968d2fb3c975b51b8efba9d71d1bf2660e0542b0e4a542 not found: ID does not exist" Sep 07 13:26:50.665086 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.665045 2579 scope.go:117] "RemoveContainer" containerID="8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf" Sep 07 13:26:50.665257 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.665239 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf"} err="failed to get container status \"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf\": rpc error: code = NotFound desc = could not find container \"8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf\": container with ID starting with 8d96da09e6f56bd227a88d12acd5f72ab357364090dffc364c2515ee09a0baaf not found: ID does not exist" Sep 07 13:26:50.665327 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.665260 2579 scope.go:117] "RemoveContainer" containerID="07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df" Sep 07 13:26:50.665527 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.665511 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df"} err="failed to get container status \"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df\": rpc error: code = NotFound desc = could not find container \"07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df\": container with ID starting with 07ae3307063cff48631ce211df7bc4904445a2bf715aa760574da2121c40f0df not found: ID does not exist" Sep 07 13:26:50.665577 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.665528 2579 scope.go:117] "RemoveContainer" containerID="172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30" Sep 07 13:26:50.665785 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.665767 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30"} err="failed to get container status \"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30\": rpc error: code = NotFound desc = could not find container \"172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30\": container with ID starting with 172d67e5371159e73b03ad510abbebba715e9df66c358f877af929f0eb118f30 not found: ID does not exist" Sep 07 13:26:50.665845 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.665787 2579 scope.go:117] "RemoveContainer" containerID="5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56" Sep 07 13:26:50.666033 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.666016 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56"} err="failed to get container status \"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56\": rpc error: code = NotFound desc = could not find container \"5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56\": container with ID starting with 5b0a1102662fa6ac9ddf021e5c1a8006c3a7ff6b1a65e02c2f80fe663e1e8a56 not found: ID does not exist" Sep 07 13:26:50.666097 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.666036 2579 scope.go:117] "RemoveContainer" containerID="6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9" Sep 07 13:26:50.672631 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.672614 2579 scope.go:117] "RemoveContainer" containerID="55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732" Sep 07 13:26:50.679490 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.679477 2579 scope.go:117] "RemoveContainer" containerID="e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa" Sep 07 13:26:50.686198 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.686181 2579 scope.go:117] "RemoveContainer" containerID="09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb" Sep 07 13:26:50.692799 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.692782 2579 scope.go:117] "RemoveContainer" containerID="1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2" Sep 07 13:26:50.694835 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.694817 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44zt8\" (UniqueName: \"kubernetes.io/projected/3c989862-0a15-4f90-bee7-8dbc91c3fc67-kube-api-access-44zt8\") pod \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " Sep 07 13:26:50.694939 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.694877 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-online-tls\") pod \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " Sep 07 13:26:50.694939 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.694902 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls\") pod \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " Sep 07 13:26:50.695048 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.694939 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-ui-tls\") pod \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " Sep 07 13:26:50.695104 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.695059 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c989862-0a15-4f90-bee7-8dbc91c3fc67-feast-data\") pod \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " Sep 07 13:26:50.695160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.695108 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls\") pod \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\" (UID: \"3c989862-0a15-4f90-bee7-8dbc91c3fc67\") " Sep 07 13:26:50.695731 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.695704 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c989862-0a15-4f90-bee7-8dbc91c3fc67-feast-data" (OuterVolumeSpecName: "feast-data") pod "3c989862-0a15-4f90-bee7-8dbc91c3fc67" (UID: "3c989862-0a15-4f90-bee7-8dbc91c3fc67"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:26:50.697212 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.697187 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3c989862-0a15-4f90-bee7-8dbc91c3fc67" (UID: "3c989862-0a15-4f90-bee7-8dbc91c3fc67"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:26:50.697428 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.697401 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c989862-0a15-4f90-bee7-8dbc91c3fc67-kube-api-access-44zt8" (OuterVolumeSpecName: "kube-api-access-44zt8") pod "3c989862-0a15-4f90-bee7-8dbc91c3fc67" (UID: "3c989862-0a15-4f90-bee7-8dbc91c3fc67"). InnerVolumeSpecName "kube-api-access-44zt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:26:50.697529 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.697482 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-online-tls" (OuterVolumeSpecName: "online-tls") pod "3c989862-0a15-4f90-bee7-8dbc91c3fc67" (UID: "3c989862-0a15-4f90-bee7-8dbc91c3fc67"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:26:50.697529 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.697511 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3c989862-0a15-4f90-bee7-8dbc91c3fc67" (UID: "3c989862-0a15-4f90-bee7-8dbc91c3fc67"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:26:50.697814 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.697797 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3c989862-0a15-4f90-bee7-8dbc91c3fc67" (UID: "3c989862-0a15-4f90-bee7-8dbc91c3fc67"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:26:50.700071 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.700055 2579 scope.go:117] "RemoveContainer" containerID="6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9" Sep 07 13:26:50.700328 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.700313 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9\": container with ID starting with 6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9 not found: ID does not exist" containerID="6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9" Sep 07 13:26:50.700372 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.700333 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9"} err="failed to get container status \"6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9\": rpc error: code = NotFound desc = could not find container \"6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9\": container with ID starting with 6dcb523c5f6d283a5b62165d37918cc4835957d43ee33c9642714168369aa0d9 not found: ID does not exist" Sep 07 13:26:50.700372 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.700346 2579 scope.go:117] "RemoveContainer" containerID="55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732" Sep 07 13:26:50.700580 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.700564 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732\": container with ID starting with 55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732 not found: ID does not exist" containerID="55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732" Sep 07 13:26:50.700622 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.700583 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732"} err="failed to get container status \"55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732\": rpc error: code = NotFound desc = could not find container \"55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732\": container with ID starting with 55053d403738cd11f1b7e27b29f0c09c01b8284aeb2f88bcfbe16f469528b732 not found: ID does not exist" Sep 07 13:26:50.700622 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.700594 2579 scope.go:117] "RemoveContainer" containerID="e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa" Sep 07 13:26:50.700845 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.700830 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa\": container with ID starting with e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa not found: ID does not exist" containerID="e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa" Sep 07 13:26:50.700895 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.700848 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa"} err="failed to get container status \"e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa\": rpc error: code = NotFound desc = could not find container \"e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa\": container with ID starting with e8c28d795eb73cc35f4054c776be78ee4f08ef01f91706f8a3d4fd32c0c5dafa not found: ID does not exist" Sep 07 13:26:50.700895 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.700859 2579 scope.go:117] "RemoveContainer" containerID="09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb" Sep 07 13:26:50.701080 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.701063 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb\": container with ID starting with 09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb not found: ID does not exist" containerID="09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb" Sep 07 13:26:50.701116 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.701087 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb"} err="failed to get container status \"09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb\": rpc error: code = NotFound desc = could not find container \"09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb\": container with ID starting with 09026306efd55bd7ef82fd097dd6113aac04c424590f4d6eee67f7c7643dcdbb not found: ID does not exist" Sep 07 13:26:50.701116 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.701101 2579 scope.go:117] "RemoveContainer" containerID="1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2" Sep 07 13:26:50.701321 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:26:50.701307 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2\": container with ID starting with 1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2 not found: ID does not exist" containerID="1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2" Sep 07 13:26:50.701362 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.701323 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2"} err="failed to get container status \"1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2\": rpc error: code = NotFound desc = could not find container \"1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2\": container with ID starting with 1885479f44e12f68849ae4aa24e986a4439e1f0068750023d64e9edb85401bc2 not found: ID does not exist" Sep 07 13:26:50.795841 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.795821 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44zt8\" (UniqueName: \"kubernetes.io/projected/3c989862-0a15-4f90-bee7-8dbc91c3fc67-kube-api-access-44zt8\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.795841 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.795840 2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-online-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.795953 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.795849 2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-offline-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.795953 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.795858 2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-ui-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.795953 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.795871 2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3c989862-0a15-4f90-bee7-8dbc91c3fc67-feast-data\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.795953 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.795880 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3c989862-0a15-4f90-bee7-8dbc91c3fc67-registry-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:26:50.937304 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.937282 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6"] Sep 07 13:26:50.942575 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:50.942556 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-m98d6"] Sep 07 13:26:51.696861 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:51.696828 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" path="/var/lib/kubelet/pods/3c989862-0a15-4f90-bee7-8dbc91c3fc67/volumes" Sep 07 13:26:51.697429 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:26:51.697414 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" path="/var/lib/kubelet/pods/b6e39bd0-6f17-4059-b85a-949dc7c46925/volumes" Sep 07 13:27:09.352175 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.352131 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc"] Sep 07 13:27:09.352663 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.352421 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" podUID="2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06" containerName="manager" containerID="cri-o://5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d" gracePeriod=10 Sep 07 13:27:09.588340 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.588314 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:27:09.690596 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.690516 2579 generic.go:356] "Generic (PLEG): container finished" podID="2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06" containerID="5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d" exitCode=0 Sep 07 13:27:09.690596 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.690555 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" Sep 07 13:27:09.690787 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.690555 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" event={"ID":"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06","Type":"ContainerDied","Data":"5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d"} Sep 07 13:27:09.690787 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.690711 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc" event={"ID":"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06","Type":"ContainerDied","Data":"2261c1c1af28d16507fd6ec7016e2d562ed2cffa4725ffd9fb27a90d5e2e8b43"} Sep 07 13:27:09.690787 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.690740 2579 scope.go:117] "RemoveContainer" containerID="5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d" Sep 07 13:27:09.700641 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.700622 2579 scope.go:117] "RemoveContainer" containerID="5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d" Sep 07 13:27:09.700961 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:27:09.700938 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d\": container with ID starting with 5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d not found: ID does not exist" containerID="5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d" Sep 07 13:27:09.701028 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.700972 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d"} err="failed to get container status \"5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d\": rpc error: code = NotFound desc = could not find container \"5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d\": container with ID starting with 5bb23220ca508585245546cb12b9855be91b5860e4d4dad17c453cee69a5849d not found: ID does not exist" Sep 07 13:27:09.719795 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.719776 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mss7q\" (UniqueName: \"kubernetes.io/projected/2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06-kube-api-access-mss7q\") pod \"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06\" (UID: \"2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06\") " Sep 07 13:27:09.721848 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.721826 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06-kube-api-access-mss7q" (OuterVolumeSpecName: "kube-api-access-mss7q") pod "2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06" (UID: "2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06"). InnerVolumeSpecName "kube-api-access-mss7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:27:09.820323 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:09.820297 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mss7q\" (UniqueName: \"kubernetes.io/projected/2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06-kube-api-access-mss7q\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:27:10.010606 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:10.010584 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc"] Sep 07 13:27:10.012503 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:10.012483 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-sqmcc"] Sep 07 13:27:11.696638 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:11.696603 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06" path="/var/lib/kubelet/pods/2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06/volumes" Sep 07 13:27:14.193151 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193113 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x"] Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193361 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06" containerName="manager" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193372 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06" containerName="manager" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193388 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="feast-apply" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193393 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="feast-apply" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193399 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193405 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193412 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="feast-init" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193417 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="feast-init" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193424 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193429 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193439 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="registry" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193444 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="registry" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193450 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193455 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193462 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="offline" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193468 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="offline" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193474 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="feast-apply" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193479 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="feast-apply" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193484 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193489 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193497 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="feast-init" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193501 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="feast-init" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193507 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="offline" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193511 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="offline" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193549 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="online" Sep 07 13:27:14.193543 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193558 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bfdb8b1-dd46-49ed-bf94-aada9d4a2f06" containerName="manager" Sep 07 13:27:14.194325 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193564 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="online" Sep 07 13:27:14.194325 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193570 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="offline" Sep 07 13:27:14.194325 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193574 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="registry" Sep 07 13:27:14.194325 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193579 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="ui" Sep 07 13:27:14.194325 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193584 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6e39bd0-6f17-4059-b85a-949dc7c46925" containerName="ui" Sep 07 13:27:14.194325 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.193589 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c989862-0a15-4f90-bee7-8dbc91c3fc67" containerName="offline" Sep 07 13:27:14.197861 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.197843 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" Sep 07 13:27:14.201439 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.201413 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 07 13:27:14.202364 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.202343 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-2tjfj\"" Sep 07 13:27:14.202471 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.202413 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 07 13:27:14.212235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.212210 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x"] Sep 07 13:27:14.347904 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.347871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4s2k\" (UniqueName: \"kubernetes.io/projected/2214bf5d-6aa2-43dd-9ab8-6b2a41a5b92e-kube-api-access-k4s2k\") pod \"feast-operator-controller-manager-689b877b4b-l727x\" (UID: \"2214bf5d-6aa2-43dd-9ab8-6b2a41a5b92e\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" Sep 07 13:27:14.448577 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.448514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4s2k\" (UniqueName: \"kubernetes.io/projected/2214bf5d-6aa2-43dd-9ab8-6b2a41a5b92e-kube-api-access-k4s2k\") pod \"feast-operator-controller-manager-689b877b4b-l727x\" (UID: \"2214bf5d-6aa2-43dd-9ab8-6b2a41a5b92e\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" Sep 07 13:27:14.458436 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.458414 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4s2k\" (UniqueName: \"kubernetes.io/projected/2214bf5d-6aa2-43dd-9ab8-6b2a41a5b92e-kube-api-access-k4s2k\") pod \"feast-operator-controller-manager-689b877b4b-l727x\" (UID: \"2214bf5d-6aa2-43dd-9ab8-6b2a41a5b92e\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" Sep 07 13:27:14.508353 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.508329 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" Sep 07 13:27:14.778402 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:14.778373 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x"] Sep 07 13:27:14.781411 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:27:14.781386 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2214bf5d_6aa2_43dd_9ab8_6b2a41a5b92e.slice/crio-fa9d4adb85e9a63e86183e2d6762fffca40c16c844e7f2598ea39ad5fc79885c WatchSource:0}: Error finding container fa9d4adb85e9a63e86183e2d6762fffca40c16c844e7f2598ea39ad5fc79885c: Status 404 returned error can't find the container with id fa9d4adb85e9a63e86183e2d6762fffca40c16c844e7f2598ea39ad5fc79885c Sep 07 13:27:15.714991 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:15.714946 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" event={"ID":"2214bf5d-6aa2-43dd-9ab8-6b2a41a5b92e","Type":"ContainerStarted","Data":"a37f8fe7505455620a91b8d8504329babaec148d916ca5eabdc18a85cc706b1b"} Sep 07 13:27:15.715353 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:15.715020 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" Sep 07 13:27:15.715353 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:15.715047 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" event={"ID":"2214bf5d-6aa2-43dd-9ab8-6b2a41a5b92e","Type":"ContainerStarted","Data":"fa9d4adb85e9a63e86183e2d6762fffca40c16c844e7f2598ea39ad5fc79885c"} Sep 07 13:27:15.733497 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:15.733447 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" podStartSLOduration=1.733431959 podStartE2EDuration="1.733431959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:27:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:27:15.732202611 +0000 UTC m=+1584.520507408" watchObservedRunningTime="2026-09-07 13:27:15.733431959 +0000 UTC m=+1584.521736755" Sep 07 13:27:26.720819 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:26.720776 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-l727x" Sep 07 13:27:32.161427 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.161368 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq"] Sep 07 13:27:32.164830 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.164812 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.170083 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.170060 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 07 13:27:32.170298 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.170280 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 07 13:27:32.170359 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.170319 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 07 13:27:32.172219 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.172204 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-p9842\"" Sep 07 13:27:32.173305 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.173291 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 07 13:27:32.174167 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.174151 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 07 13:27:32.177082 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.177067 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 07 13:27:32.253482 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.253461 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq"] Sep 07 13:27:32.265411 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.265387 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.265496 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.265414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.265496 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.265440 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.265581 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.265545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.265581 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.265577 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0ded9ef-1853-40c0-93d4-0cd81078e920-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.265660 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.265595 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tltsg\" (UniqueName: \"kubernetes.io/projected/e0ded9ef-1853-40c0-93d4-0cd81078e920-kube-api-access-tltsg\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.366460 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.366441 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.366559 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.366487 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.366559 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.366506 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0ded9ef-1853-40c0-93d4-0cd81078e920-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.366559 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.366523 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tltsg\" (UniqueName: \"kubernetes.io/projected/e0ded9ef-1853-40c0-93d4-0cd81078e920-kube-api-access-tltsg\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.366559 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.366540 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.366828 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.366559 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.366828 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:27:32.366646 2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 07 13:27:32.366828 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:27:32.366727 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls podName:e0ded9ef-1853-40c0-93d4-0cd81078e920 nodeName:}" failed. No retries permitted until 2026-09-07 13:27:32.866710416 +0000 UTC m=+1601.655015207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls") pod "feast-simple-feast-setup-57576b8fcf-mvzkq" (UID: "e0ded9ef-1853-40c0-93d4-0cd81078e920") : secret "feast-simple-feast-setup-online-tls" not found Sep 07 13:27:32.366970 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.366955 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0ded9ef-1853-40c0-93d4-0cd81078e920-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.369234 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.369206 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.369332 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.369269 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.369332 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.369302 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.395756 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.395728 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tltsg\" (UniqueName: \"kubernetes.io/projected/e0ded9ef-1853-40c0-93d4-0cd81078e920-kube-api-access-tltsg\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.870841 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.870816 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:32.873219 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:32.873187 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-mvzkq\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:33.074149 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:33.074116 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:33.358799 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:33.358764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq"] Sep 07 13:27:33.363015 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:27:33.362987 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0ded9ef_1853_40c0_93d4_0cd81078e920.slice/crio-1e363e51ad5d782d26f75db61777dc9cc6246eabcdb78f6e95b8f2742035cae6 WatchSource:0}: Error finding container 1e363e51ad5d782d26f75db61777dc9cc6246eabcdb78f6e95b8f2742035cae6: Status 404 returned error can't find the container with id 1e363e51ad5d782d26f75db61777dc9cc6246eabcdb78f6e95b8f2742035cae6 Sep 07 13:27:33.780191 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:33.780145 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerStarted","Data":"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330"} Sep 07 13:27:33.780355 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:33.780205 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerStarted","Data":"1e363e51ad5d782d26f75db61777dc9cc6246eabcdb78f6e95b8f2742035cae6"} Sep 07 13:27:38.800699 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:38.800649 2579 generic.go:356] "Generic (PLEG): container finished" podID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerID="d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330" exitCode=0 Sep 07 13:27:38.801077 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:38.800739 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerDied","Data":"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330"} Sep 07 13:27:39.805615 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:39.805581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerStarted","Data":"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27"} Sep 07 13:27:44.825194 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:44.825162 2579 generic.go:356] "Generic (PLEG): container finished" podID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerID="28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27" exitCode=0 Sep 07 13:27:44.825523 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:44.825200 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerDied","Data":"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27"} Sep 07 13:27:45.834703 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:45.834641 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerStarted","Data":"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f"} Sep 07 13:27:45.835167 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:45.834722 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerStarted","Data":"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356"} Sep 07 13:27:45.835167 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:45.834745 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerStarted","Data":"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411"} Sep 07 13:27:45.835167 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:45.834761 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerStarted","Data":"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef"} Sep 07 13:27:45.865220 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:45.865141 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podStartSLOduration=13.865118617 podStartE2EDuration="13.865118617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:27:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:27:45.864496681 +0000 UTC m=+1614.652801481" watchObservedRunningTime="2026-09-07 13:27:45.865118617 +0000 UTC m=+1614.653423414" Sep 07 13:27:48.075103 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:48.075063 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:48.075558 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:48.075130 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:48.075558 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:48.075150 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:48.075558 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:48.075170 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:48.077056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:48.076961 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused" Sep 07 13:27:48.077056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:48.076979 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Sep 07 13:27:48.077056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:48.076995 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 07 13:27:48.077056 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:48.077040 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 07 13:27:51.074880 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:51.074814 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 07 13:27:51.074880 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:51.074824 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.25:6571: connect: connection refused" Sep 07 13:27:51.074880 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:51.074814 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.25:8816: connect: connection refused" Sep 07 13:27:51.075493 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:51.074842 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 07 13:27:53.074540 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:53.074509 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:53.074912 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:53.074581 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:53.074912 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:53.074610 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:53.074912 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:53.074628 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:54.075085 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:54.075055 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:54.075521 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:54.075290 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:54.075521 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:54.075405 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:54.080374 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:54.080357 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:54.879925 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:54.879894 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:54.880141 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:54.880095 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:54.880210 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:54.880191 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:27:54.882851 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:27:54.882833 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:28:57.382840 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.382805 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq"] Sep 07 13:28:57.383337 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.383054 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="registry" containerID="cri-o://1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef" gracePeriod=30 Sep 07 13:28:57.383337 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.383112 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" containerID="cri-o://2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f" gracePeriod=30 Sep 07 13:28:57.383337 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.383148 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" containerID="cri-o://a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411" gracePeriod=30 Sep 07 13:28:57.383337 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.383111 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="offline" containerID="cri-o://5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356" gracePeriod=30 Sep 07 13:28:57.820244 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.820203 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx"] Sep 07 13:28:57.824352 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.824326 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:57.827246 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.827224 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bnqxc\"" Sep 07 13:28:57.838759 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.838734 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx"] Sep 07 13:28:57.951877 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.951839 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:57.951877 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.951890 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:57.952148 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.952001 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrdl2\" (UniqueName: \"kubernetes.io/projected/c2013020-7707-46c9-b162-471d38ab8d55-kube-api-access-qrdl2\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:57.952148 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.952041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:57.952148 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.952068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:57.952148 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:57.952105 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2013020-7707-46c9-b162-471d38ab8d55-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.053425 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.053393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrdl2\" (UniqueName: \"kubernetes.io/projected/c2013020-7707-46c9-b162-471d38ab8d55-kube-api-access-qrdl2\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.053598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.053434 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.053598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.053457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.053598 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.053471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2013020-7707-46c9-b162-471d38ab8d55-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.053598 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:28:58.053567 2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 07 13:28:58.053867 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.053607 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.053867 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:28:58.053639 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls podName:c2013020-7707-46c9-b162-471d38ab8d55 nodeName:}" failed. No retries permitted until 2026-09-07 13:28:58.553618534 +0000 UTC m=+1687.341923328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls") pod "feast-simple-feast-setup-57576b8fcf-cqhnx" (UID: "c2013020-7707-46c9-b162-471d38ab8d55") : secret "feast-simple-feast-setup-online-tls" not found Sep 07 13:28:58.053867 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.053705 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.054021 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.053889 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2013020-7707-46c9-b162-471d38ab8d55-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.056219 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.056199 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.056327 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.056222 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.056327 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.056262 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.063571 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.063550 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrdl2\" (UniqueName: \"kubernetes.io/projected/c2013020-7707-46c9-b162-471d38ab8d55-kube-api-access-qrdl2\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.122029 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.121998 2579 generic.go:356] "Generic (PLEG): container finished" podID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerID="2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f" exitCode=0 Sep 07 13:28:58.122160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.122056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerDied","Data":"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f"} Sep 07 13:28:58.558495 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.558461 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.560852 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.560833 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-cqhnx\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:58.734128 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:58.734101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:28:59.022657 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:59.022631 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx"] Sep 07 13:28:59.024198 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:28:59.024170 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2013020_7707_46c9_b162_471d38ab8d55.slice/crio-a74c8f63daba80e5b9553a6379a1f80f6ea065dfa115556ced852780e655ba6c WatchSource:0}: Error finding container a74c8f63daba80e5b9553a6379a1f80f6ea065dfa115556ced852780e655ba6c: Status 404 returned error can't find the container with id a74c8f63daba80e5b9553a6379a1f80f6ea065dfa115556ced852780e655ba6c Sep 07 13:28:59.127431 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:59.127399 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerStarted","Data":"1c8e5c735c2953649bd6cbe1714a0bec31b721e41a52fe95d7a0fb2eacefb234"} Sep 07 13:28:59.127544 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:59.127449 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerStarted","Data":"a74c8f63daba80e5b9553a6379a1f80f6ea065dfa115556ced852780e655ba6c"} Sep 07 13:28:59.130628 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:59.130602 2579 generic.go:356] "Generic (PLEG): container finished" podID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerID="a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411" exitCode=0 Sep 07 13:28:59.130732 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:28:59.130642 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerDied","Data":"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411"} Sep 07 13:29:04.151885 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:04.151801 2579 generic.go:356] "Generic (PLEG): container finished" podID="c2013020-7707-46c9-b162-471d38ab8d55" containerID="1c8e5c735c2953649bd6cbe1714a0bec31b721e41a52fe95d7a0fb2eacefb234" exitCode=0 Sep 07 13:29:04.152247 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:04.151884 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerDied","Data":"1c8e5c735c2953649bd6cbe1714a0bec31b721e41a52fe95d7a0fb2eacefb234"} Sep 07 13:29:04.880223 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:04.880186 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 07 13:29:04.880411 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:04.880366 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 07 13:29:05.158226 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:05.158142 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerStarted","Data":"3660c3c71a6d19fc54a81db83bba3082a7ea3ec6170b43b175b5e01081642a8a"} Sep 07 13:29:10.180565 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:10.180486 2579 generic.go:356] "Generic (PLEG): container finished" podID="c2013020-7707-46c9-b162-471d38ab8d55" containerID="3660c3c71a6d19fc54a81db83bba3082a7ea3ec6170b43b175b5e01081642a8a" exitCode=0 Sep 07 13:29:10.180924 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:10.180572 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerDied","Data":"3660c3c71a6d19fc54a81db83bba3082a7ea3ec6170b43b175b5e01081642a8a"} Sep 07 13:29:11.190799 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:11.190758 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerStarted","Data":"422d747a21d21748c175993c1417a8c7bfda5bc6bcae58ce73c4748834cb166a"} Sep 07 13:29:11.191271 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:11.190822 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerStarted","Data":"927b545e5222789d4f77f547e24ae04f1a9a4489960ebdbd72d3f40b486bb02e"} Sep 07 13:29:11.191271 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:11.190845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerStarted","Data":"b6f493c3f64561e3e4c92c1f6e4c331b25ce9e8e21234c62246e9104d1431db6"} Sep 07 13:29:11.191271 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:11.190863 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerStarted","Data":"a928074fcb7e5b956b856c020f6be2bba9efd5fa4d828686e6aefba7af1f5371"} Sep 07 13:29:11.220179 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:11.220095 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podStartSLOduration=14.220071616 podStartE2EDuration="14.220071616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:28:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:29:11.216877816 +0000 UTC m=+1700.005182637" watchObservedRunningTime="2026-09-07 13:29:11.220071616 +0000 UTC m=+1700.008376413" Sep 07 13:29:13.734818 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:13.734727 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:13.734818 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:13.734809 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:13.735341 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:13.734830 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:13.735341 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:13.734861 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:13.737134 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:13.737097 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused" Sep 07 13:29:13.737253 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:13.737121 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused" Sep 07 13:29:13.737253 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:13.737157 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 07 13:29:13.737253 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:13.737247 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 07 13:29:14.880129 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:14.880083 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 07 13:29:14.880720 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:14.880125 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 07 13:29:16.734306 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:16.734246 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused" Sep 07 13:29:16.734805 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:16.734374 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused" Sep 07 13:29:16.734805 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:16.734484 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 07 13:29:16.734805 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:16.734562 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 07 13:29:18.735031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:18.734979 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:18.735031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:18.735037 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:18.735031 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:18.735054 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:18.735500 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:18.735066 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:19.735961 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:19.735930 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:19.736388 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:19.736053 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:19.736388 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:19.736313 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:19.736886 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:19.736835 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:19.737165 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:19.737144 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:19.737263 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:19.737245 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:19.741716 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:19.741697 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:20.243685 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:20.243653 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:29:24.880037 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:24.879970 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.25:8443: connect: connection refused" Sep 07 13:29:24.880037 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:24.880008 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" probeResult="failure" output="Get \"https://10.133.0.25:6567/health\": dial tcp 10.133.0.25:6567: connect: connection refused" Sep 07 13:29:24.880591 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:24.880125 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:29:24.880591 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:24.880357 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:29:28.033380 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.033357 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:29:28.187416 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.187298 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0ded9ef-1853-40c0-93d4-0cd81078e920-feast-data\") pod \"e0ded9ef-1853-40c0-93d4-0cd81078e920\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " Sep 07 13:29:28.187538 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.187420 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tltsg\" (UniqueName: \"kubernetes.io/projected/e0ded9ef-1853-40c0-93d4-0cd81078e920-kube-api-access-tltsg\") pod \"e0ded9ef-1853-40c0-93d4-0cd81078e920\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " Sep 07 13:29:28.187538 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.187463 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-offline-tls\") pod \"e0ded9ef-1853-40c0-93d4-0cd81078e920\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " Sep 07 13:29:28.187538 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.187490 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls\") pod \"e0ded9ef-1853-40c0-93d4-0cd81078e920\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " Sep 07 13:29:28.187538 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.187508 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-ui-tls\") pod \"e0ded9ef-1853-40c0-93d4-0cd81078e920\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " Sep 07 13:29:28.187780 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.187644 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-registry-tls\") pod \"e0ded9ef-1853-40c0-93d4-0cd81078e920\" (UID: \"e0ded9ef-1853-40c0-93d4-0cd81078e920\") " Sep 07 13:29:28.188377 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.187751 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0ded9ef-1853-40c0-93d4-0cd81078e920-feast-data" (OuterVolumeSpecName: "feast-data") pod "e0ded9ef-1853-40c0-93d4-0cd81078e920" (UID: "e0ded9ef-1853-40c0-93d4-0cd81078e920"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:29:28.188377 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.188182 2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e0ded9ef-1853-40c0-93d4-0cd81078e920-feast-data\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:29:28.190793 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.190749 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e0ded9ef-1853-40c0-93d4-0cd81078e920" (UID: "e0ded9ef-1853-40c0-93d4-0cd81078e920"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:29:28.190793 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.190762 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e0ded9ef-1853-40c0-93d4-0cd81078e920" (UID: "e0ded9ef-1853-40c0-93d4-0cd81078e920"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:29:28.190951 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.190707 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ded9ef-1853-40c0-93d4-0cd81078e920-kube-api-access-tltsg" (OuterVolumeSpecName: "kube-api-access-tltsg") pod "e0ded9ef-1853-40c0-93d4-0cd81078e920" (UID: "e0ded9ef-1853-40c0-93d4-0cd81078e920"). InnerVolumeSpecName "kube-api-access-tltsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:29:28.194933 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.194906 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e0ded9ef-1853-40c0-93d4-0cd81078e920" (UID: "e0ded9ef-1853-40c0-93d4-0cd81078e920"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:29:28.195187 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.195159 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls" (OuterVolumeSpecName: "online-tls") pod "e0ded9ef-1853-40c0-93d4-0cd81078e920" (UID: "e0ded9ef-1853-40c0-93d4-0cd81078e920"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:29:28.270420 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.270393 2579 generic.go:356] "Generic (PLEG): container finished" podID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerID="5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356" exitCode=137 Sep 07 13:29:28.270420 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.270421 2579 generic.go:356] "Generic (PLEG): container finished" podID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerID="1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef" exitCode=137 Sep 07 13:29:28.270665 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.270464 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" Sep 07 13:29:28.270665 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.270483 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerDied","Data":"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356"} Sep 07 13:29:28.270665 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.270543 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerDied","Data":"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef"} Sep 07 13:29:28.270665 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.270564 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq" event={"ID":"e0ded9ef-1853-40c0-93d4-0cd81078e920","Type":"ContainerDied","Data":"1e363e51ad5d782d26f75db61777dc9cc6246eabcdb78f6e95b8f2742035cae6"} Sep 07 13:29:28.270665 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.270590 2579 scope.go:117] "RemoveContainer" containerID="2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f" Sep 07 13:29:28.278801 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.278781 2579 scope.go:117] "RemoveContainer" containerID="5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356" Sep 07 13:29:28.287938 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.287861 2579 scope.go:117] "RemoveContainer" containerID="a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411" Sep 07 13:29:28.288482 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.288463 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tltsg\" (UniqueName: \"kubernetes.io/projected/e0ded9ef-1853-40c0-93d4-0cd81078e920-kube-api-access-tltsg\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:29:28.288560 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.288488 2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-offline-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:29:28.288560 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.288524 2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-online-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:29:28.288560 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.288538 2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-ui-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:29:28.288560 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.288551 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e0ded9ef-1853-40c0-93d4-0cd81078e920-registry-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:29:28.293143 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.293123 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq"] Sep 07 13:29:28.295881 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.295855 2579 scope.go:117] "RemoveContainer" containerID="1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef" Sep 07 13:29:28.298284 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.298264 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-mvzkq"] Sep 07 13:29:28.303572 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.303558 2579 scope.go:117] "RemoveContainer" containerID="28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27" Sep 07 13:29:28.310133 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.310117 2579 scope.go:117] "RemoveContainer" containerID="d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330" Sep 07 13:29:28.316600 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.316584 2579 scope.go:117] "RemoveContainer" containerID="2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f" Sep 07 13:29:28.316912 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:29:28.316887 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f\": container with ID starting with 2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f not found: ID does not exist" containerID="2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f" Sep 07 13:29:28.316980 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.316911 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f"} err="failed to get container status \"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f\": rpc error: code = NotFound desc = could not find container \"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f\": container with ID starting with 2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f not found: ID does not exist" Sep 07 13:29:28.316980 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.316938 2579 scope.go:117] "RemoveContainer" containerID="5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356" Sep 07 13:29:28.317169 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:29:28.317151 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356\": container with ID starting with 5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356 not found: ID does not exist" containerID="5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356" Sep 07 13:29:28.317235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.317178 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356"} err="failed to get container status \"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356\": rpc error: code = NotFound desc = could not find container \"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356\": container with ID starting with 5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356 not found: ID does not exist" Sep 07 13:29:28.317235 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.317200 2579 scope.go:117] "RemoveContainer" containerID="a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411" Sep 07 13:29:28.317432 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:29:28.317418 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411\": container with ID starting with a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411 not found: ID does not exist" containerID="a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411" Sep 07 13:29:28.317497 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.317437 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411"} err="failed to get container status \"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411\": rpc error: code = NotFound desc = could not find container \"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411\": container with ID starting with a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411 not found: ID does not exist" Sep 07 13:29:28.317497 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.317455 2579 scope.go:117] "RemoveContainer" containerID="1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef" Sep 07 13:29:28.317742 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:29:28.317717 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef\": container with ID starting with 1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef not found: ID does not exist" containerID="1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef" Sep 07 13:29:28.317818 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.317747 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef"} err="failed to get container status \"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef\": rpc error: code = NotFound desc = could not find container \"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef\": container with ID starting with 1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef not found: ID does not exist" Sep 07 13:29:28.317818 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.317769 2579 scope.go:117] "RemoveContainer" containerID="28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27" Sep 07 13:29:28.318022 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:29:28.318008 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27\": container with ID starting with 28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27 not found: ID does not exist" containerID="28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27" Sep 07 13:29:28.318071 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318025 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27"} err="failed to get container status \"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27\": rpc error: code = NotFound desc = could not find container \"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27\": container with ID starting with 28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27 not found: ID does not exist" Sep 07 13:29:28.318071 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318041 2579 scope.go:117] "RemoveContainer" containerID="d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330" Sep 07 13:29:28.318275 ip-10-0-137-227 kubenswrapper[2579]: E0907 13:29:28.318260 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330\": container with ID starting with d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330 not found: ID does not exist" containerID="d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330" Sep 07 13:29:28.318313 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318280 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330"} err="failed to get container status \"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330\": rpc error: code = NotFound desc = could not find container \"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330\": container with ID starting with d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330 not found: ID does not exist" Sep 07 13:29:28.318313 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318292 2579 scope.go:117] "RemoveContainer" containerID="2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f" Sep 07 13:29:28.318490 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318473 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f"} err="failed to get container status \"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f\": rpc error: code = NotFound desc = could not find container \"2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f\": container with ID starting with 2978614555b8923be51f0b4131d637116ea600024a340c12ded004c0cbdcb35f not found: ID does not exist" Sep 07 13:29:28.318539 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318492 2579 scope.go:117] "RemoveContainer" containerID="5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356" Sep 07 13:29:28.318728 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318711 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356"} err="failed to get container status \"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356\": rpc error: code = NotFound desc = could not find container \"5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356\": container with ID starting with 5fa3d711d5b523b6ce5be35bbbe9d54a0dbeda9d284cc08fbfdc9ac901519356 not found: ID does not exist" Sep 07 13:29:28.318776 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318728 2579 scope.go:117] "RemoveContainer" containerID="a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411" Sep 07 13:29:28.318928 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318911 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411"} err="failed to get container status \"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411\": rpc error: code = NotFound desc = could not find container \"a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411\": container with ID starting with a884e6771429e3c5b2679f31d6111c82f1abd569258fe2a0c2adb8dc88732411 not found: ID does not exist" Sep 07 13:29:28.318972 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.318929 2579 scope.go:117] "RemoveContainer" containerID="1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef" Sep 07 13:29:28.319147 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.319131 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef"} err="failed to get container status \"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef\": rpc error: code = NotFound desc = could not find container \"1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef\": container with ID starting with 1fb14fd611567ad96b241821f0584c93cc064afe204939f43a87c30fe72accef not found: ID does not exist" Sep 07 13:29:28.319190 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.319147 2579 scope.go:117] "RemoveContainer" containerID="28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27" Sep 07 13:29:28.319398 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.319380 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27"} err="failed to get container status \"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27\": rpc error: code = NotFound desc = could not find container \"28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27\": container with ID starting with 28b08cca904c4d8af01d432c318dc9fcd1188b0c19810f514058f2dd3b450e27 not found: ID does not exist" Sep 07 13:29:28.319455 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.319400 2579 scope.go:117] "RemoveContainer" containerID="d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330" Sep 07 13:29:28.319622 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:28.319607 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330"} err="failed to get container status \"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330\": rpc error: code = NotFound desc = could not find container \"d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330\": container with ID starting with d2344cd3e7c2996e95cc160e24f31b34757235d5cb2961b21a1c7c5001865330 not found: ID does not exist" Sep 07 13:29:29.697118 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:29:29.697085 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" path="/var/lib/kubelet/pods/e0ded9ef-1853-40c0-93d4-0cd81078e920/volumes" Sep 07 13:30:22.532393 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532364 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm"] Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532610 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="feast-init" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532620 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="feast-init" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532629 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532634 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532644 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="offline" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532649 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="offline" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532661 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="feast-apply" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532666 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="feast-apply" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532688 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532695 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532710 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="registry" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532718 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="registry" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532784 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="offline" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532792 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="registry" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532798 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="online" Sep 07 13:30:22.532866 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.532803 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0ded9ef-1853-40c0-93d4-0cd81078e920" containerName="ui" Sep 07 13:30:22.535769 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.535754 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.538776 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.538751 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 07 13:30:22.538881 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.538805 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 07 13:30:22.539579 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.539555 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 07 13:30:22.539579 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.539567 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-99cxn\"" Sep 07 13:30:22.539730 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.539627 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 07 13:30:22.540034 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.540018 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 07 13:30:22.540111 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.540091 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 07 13:30:22.550820 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.550798 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm"] Sep 07 13:30:22.662992 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.662968 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.663089 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.662999 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ee24220f-94e1-4729-be27-55bef34a420d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.663089 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.663024 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/ee24220f-94e1-4729-be27-55bef34a420d-kube-api-access-597bz\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.663089 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.663082 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ee24220f-94e1-4729-be27-55bef34a420d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.663223 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.663110 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.663223 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.663129 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.763609 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.763588 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ee24220f-94e1-4729-be27-55bef34a420d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.763748 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.763656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.763821 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.763797 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.764109 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.764045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.764225 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.764139 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ee24220f-94e1-4729-be27-55bef34a420d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.764291 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.764221 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ee24220f-94e1-4729-be27-55bef34a420d-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.764291 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.764275 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/ee24220f-94e1-4729-be27-55bef34a420d-kube-api-access-597bz\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.766562 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.765390 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ee24220f-94e1-4729-be27-55bef34a420d-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.767262 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.767235 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.771184 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.771151 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.773135 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.773116 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.775376 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.775354 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/ee24220f-94e1-4729-be27-55bef34a420d-kube-api-access-597bz\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-ddtmm\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:22.845411 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:22.845354 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:23.123655 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:23.123620 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm"] Sep 07 13:30:23.125381 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:30:23.125356 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee24220f_94e1_4729_be27_55bef34a420d.slice/crio-decedb0a20b94965296c3043143b845d1481c8883ff52a3eae986d4f6a9f6bd3 WatchSource:0}: Error finding container decedb0a20b94965296c3043143b845d1481c8883ff52a3eae986d4f6a9f6bd3: Status 404 returned error can't find the container with id decedb0a20b94965296c3043143b845d1481c8883ff52a3eae986d4f6a9f6bd3 Sep 07 13:30:23.487195 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:23.487097 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerStarted","Data":"1d92787f2a9d6fe937c6a2511be0fb69d13036809d280a70de86331c22a64442"} Sep 07 13:30:23.487195 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:23.487156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerStarted","Data":"decedb0a20b94965296c3043143b845d1481c8883ff52a3eae986d4f6a9f6bd3"} Sep 07 13:30:28.507266 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:28.507232 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee24220f-94e1-4729-be27-55bef34a420d" containerID="1d92787f2a9d6fe937c6a2511be0fb69d13036809d280a70de86331c22a64442" exitCode=0 Sep 07 13:30:28.507611 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:28.507310 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerDied","Data":"1d92787f2a9d6fe937c6a2511be0fb69d13036809d280a70de86331c22a64442"} Sep 07 13:30:29.512800 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:29.512766 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerStarted","Data":"670bf47b7c569437ce4e7f442449daee450765db967d2076d21054aafc4b87db"} Sep 07 13:30:51.598832 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:51.598797 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee24220f-94e1-4729-be27-55bef34a420d" containerID="670bf47b7c569437ce4e7f442449daee450765db967d2076d21054aafc4b87db" exitCode=0 Sep 07 13:30:51.599182 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:51.598864 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerDied","Data":"670bf47b7c569437ce4e7f442449daee450765db967d2076d21054aafc4b87db"} Sep 07 13:30:51.778034 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:51.778009 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:30:51.781646 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:51.781624 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:30:52.607141 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.607101 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerStarted","Data":"1fc009ab9fd8b77559c909b5c0367249680b93a84f615138b109b5cd6b610e66"} Sep 07 13:30:52.607644 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.607156 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerStarted","Data":"83da997d80858c48179431c970870f2b7e216eea90e44f7dc7920da6f6604601"} Sep 07 13:30:52.607644 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.607171 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerStarted","Data":"40018eb053f08c136effee52e782750540a32447a3164ab5e94efa839f2f7e9e"} Sep 07 13:30:52.632250 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.632192 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podStartSLOduration=30.632171323 podStartE2EDuration="30.632171323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:30:52.629967707 +0000 UTC m=+1801.418272505" watchObservedRunningTime="2026-09-07 13:30:52.632171323 +0000 UTC m=+1801.420476121" Sep 07 13:30:52.846573 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.846405 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:52.846573 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.846475 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:52.846573 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.846496 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:52.846573 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.846514 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:52.846573 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.846530 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:52.846573 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.846546 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:30:52.848372 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.848330 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Sep 07 13:30:52.848372 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.848364 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 07 13:30:52.848571 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:52.848327 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 07 13:30:55.846427 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:55.846378 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Sep 07 13:30:55.847012 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:55.846386 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 07 13:30:55.847012 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:55.846378 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 07 13:30:58.846296 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:58.846256 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 07 13:30:58.846671 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:58.846260 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.27:8816: connect: connection refused" Sep 07 13:30:58.846671 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:30:58.846266 2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 07 13:31:01.847339 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:01.847305 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:31:01.847745 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:01.847459 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:31:01.848225 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:01.848198 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:31:01.848433 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:01.848412 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:31:02.643372 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:02.643338 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:31:03.348398 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:03.348367 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:31:03.849819 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:03.849780 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 07 13:31:23.849858 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:23.849813 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Sep 07 13:31:43.850797 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:31:43.850761 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 07 13:32:03.655811 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:03.655775 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 07 13:32:03.846603 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:03.846565 2579 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Sep 07 13:32:04.653602 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.653567 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm"] Sep 07 13:32:04.653999 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.653942 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" containerID="cri-o://1fc009ab9fd8b77559c909b5c0367249680b93a84f615138b109b5cd6b610e66" gracePeriod=30 Sep 07 13:32:04.653999 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.653952 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="offline" containerID="cri-o://83da997d80858c48179431c970870f2b7e216eea90e44f7dc7920da6f6604601" gracePeriod=30 Sep 07 13:32:04.654197 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.653923 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" containerID="cri-o://40018eb053f08c136effee52e782750540a32447a3164ab5e94efa839f2f7e9e" gracePeriod=30 Sep 07 13:32:04.791553 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.791521 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx"] Sep 07 13:32:04.792014 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.791787 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="registry" containerID="cri-o://a928074fcb7e5b956b856c020f6be2bba9efd5fa4d828686e6aefba7af1f5371" gracePeriod=30 Sep 07 13:32:04.792014 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.791880 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="offline" containerID="cri-o://927b545e5222789d4f77f547e24ae04f1a9a4489960ebdbd72d3f40b486bb02e" gracePeriod=30 Sep 07 13:32:04.792014 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.791948 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" containerID="cri-o://b6f493c3f64561e3e4c92c1f6e4c331b25ce9e8e21234c62246e9104d1431db6" gracePeriod=30 Sep 07 13:32:04.792014 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:04.791945 2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" containerID="cri-o://422d747a21d21748c175993c1417a8c7bfda5bc6bcae58ce73c4748834cb166a" gracePeriod=30 Sep 07 13:32:05.902816 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:05.902780 2579 generic.go:356] "Generic (PLEG): container finished" podID="c2013020-7707-46c9-b162-471d38ab8d55" containerID="422d747a21d21748c175993c1417a8c7bfda5bc6bcae58ce73c4748834cb166a" exitCode=0 Sep 07 13:32:05.902816 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:05.902809 2579 generic.go:356] "Generic (PLEG): container finished" podID="c2013020-7707-46c9-b162-471d38ab8d55" containerID="b6f493c3f64561e3e4c92c1f6e4c331b25ce9e8e21234c62246e9104d1431db6" exitCode=0 Sep 07 13:32:05.903249 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:05.902862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerDied","Data":"422d747a21d21748c175993c1417a8c7bfda5bc6bcae58ce73c4748834cb166a"} Sep 07 13:32:05.903249 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:05.902923 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerDied","Data":"b6f493c3f64561e3e4c92c1f6e4c331b25ce9e8e21234c62246e9104d1431db6"} Sep 07 13:32:05.905990 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:05.905967 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee24220f-94e1-4729-be27-55bef34a420d" containerID="1fc009ab9fd8b77559c909b5c0367249680b93a84f615138b109b5cd6b610e66" exitCode=0 Sep 07 13:32:05.905990 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:05.905991 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee24220f-94e1-4729-be27-55bef34a420d" containerID="40018eb053f08c136effee52e782750540a32447a3164ab5e94efa839f2f7e9e" exitCode=0 Sep 07 13:32:05.906139 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:05.906037 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerDied","Data":"1fc009ab9fd8b77559c909b5c0367249680b93a84f615138b109b5cd6b610e66"} Sep 07 13:32:05.906139 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:05.906075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerDied","Data":"40018eb053f08c136effee52e782750540a32447a3164ab5e94efa839f2f7e9e"} Sep 07 13:32:09.737396 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:09.737353 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 07 13:32:10.238288 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:10.238248 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 07 13:32:11.848656 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:11.848616 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 07 13:32:12.650997 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:12.650950 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 07 13:32:19.736974 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:19.736930 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 07 13:32:20.238070 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:20.238024 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 07 13:32:21.848804 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:21.848745 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 07 13:32:22.650589 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:22.650542 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 07 13:32:22.650813 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:22.650732 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:32:29.737359 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:29.737304 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.26:8443: connect: connection refused" Sep 07 13:32:29.737857 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:29.737466 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:32:30.238282 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:30.238236 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused" Sep 07 13:32:30.238468 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:30.238398 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:32:31.848166 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:31.848109 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.27:8443: connect: connection refused" Sep 07 13:32:31.848622 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:31.848273 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:32:32.650872 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:32.650826 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.27:6567/health\": dial tcp 10.133.0.27:6567: connect: connection refused" Sep 07 13:32:35.019758 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.019731 2579 generic.go:356] "Generic (PLEG): container finished" podID="c2013020-7707-46c9-b162-471d38ab8d55" containerID="927b545e5222789d4f77f547e24ae04f1a9a4489960ebdbd72d3f40b486bb02e" exitCode=137 Sep 07 13:32:35.019758 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.019755 2579 generic.go:356] "Generic (PLEG): container finished" podID="c2013020-7707-46c9-b162-471d38ab8d55" containerID="a928074fcb7e5b956b856c020f6be2bba9efd5fa4d828686e6aefba7af1f5371" exitCode=137 Sep 07 13:32:35.020149 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.019804 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerDied","Data":"927b545e5222789d4f77f547e24ae04f1a9a4489960ebdbd72d3f40b486bb02e"} Sep 07 13:32:35.020149 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.019846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerDied","Data":"a928074fcb7e5b956b856c020f6be2bba9efd5fa4d828686e6aefba7af1f5371"} Sep 07 13:32:35.022472 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.022452 2579 generic.go:356] "Generic (PLEG): container finished" podID="ee24220f-94e1-4729-be27-55bef34a420d" containerID="83da997d80858c48179431c970870f2b7e216eea90e44f7dc7920da6f6604601" exitCode=137 Sep 07 13:32:35.022547 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.022493 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerDied","Data":"83da997d80858c48179431c970870f2b7e216eea90e44f7dc7920da6f6604601"} Sep 07 13:32:35.298465 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.298442 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:32:35.392042 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.392013 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ee24220f-94e1-4729-be27-55bef34a420d-feast-data\") pod \"ee24220f-94e1-4729-be27-55bef34a420d\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " Sep 07 13:32:35.392189 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.392075 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-offline-tls\") pod \"ee24220f-94e1-4729-be27-55bef34a420d\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " Sep 07 13:32:35.392189 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.392107 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-online-tls\") pod \"ee24220f-94e1-4729-be27-55bef34a420d\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " Sep 07 13:32:35.392189 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.392132 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ee24220f-94e1-4729-be27-55bef34a420d-registry-tls\") pod \"ee24220f-94e1-4729-be27-55bef34a420d\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " Sep 07 13:32:35.392189 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.392158 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-ui-tls\") pod \"ee24220f-94e1-4729-be27-55bef34a420d\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " Sep 07 13:32:35.392408 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.392189 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/ee24220f-94e1-4729-be27-55bef34a420d-kube-api-access-597bz\") pod \"ee24220f-94e1-4729-be27-55bef34a420d\" (UID: \"ee24220f-94e1-4729-be27-55bef34a420d\") " Sep 07 13:32:35.392524 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.392499 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee24220f-94e1-4729-be27-55bef34a420d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ee24220f-94e1-4729-be27-55bef34a420d" (UID: "ee24220f-94e1-4729-be27-55bef34a420d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 07 13:32:35.392612 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.392587 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee24220f-94e1-4729-be27-55bef34a420d-feast-data" (OuterVolumeSpecName: "feast-data") pod "ee24220f-94e1-4729-be27-55bef34a420d" (UID: "ee24220f-94e1-4729-be27-55bef34a420d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:32:35.396371 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.396348 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ee24220f-94e1-4729-be27-55bef34a420d" (UID: "ee24220f-94e1-4729-be27-55bef34a420d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:32:35.396485 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.396465 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee24220f-94e1-4729-be27-55bef34a420d-kube-api-access-597bz" (OuterVolumeSpecName: "kube-api-access-597bz") pod "ee24220f-94e1-4729-be27-55bef34a420d" (UID: "ee24220f-94e1-4729-be27-55bef34a420d"). InnerVolumeSpecName "kube-api-access-597bz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:32:35.396546 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.396480 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-online-tls" (OuterVolumeSpecName: "online-tls") pod "ee24220f-94e1-4729-be27-55bef34a420d" (UID: "ee24220f-94e1-4729-be27-55bef34a420d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:32:35.396546 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.396498 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ee24220f-94e1-4729-be27-55bef34a420d" (UID: "ee24220f-94e1-4729-be27-55bef34a420d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:32:35.423136 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.423113 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:32:35.492633 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.492611 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2013020-7707-46c9-b162-471d38ab8d55-feast-data\") pod \"c2013020-7707-46c9-b162-471d38ab8d55\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " Sep 07 13:32:35.492765 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.492639 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-ui-tls\") pod \"c2013020-7707-46c9-b162-471d38ab8d55\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " Sep 07 13:32:35.492765 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.492686 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrdl2\" (UniqueName: \"kubernetes.io/projected/c2013020-7707-46c9-b162-471d38ab8d55-kube-api-access-qrdl2\") pod \"c2013020-7707-46c9-b162-471d38ab8d55\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " Sep 07 13:32:35.492885 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.492797 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-offline-tls\") pod \"c2013020-7707-46c9-b162-471d38ab8d55\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " Sep 07 13:32:35.492885 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.492846 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-registry-tls\") pod \"c2013020-7707-46c9-b162-471d38ab8d55\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " Sep 07 13:32:35.492885 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.492878 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls\") pod \"c2013020-7707-46c9-b162-471d38ab8d55\" (UID: \"c2013020-7707-46c9-b162-471d38ab8d55\") " Sep 07 13:32:35.493160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.493071 2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-offline-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.493160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.493092 2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-online-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.493160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.493104 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/ee24220f-94e1-4729-be27-55bef34a420d-registry-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.493160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.493116 2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ee24220f-94e1-4729-be27-55bef34a420d-ui-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.493160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.493128 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-597bz\" (UniqueName: \"kubernetes.io/projected/ee24220f-94e1-4729-be27-55bef34a420d-kube-api-access-597bz\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.493160 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.493139 2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ee24220f-94e1-4729-be27-55bef34a420d-feast-data\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.495445 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.493159 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2013020-7707-46c9-b162-471d38ab8d55-feast-data" (OuterVolumeSpecName: "feast-data") pod "c2013020-7707-46c9-b162-471d38ab8d55" (UID: "c2013020-7707-46c9-b162-471d38ab8d55"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 07 13:32:35.496804 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.496770 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c2013020-7707-46c9-b162-471d38ab8d55" (UID: "c2013020-7707-46c9-b162-471d38ab8d55"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:32:35.499836 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.499812 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c2013020-7707-46c9-b162-471d38ab8d55" (UID: "c2013020-7707-46c9-b162-471d38ab8d55"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:32:35.499925 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.499833 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls" (OuterVolumeSpecName: "online-tls") pod "c2013020-7707-46c9-b162-471d38ab8d55" (UID: "c2013020-7707-46c9-b162-471d38ab8d55"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:32:35.499925 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.499849 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c2013020-7707-46c9-b162-471d38ab8d55" (UID: "c2013020-7707-46c9-b162-471d38ab8d55"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 07 13:32:35.499925 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.499866 2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2013020-7707-46c9-b162-471d38ab8d55-kube-api-access-qrdl2" (OuterVolumeSpecName: "kube-api-access-qrdl2") pod "c2013020-7707-46c9-b162-471d38ab8d55" (UID: "c2013020-7707-46c9-b162-471d38ab8d55"). InnerVolumeSpecName "kube-api-access-qrdl2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 07 13:32:35.593453 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.593406 2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2013020-7707-46c9-b162-471d38ab8d55-feast-data\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.593453 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.593426 2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-ui-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.593453 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.593454 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrdl2\" (UniqueName: \"kubernetes.io/projected/c2013020-7707-46c9-b162-471d38ab8d55-kube-api-access-qrdl2\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.593590 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.593463 2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-offline-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.593590 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.593472 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-registry-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:35.593590 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:35.593479 2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2013020-7707-46c9-b162-471d38ab8d55-online-tls\") on node \"ip-10-0-137-227.ec2.internal\" DevicePath \"\"" Sep 07 13:32:36.029573 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.029540 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" event={"ID":"c2013020-7707-46c9-b162-471d38ab8d55","Type":"ContainerDied","Data":"a74c8f63daba80e5b9553a6379a1f80f6ea065dfa115556ced852780e655ba6c"} Sep 07 13:32:36.029573 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.029569 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx" Sep 07 13:32:36.030026 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.029608 2579 scope.go:117] "RemoveContainer" containerID="422d747a21d21748c175993c1417a8c7bfda5bc6bcae58ce73c4748834cb166a" Sep 07 13:32:36.033453 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.033426 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" event={"ID":"ee24220f-94e1-4729-be27-55bef34a420d","Type":"ContainerDied","Data":"decedb0a20b94965296c3043143b845d1481c8883ff52a3eae986d4f6a9f6bd3"} Sep 07 13:32:36.033556 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.033466 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm" Sep 07 13:32:36.040153 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.040111 2579 scope.go:117] "RemoveContainer" containerID="927b545e5222789d4f77f547e24ae04f1a9a4489960ebdbd72d3f40b486bb02e" Sep 07 13:32:36.048347 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.048223 2579 scope.go:117] "RemoveContainer" containerID="b6f493c3f64561e3e4c92c1f6e4c331b25ce9e8e21234c62246e9104d1431db6" Sep 07 13:32:36.049599 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.049507 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx"] Sep 07 13:32:36.055081 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.055056 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-cqhnx"] Sep 07 13:32:36.056982 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.056959 2579 scope.go:117] "RemoveContainer" containerID="a928074fcb7e5b956b856c020f6be2bba9efd5fa4d828686e6aefba7af1f5371" Sep 07 13:32:36.064646 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.064626 2579 scope.go:117] "RemoveContainer" containerID="3660c3c71a6d19fc54a81db83bba3082a7ea3ec6170b43b175b5e01081642a8a" Sep 07 13:32:36.071603 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.071579 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm"] Sep 07 13:32:36.072315 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.072298 2579 scope.go:117] "RemoveContainer" containerID="1c8e5c735c2953649bd6cbe1714a0bec31b721e41a52fe95d7a0fb2eacefb234" Sep 07 13:32:36.075153 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.075132 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-ddtmm"] Sep 07 13:32:36.079950 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.079933 2579 scope.go:117] "RemoveContainer" containerID="1fc009ab9fd8b77559c909b5c0367249680b93a84f615138b109b5cd6b610e66" Sep 07 13:32:36.086820 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.086806 2579 scope.go:117] "RemoveContainer" containerID="83da997d80858c48179431c970870f2b7e216eea90e44f7dc7920da6f6604601" Sep 07 13:32:36.094003 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.093989 2579 scope.go:117] "RemoveContainer" containerID="40018eb053f08c136effee52e782750540a32447a3164ab5e94efa839f2f7e9e" Sep 07 13:32:36.101201 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.101185 2579 scope.go:117] "RemoveContainer" containerID="670bf47b7c569437ce4e7f442449daee450765db967d2076d21054aafc4b87db" Sep 07 13:32:36.107930 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:36.107912 2579 scope.go:117] "RemoveContainer" containerID="1d92787f2a9d6fe937c6a2511be0fb69d13036809d280a70de86331c22a64442" Sep 07 13:32:37.696648 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:37.696609 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2013020-7707-46c9-b162-471d38ab8d55" path="/var/lib/kubelet/pods/c2013020-7707-46c9-b162-471d38ab8d55/volumes" Sep 07 13:32:37.697272 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:32:37.697253 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee24220f-94e1-4729-be27-55bef34a420d" path="/var/lib/kubelet/pods/ee24220f-94e1-4729-be27-55bef34a420d/volumes" Sep 07 13:33:03.312082 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312046 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fd6hd/must-gather-jz94d"] Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312314 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312326 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312338 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="offline" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312343 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="offline" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312350 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="feast-apply" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312356 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="feast-apply" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312364 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312370 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312380 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="feast-apply" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312385 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="feast-apply" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312391 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312396 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312401 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312406 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312413 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="registry" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312418 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="registry" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312427 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="offline" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312431 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="offline" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312438 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="feast-init" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312443 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="feast-init" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312448 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="feast-init" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312453 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="feast-init" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312500 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="online" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312508 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="offline" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312514 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="ui" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312520 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="offline" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312527 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="online" Sep 07 13:33:03.312517 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312534 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee24220f-94e1-4729-be27-55bef34a420d" containerName="ui" Sep 07 13:33:03.313715 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.312541 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2013020-7707-46c9-b162-471d38ab8d55" containerName="registry" Sep 07 13:33:03.315407 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.315389 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fd6hd/must-gather-jz94d" Sep 07 13:33:03.318292 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.318267 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fd6hd\"/\"default-dockercfg-rpvlg\"" Sep 07 13:33:03.318292 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.318282 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fd6hd\"/\"openshift-service-ca.crt\"" Sep 07 13:33:03.319489 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.319472 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fd6hd\"/\"kube-root-ca.crt\"" Sep 07 13:33:03.323405 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.323378 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fd6hd/must-gather-jz94d"] Sep 07 13:33:03.475223 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.475193 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8975\" (UniqueName: \"kubernetes.io/projected/e0298181-62cc-42ee-a8e0-edf31364c951-kube-api-access-t8975\") pod \"must-gather-jz94d\" (UID: \"e0298181-62cc-42ee-a8e0-edf31364c951\") " pod="openshift-must-gather-fd6hd/must-gather-jz94d" Sep 07 13:33:03.475342 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.475245 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e0298181-62cc-42ee-a8e0-edf31364c951-must-gather-output\") pod \"must-gather-jz94d\" (UID: \"e0298181-62cc-42ee-a8e0-edf31364c951\") " pod="openshift-must-gather-fd6hd/must-gather-jz94d" Sep 07 13:33:03.575854 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.575792 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8975\" (UniqueName: \"kubernetes.io/projected/e0298181-62cc-42ee-a8e0-edf31364c951-kube-api-access-t8975\") pod \"must-gather-jz94d\" (UID: \"e0298181-62cc-42ee-a8e0-edf31364c951\") " pod="openshift-must-gather-fd6hd/must-gather-jz94d" Sep 07 13:33:03.575854 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.575847 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e0298181-62cc-42ee-a8e0-edf31364c951-must-gather-output\") pod \"must-gather-jz94d\" (UID: \"e0298181-62cc-42ee-a8e0-edf31364c951\") " pod="openshift-must-gather-fd6hd/must-gather-jz94d" Sep 07 13:33:03.576121 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.576105 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e0298181-62cc-42ee-a8e0-edf31364c951-must-gather-output\") pod \"must-gather-jz94d\" (UID: \"e0298181-62cc-42ee-a8e0-edf31364c951\") " pod="openshift-must-gather-fd6hd/must-gather-jz94d" Sep 07 13:33:03.586199 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.586172 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8975\" (UniqueName: \"kubernetes.io/projected/e0298181-62cc-42ee-a8e0-edf31364c951-kube-api-access-t8975\") pod \"must-gather-jz94d\" (UID: \"e0298181-62cc-42ee-a8e0-edf31364c951\") " pod="openshift-must-gather-fd6hd/must-gather-jz94d" Sep 07 13:33:03.625321 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.625297 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fd6hd/must-gather-jz94d" Sep 07 13:33:03.897872 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.897797 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fd6hd/must-gather-jz94d"] Sep 07 13:33:03.901357 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:33:03.901333 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0298181_62cc_42ee_a8e0_edf31364c951.slice/crio-1343f75008fe759abee0a15f3e560b7a5e887cf3aabebefe9cdab076d4c336a9 WatchSource:0}: Error finding container 1343f75008fe759abee0a15f3e560b7a5e887cf3aabebefe9cdab076d4c336a9: Status 404 returned error can't find the container with id 1343f75008fe759abee0a15f3e560b7a5e887cf3aabebefe9cdab076d4c336a9 Sep 07 13:33:03.903332 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:03.903313 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 07 13:33:04.145329 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:04.145301 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd6hd/must-gather-jz94d" event={"ID":"e0298181-62cc-42ee-a8e0-edf31364c951","Type":"ContainerStarted","Data":"1343f75008fe759abee0a15f3e560b7a5e887cf3aabebefe9cdab076d4c336a9"} Sep 07 13:33:05.152508 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:05.152468 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd6hd/must-gather-jz94d" event={"ID":"e0298181-62cc-42ee-a8e0-edf31364c951","Type":"ContainerStarted","Data":"3ee607aa2bca1624539d4e9848307938b8da9e3502771d0e29d150555f451182"} Sep 07 13:33:05.152508 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:05.152512 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd6hd/must-gather-jz94d" event={"ID":"e0298181-62cc-42ee-a8e0-edf31364c951","Type":"ContainerStarted","Data":"dc935d66a32ab1e5060c1fd9d4f8647f605bddcd552c1b8d90cbc37d1bb1f28f"} Sep 07 13:33:05.172589 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:05.172546 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fd6hd/must-gather-jz94d" podStartSLOduration=1.3717193540000001 podStartE2EDuration="2.172532208s" totalImagesPullingTime="800.812854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:33:05.171331625 +0000 UTC m=+1933.959636425" watchObservedRunningTime="2026-09-07 13:33:05.172532208 +0000 UTC m=+1933.960837004" Sep 07 13:33:06.155030 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:06.154982 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vbrfx_44675e1d-941e-4e2c-ba99-2efdbda04edf/global-pull-secret-syncer/0.log" Sep 07 13:33:06.238809 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:06.238773 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pbfpr_273c431c-d571-433b-b52d-ffa9a825c2be/konnectivity-agent/0.log" Sep 07 13:33:06.291653 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:06.291629 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-227.ec2.internal_da5e3a4c5eae8de2d6c17446168336e8/haproxy/0.log" Sep 07 13:33:10.538074 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:10.538042 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54447957f8-q4fxv_91763165-6363-411b-9840-044fadc6a3ce/metrics-server/0.log" Sep 07 13:33:10.597533 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:10.597507 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2w766_e8184954-02cd-4324-87fe-8ad0de5dd77d/node-exporter/0.log" Sep 07 13:33:10.621792 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:10.621765 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2w766_e8184954-02cd-4324-87fe-8ad0de5dd77d/kube-rbac-proxy/0.log" Sep 07 13:33:10.648111 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:10.648083 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2w766_e8184954-02cd-4324-87fe-8ad0de5dd77d/init-textfile/0.log" Sep 07 13:33:12.875637 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:12.875604 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl"] Sep 07 13:33:12.881551 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:12.881528 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:12.889258 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:12.889232 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl"] Sep 07 13:33:13.025417 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.025385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/2.log" Sep 07 13:33:13.030141 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.030115 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-d7kvx_750136a1-c5a0-4d33-a83d-c0d3d3eeed5f/console-operator/3.log" Sep 07 13:33:13.051502 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.051466 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-sys\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.051656 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.051518 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-podres\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.051656 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.051584 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-lib-modules\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.051656 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.051617 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-proc\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.051656 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.051649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4xp4\" (UniqueName: \"kubernetes.io/projected/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-kube-api-access-l4xp4\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152274 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152181 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-sys\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152274 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-podres\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152481 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152304 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-sys\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152481 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152342 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-lib-modules\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152481 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-proc\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152481 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152408 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-podres\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152481 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152416 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4xp4\" (UniqueName: \"kubernetes.io/projected/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-kube-api-access-l4xp4\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152742 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152478 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-lib-modules\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.152742 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.152476 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-proc\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.162649 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.162617 2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4xp4\" (UniqueName: \"kubernetes.io/projected/f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5-kube-api-access-l4xp4\") pod \"perf-node-gather-daemonset-z4nnl\" (UID: \"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5\") " pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.194724 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.194701 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:13.474055 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:13.473894 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl"] Sep 07 13:33:13.478943 ip-10-0-137-227 kubenswrapper[2579]: W0907 13:33:13.478909 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf88ebb1b_f0f6_4f6d_b0bc_9962d6aebcd5.slice/crio-e54f6f39f44b27ea59fe5fd0a35f6139a44a2184745f86cc4c246b7332edabd4 WatchSource:0}: Error finding container e54f6f39f44b27ea59fe5fd0a35f6139a44a2184745f86cc4c246b7332edabd4: Status 404 returned error can't find the container with id e54f6f39f44b27ea59fe5fd0a35f6139a44a2184745f86cc4c246b7332edabd4 Sep 07 13:33:14.195259 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:14.195223 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" event={"ID":"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5","Type":"ContainerStarted","Data":"b8a823519721a9d5e773e575a53fbab29c79e2f89df6d5fa650135e9b388513b"} Sep 07 13:33:14.195639 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:14.195273 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" event={"ID":"f88ebb1b-f0f6-4f6d-b0bc-9962d6aebcd5","Type":"ContainerStarted","Data":"e54f6f39f44b27ea59fe5fd0a35f6139a44a2184745f86cc4c246b7332edabd4"} Sep 07 13:33:14.195639 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:14.195302 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:14.219976 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:14.219928 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" podStartSLOduration=2.219913302 podStartE2EDuration="2.219913302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:33:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:33:14.217525795 +0000 UTC m=+1943.005830591" watchObservedRunningTime="2026-09-07 13:33:14.219913302 +0000 UTC m=+1943.008218098" Sep 07 13:33:14.961885 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:14.961851 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sgwbc_3c98e737-285d-4902-8f5f-b97ba1ae3423/dns/0.log" Sep 07 13:33:14.988695 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:14.988641 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sgwbc_3c98e737-285d-4902-8f5f-b97ba1ae3423/kube-rbac-proxy/0.log" Sep 07 13:33:15.020487 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:15.020460 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-644ph_07a8a0b6-0f52-4ace-8bac-404be420bebf/dns-node-resolver/0.log" Sep 07 13:33:15.552497 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:15.552464 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nzgwf_8909dd03-0c85-40a4-9252-29a07ab443b7/node-ca/0.log" Sep 07 13:33:16.670000 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:16.669973 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-82k98_8c45569e-b83b-4828-b86a-eb20a15e5646/serve-healthcheck-canary/0.log" Sep 07 13:33:17.073404 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:17.073379 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-29kxx_ce23da70-f89a-4b06-9b18-472f812bc78f/insights-operator/0.log" Sep 07 13:33:17.073593 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:17.073489 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-29kxx_ce23da70-f89a-4b06-9b18-472f812bc78f/insights-operator/1.log" Sep 07 13:33:17.093969 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:17.093949 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-877rr_341eb6c7-3c7b-4e3e-845e-d118ff21cb4a/kube-rbac-proxy/0.log" Sep 07 13:33:17.120990 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:17.120974 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-877rr_341eb6c7-3c7b-4e3e-845e-d118ff21cb4a/exporter/0.log" Sep 07 13:33:17.145817 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:17.145769 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-877rr_341eb6c7-3c7b-4e3e-845e-d118ff21cb4a/extractor/0.log" Sep 07 13:33:20.208850 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:20.208819 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fd6hd/perf-node-gather-daemonset-z4nnl" Sep 07 13:33:21.732490 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:21.732401 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-l8p6l_b726bc14-ba52-4c9f-a4e3-2e13164cd6d2/migrator/0.log" Sep 07 13:33:21.754167 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:21.754132 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-l8p6l_b726bc14-ba52-4c9f-a4e3-2e13164cd6d2/graceful-termination/0.log" Sep 07 13:33:23.298508 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.298476 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtg4b_430f9a09-d445-4492-851a-1e9d70d99ff1/kube-multus-additional-cni-plugins/0.log" Sep 07 13:33:23.320787 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.320762 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtg4b_430f9a09-d445-4492-851a-1e9d70d99ff1/egress-router-binary-copy/0.log" Sep 07 13:33:23.343350 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.343304 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtg4b_430f9a09-d445-4492-851a-1e9d70d99ff1/cni-plugins/0.log" Sep 07 13:33:23.367931 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.367908 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtg4b_430f9a09-d445-4492-851a-1e9d70d99ff1/bond-cni-plugin/0.log" Sep 07 13:33:23.392691 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.392660 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtg4b_430f9a09-d445-4492-851a-1e9d70d99ff1/routeoverride-cni/0.log" Sep 07 13:33:23.416272 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.416242 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtg4b_430f9a09-d445-4492-851a-1e9d70d99ff1/whereabouts-cni-bincopy/0.log" Sep 07 13:33:23.438768 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.438670 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qtg4b_430f9a09-d445-4492-851a-1e9d70d99ff1/whereabouts-cni/0.log" Sep 07 13:33:23.665540 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.665517 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-scfft_f5911bf3-8084-4a00-a070-d18f1937f7e3/kube-multus/0.log" Sep 07 13:33:23.784044 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.784022 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j944k_0dc9eb65-272c-4303-8892-bef137df8bd6/network-metrics-daemon/0.log" Sep 07 13:33:23.805223 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:23.805200 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-j944k_0dc9eb65-272c-4303-8892-bef137df8bd6/kube-rbac-proxy/0.log" Sep 07 13:33:24.521896 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:24.521872 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7vrt7_6fca8dfc-2405-49f9-85c4-a978b115ba9f/ovn-controller/0.log" Sep 07 13:33:24.545752 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:24.545720 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7vrt7_6fca8dfc-2405-49f9-85c4-a978b115ba9f/ovn-acl-logging/0.log" Sep 07 13:33:24.568425 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:24.568403 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7vrt7_6fca8dfc-2405-49f9-85c4-a978b115ba9f/kube-rbac-proxy-node/0.log" Sep 07 13:33:24.588644 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:24.588622 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7vrt7_6fca8dfc-2405-49f9-85c4-a978b115ba9f/kube-rbac-proxy-ovn-metrics/0.log" Sep 07 13:33:24.607062 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:24.607042 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7vrt7_6fca8dfc-2405-49f9-85c4-a978b115ba9f/northd/0.log" Sep 07 13:33:24.626072 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:24.626053 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7vrt7_6fca8dfc-2405-49f9-85c4-a978b115ba9f/nbdb/0.log" Sep 07 13:33:24.652406 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:24.652385 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7vrt7_6fca8dfc-2405-49f9-85c4-a978b115ba9f/sbdb/0.log" Sep 07 13:33:24.692898 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:24.692875 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7vrt7_6fca8dfc-2405-49f9-85c4-a978b115ba9f/ovnkube-controller/0.log" Sep 07 13:33:26.213142 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:26.213114 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-pwm62_051c4ecd-6019-489b-84ec-411778c62ad3/check-endpoints/0.log" Sep 07 13:33:26.241015 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:26.240985 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-2tvj7_fcde63d4-f722-4351-962d-65e4002bb83c/network-check-target-container/0.log" Sep 07 13:33:27.242987 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:27.242959 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-j9bjw_8ea1952c-2544-4725-bbcd-37b14d329f00/iptables-alerter/0.log" Sep 07 13:33:27.973801 ip-10-0-137-227 kubenswrapper[2579]: I0907 13:33:27.973776 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-cfp6f_32fd61b2-4c97-4a05-b159-3392cc08620b/tuned/0.log"