Sep 17 11:38:34.303995 ip-10-0-130-219 systemd[1]: Starting Kubernetes Kubelet... Sep 17 11:38:34.719294 ip-10-0-130-219 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 11:38:34.719294 ip-10-0-130-219 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 17 11:38:34.719294 ip-10-0-130-219 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 11:38:34.719294 ip-10-0-130-219 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 17 11:38:34.719294 ip-10-0-130-219 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 17 11:38:34.720242 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.720144 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 17 11:38:34.724037 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724022 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 11:38:34.724037 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724037 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724042 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724067 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724071 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724075 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724077 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724080 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724083 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724086 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 11:38:34.724089 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724089 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724096 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724099 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724101 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724104 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724107 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724109 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724112 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724114 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724119 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724122 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724125 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724128 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724131 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724134 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724137 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724140 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724143 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724146 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724148 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 11:38:34.724304 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724150 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724153 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724155 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724158 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724161 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724163 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724166 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724168 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724171 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724174 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724176 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724179 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724182 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724185 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724189 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724192 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724194 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724197 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724200 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724204 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 11:38:34.724827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724207 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724210 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724213 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724215 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724218 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724220 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724223 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724225 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724228 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724230 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724233 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724235 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724238 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724240 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724243 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724246 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724249 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724252 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724254 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724257 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 11:38:34.725305 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724259 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724263 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724265 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724268 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724270 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724272 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724275 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724278 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724280 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724283 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724285 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724288 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724290 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724292 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724295 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724298 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724301 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724303 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724306 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 11:38:34.725803 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724308 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724312 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724316 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724319 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724321 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724324 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724327 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724330 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724332 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.724335 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725038 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725045 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725048 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725051 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725054 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725056 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725059 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725062 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725065 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725068 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 11:38:34.726286 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725070 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725073 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725076 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725078 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725081 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725083 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725086 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725088 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725091 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725093 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725096 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725098 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725101 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725103 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725108 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725111 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725115 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725118 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725122 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 11:38:34.726776 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725125 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725128 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725131 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725134 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725137 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725140 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725143 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725145 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725148 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725150 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725153 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725156 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725158 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725160 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725163 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725166 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725168 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725171 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725173 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 11:38:34.727290 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725176 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725178 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725182 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725185 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725187 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725190 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725194 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725197 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725200 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725202 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725205 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725207 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725210 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725213 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725216 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725218 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725222 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725225 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725227 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 11:38:34.727759 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725229 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725232 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725234 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725237 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725239 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725242 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725245 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725247 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725250 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725253 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725255 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725258 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725260 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725263 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725265 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725268 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725270 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725273 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725278 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725280 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 11:38:34.728213 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725283 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725285 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725288 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725290 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725293 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725295 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725299 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725301 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725304 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725307 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725309 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725313 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725690 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725696 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725699 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725702 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725705 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725707 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725710 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725729 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 11:38:34.728685 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725732 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725736 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725739 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725742 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725744 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725748 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725751 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725754 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725756 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725759 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725765 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725768 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725770 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725773 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725776 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725778 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725781 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725784 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725787 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725789 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 11:38:34.729176 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725792 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725794 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725797 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725800 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725803 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725805 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725808 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725811 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725814 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725817 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725819 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725822 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725825 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725827 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725831 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725834 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725837 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725839 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725842 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725845 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 11:38:34.729655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725847 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725850 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725854 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725857 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725860 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725862 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725865 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725868 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725870 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725873 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725876 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725879 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725882 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725884 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725887 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725890 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725892 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725895 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725897 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725900 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 11:38:34.730157 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725903 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725905 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725908 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725912 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725915 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725918 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725922 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725927 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725929 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725933 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725935 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725938 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725940 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725943 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725948 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725951 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725954 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725956 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725959 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 11:38:34.730630 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725962 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725965 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725967 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725970 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725973 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725975 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725978 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725982 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725985 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725988 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725991 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.725994 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726066 2556 flags.go:64] FLAG: --address="0.0.0.0" Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726101 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726107 2556 flags.go:64] FLAG: --anonymous-auth="true" Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726111 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726115 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726118 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726122 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726126 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 17 11:38:34.731135 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726129 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726133 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726137 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726141 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726144 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726146 2556 flags.go:64] FLAG: --cgroup-root="" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726149 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726154 2556 flags.go:64] FLAG: --client-ca-file="" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726156 2556 flags.go:64] FLAG: --cloud-provider="external" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726159 2556 flags.go:64] FLAG: --cluster-dns="[]" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726164 2556 flags.go:64] FLAG: --cluster-domain="" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726166 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726169 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726172 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726176 2556 flags.go:64] FLAG: --container-log-max-files="5" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726179 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726182 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726185 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726188 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726191 2556 flags.go:64] FLAG: --contention-profiling="false" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726194 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726197 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726201 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726204 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 17 11:38:34.731606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726208 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726210 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726213 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726216 2556 flags.go:64] FLAG: --enable-load-reader="false" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726219 2556 flags.go:64] FLAG: --enable-server="true" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726222 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726226 2556 flags.go:64] FLAG: --event-burst="100" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726229 2556 flags.go:64] FLAG: --event-qps="50" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726231 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726234 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726239 2556 flags.go:64] FLAG: --eviction-hard="" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726242 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726246 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726248 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726251 2556 flags.go:64] FLAG: --eviction-soft="" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726256 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726258 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726261 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726264 2556 flags.go:64] FLAG: --experimental-mounter-path="" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726267 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726270 2556 flags.go:64] FLAG: --fail-swap-on="true" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726272 2556 flags.go:64] FLAG: --feature-gates="" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726276 2556 flags.go:64] FLAG: --file-check-frequency="20s" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726279 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726282 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 17 11:38:34.732260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726285 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726288 2556 flags.go:64] FLAG: --healthz-port="10248" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726291 2556 flags.go:64] FLAG: --help="false" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726294 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-130-219.ec2.internal" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726297 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726300 2556 flags.go:64] FLAG: --http-check-frequency="20s" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726303 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726306 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726310 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726312 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726315 2556 flags.go:64] FLAG: --image-service-endpoint="" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726318 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726321 2556 flags.go:64] FLAG: --kube-api-burst="100" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726323 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726326 2556 flags.go:64] FLAG: --kube-api-qps="50" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726329 2556 flags.go:64] FLAG: --kube-reserved="" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726332 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726336 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726339 2556 flags.go:64] FLAG: --kubelet-cgroups="" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726351 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726354 2556 flags.go:64] FLAG: --lock-file="" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726357 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726361 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726363 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 17 11:38:34.732920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726368 2556 flags.go:64] FLAG: --log-json-split-stream="false" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726371 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726374 2556 flags.go:64] FLAG: --log-text-split-stream="false" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726376 2556 flags.go:64] FLAG: --logging-format="text" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726379 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726383 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726385 2556 flags.go:64] FLAG: --manifest-url="" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726388 2556 flags.go:64] FLAG: --manifest-url-header="" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726392 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726395 2556 flags.go:64] FLAG: --max-open-files="1000000" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726399 2556 flags.go:64] FLAG: --max-pods="110" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726401 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726404 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726407 2556 flags.go:64] FLAG: --memory-manager-policy="None" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726409 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726412 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726415 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726418 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726424 2556 flags.go:64] FLAG: --node-status-max-images="50" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726427 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726430 2556 flags.go:64] FLAG: --oom-score-adj="-999" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726433 2556 flags.go:64] FLAG: --pod-cidr="" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726436 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 17 11:38:34.733566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726444 2556 flags.go:64] FLAG: --pod-manifest-path="" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726448 2556 flags.go:64] FLAG: --pod-max-pids="-1" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726451 2556 flags.go:64] FLAG: --pods-per-core="0" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726454 2556 flags.go:64] FLAG: --port="10250" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726458 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726460 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-031bf9d9300bc3aca" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726464 2556 flags.go:64] FLAG: --qos-reserved="" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726466 2556 flags.go:64] FLAG: --read-only-port="10255" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726469 2556 flags.go:64] FLAG: --register-node="true" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726472 2556 flags.go:64] FLAG: --register-with-taints="" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726475 2556 flags.go:64] FLAG: --registry-burst="10" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726478 2556 flags.go:64] FLAG: --registry-qps="5" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726481 2556 flags.go:64] FLAG: --reserved-cpus="" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726483 2556 flags.go:64] FLAG: --reserved-memory="" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726487 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726490 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726493 2556 flags.go:64] FLAG: --rotate-certificates="false" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726495 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726498 2556 flags.go:64] FLAG: --runonce="false" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726501 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726504 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726506 2556 flags.go:64] FLAG: --seccomp-default="false" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726509 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726512 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726515 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726518 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 17 11:38:34.734523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726521 2556 flags.go:64] FLAG: --storage-driver-password="root" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726524 2556 flags.go:64] FLAG: --storage-driver-secure="false" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726526 2556 flags.go:64] FLAG: --storage-driver-table="stats" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726529 2556 flags.go:64] FLAG: --storage-driver-user="root" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726532 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726535 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726537 2556 flags.go:64] FLAG: --system-cgroups="" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726540 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726545 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726548 2556 flags.go:64] FLAG: --tls-cert-file="" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726550 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726559 2556 flags.go:64] FLAG: --tls-min-version="" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726561 2556 flags.go:64] FLAG: --tls-private-key-file="" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726564 2556 flags.go:64] FLAG: --topology-manager-policy="none" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726567 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726569 2556 flags.go:64] FLAG: --topology-manager-scope="container" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726572 2556 flags.go:64] FLAG: --v="2" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726576 2556 flags.go:64] FLAG: --version="false" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726579 2556 flags.go:64] FLAG: --vmodule="" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726583 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.726586 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726699 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726703 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726706 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 11:38:34.735273 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726709 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726726 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726731 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726734 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726737 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726740 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726743 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726746 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726748 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726751 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726755 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726758 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726761 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726764 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726766 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726769 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726771 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726774 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 11:38:34.735888 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726776 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726779 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726783 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726785 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726788 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726791 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726794 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726796 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726799 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726801 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726804 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726806 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726809 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726811 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726814 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726816 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726819 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726821 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726824 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 11:38:34.736323 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726826 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726829 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726833 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726835 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726839 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726842 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726845 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726847 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726850 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726852 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726855 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726857 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726860 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726862 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726865 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726867 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726871 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726873 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726876 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726878 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 11:38:34.736884 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726881 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726883 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726886 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726888 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726891 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726893 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726896 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726898 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726901 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726903 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726905 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726908 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726910 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726913 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726916 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726919 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726923 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726926 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726929 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726931 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 11:38:34.737372 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726934 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726936 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726939 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726942 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726944 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726947 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726949 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726951 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726954 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726957 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726959 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726962 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726964 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726968 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726971 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726974 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726977 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726980 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 11:38:34.737869 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.726983 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.727554 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.735925 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.735942 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.736589 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.736596 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736653 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736657 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736661 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736664 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736667 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736670 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736673 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736676 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736679 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 11:38:34.738299 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736681 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736684 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736686 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736689 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736692 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736694 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736697 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736699 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736702 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736705 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736707 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736710 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736712 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736743 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736746 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736749 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736752 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736755 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736758 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736762 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 11:38:34.738655 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736766 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736770 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736773 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736776 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736779 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736783 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736787 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736789 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736792 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736794 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736797 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736799 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736802 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736805 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736809 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736812 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736815 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736817 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736821 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 11:38:34.739160 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736823 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736826 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736828 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736831 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736833 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736836 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736838 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736841 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736844 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736846 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736849 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736851 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736854 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736857 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736859 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736862 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736865 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736868 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736870 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 11:38:34.739608 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736873 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736875 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736878 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736880 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736883 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736885 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736888 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736891 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736893 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736896 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736899 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736901 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736913 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736915 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736918 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736920 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736923 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736926 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736928 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736931 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 11:38:34.740076 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736934 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736936 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736939 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736941 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736944 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736946 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736949 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736952 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736955 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736957 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736959 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.736962 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.736967 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737078 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737083 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 17 11:38:34.740638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737086 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737088 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737091 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737093 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737096 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737098 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737101 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737103 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737106 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737109 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737112 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737114 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737117 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737120 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737123 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737125 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737127 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737130 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737133 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737135 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 17 11:38:34.741030 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737137 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737140 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737143 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737145 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737148 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737151 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737153 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737156 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737158 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737161 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737165 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737169 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737171 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737174 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737176 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737179 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737181 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737184 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737186 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737188 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 17 11:38:34.741606 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737191 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737193 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737196 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737199 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737202 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737204 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737207 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737209 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737212 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737214 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737217 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737219 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737222 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737224 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737227 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737229 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737232 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737234 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737237 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 17 11:38:34.742216 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737239 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737243 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737246 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737250 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737253 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737255 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737258 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737261 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737263 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737266 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737268 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737271 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737273 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737276 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737278 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737281 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737283 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737286 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737289 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 17 11:38:34.742677 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737292 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737294 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737297 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737299 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737302 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737304 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737307 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737309 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737312 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737314 2556 feature_gate.go:328] unrecognized feature gate: Example Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737317 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737319 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737322 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737324 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737327 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737331 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737334 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737337 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 17 11:38:34.743363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:34.737340 2556 feature_gate.go:328] unrecognized feature gate: Example2 Sep 17 11:38:34.744019 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.737345 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 17 11:38:34.744019 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.737457 2556 server.go:962] "Client rotation is on, will bootstrap in background" Sep 17 11:38:34.744019 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.740221 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 17 11:38:34.744019 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.741037 2556 server.go:1019] "Starting client certificate rotation" Sep 17 11:38:34.744019 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.741154 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 11:38:34.744019 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.741195 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 17 11:38:34.744019 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.743347 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 11:38:34.744570 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.744551 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 17 11:38:34.752252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.752235 2556 log.go:25] "Validated CRI v1 runtime API" Sep 17 11:38:34.755266 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.755175 2556 log.go:25] "Validated CRI v1 image API" Sep 17 11:38:34.756790 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.756761 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 17 11:38:34.761401 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.761377 2556 fs.go:135] Filesystem UUIDs: map[6b9c8c8b-2bf8-452f-a7a9-fb94b244d34b:/dev/nvme0n1p4 74801060-a51a-457b-b8c3-1cb0e864fa7d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Sep 17 11:38:34.761401 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.761395 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 17 11:38:34.768565 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.768449 2556 manager.go:216] Machine: {Timestamp:2026-09-17 11:38:34.767283154 +0000 UTC m=+0.363119527 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097766 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26a55a8158daea136bfe50d2b6e824 SystemUUID:ec26a55a-8158-daea-136b-fe50d2b6e824 BootID:3cbe2ab6-a859-483f-8f75-a2fd889284a3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d5:72:f1:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d5:72:f1:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:0d:62:90:f6:28 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 17 11:38:34.768565 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.768550 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 17 11:38:34.768685 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.768632 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 17 11:38:34.770436 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.770417 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 11:38:34.771386 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.771360 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 17 11:38:34.771521 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.771389 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-219.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 17 11:38:34.772071 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.772061 2556 topology_manager.go:138] "Creating topology manager with none policy" Sep 17 11:38:34.772103 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.772075 2556 container_manager_linux.go:309] "Creating device plugin manager" Sep 17 11:38:34.772103 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.772082 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 11:38:34.772103 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.772095 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 17 11:38:34.773126 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.773115 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 17 11:38:34.777250 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777238 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 17 11:38:34.777358 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777348 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 17 11:38:34.777392 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777379 2556 kubelet.go:486] "Attempting to sync node with API server" Sep 17 11:38:34.777392 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777388 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 17 11:38:34.777444 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777401 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 17 11:38:34.777444 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777410 2556 kubelet.go:398] "Adding apiserver pod source" Sep 17 11:38:34.777444 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777418 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 17 11:38:34.777826 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777808 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 11:38:34.777919 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.777836 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 17 11:38:34.780045 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.780029 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 17 11:38:34.782682 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.782670 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 17 11:38:34.782737 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.782699 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 17 11:38:34.784418 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784399 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784423 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784430 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784435 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784444 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784450 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784464 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784474 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784482 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 17 11:38:34.784486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784488 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 17 11:38:34.784730 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784504 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 17 11:38:34.784730 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.784510 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 17 11:38:34.785178 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.785168 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 17 11:38:34.785178 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.785178 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 17 11:38:34.789117 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.789102 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-219.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 17 11:38:34.789172 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.789141 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 17 11:38:34.789232 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.789221 2556 server.go:1268] "Started kubelet" Sep 17 11:38:34.789275 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.789239 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-219.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 17 11:38:34.789348 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.789321 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 17 11:38:34.790066 ip-10-0-130-219 systemd[1]: Started Kubernetes Kubelet. Sep 17 11:38:34.790566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.790060 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 17 11:38:34.790653 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.790587 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 17 11:38:34.791763 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.791746 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 17 11:38:34.792151 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.792135 2556 server.go:310] "Adding debug handlers to kubelet server" Sep 17 11:38:34.794504 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.794487 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 17 11:38:34.796069 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.795250 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-219.ec2.internal.18d618bffd05f730 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-219.ec2.internal,UID:ip-10-0-130-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-219.ec2.internal,},FirstTimestamp:2026-09-17 11:38:34.789197616 +0000 UTC m=+0.385033990,LastTimestamp:2026-09-17 11:38:34.789197616 +0000 UTC m=+0.385033990,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-219.ec2.internal,}" Sep 17 11:38:34.796525 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.796507 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 17 11:38:34.797040 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.797022 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 17 11:38:34.797575 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.797560 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:34.798081 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798062 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 17 11:38:34.798081 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798063 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 17 11:38:34.798199 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798093 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 17 11:38:34.798199 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798180 2556 reconstruct.go:97] "Volume reconstruction finished" Sep 17 11:38:34.798199 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798185 2556 reconciler.go:29] "Reconciler: start to sync state" Sep 17 11:38:34.798324 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798231 2556 factory.go:55] Registering systemd factory Sep 17 11:38:34.798324 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798245 2556 factory.go:223] Registration of the systemd container factory successfully Sep 17 11:38:34.798498 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798484 2556 factory.go:153] Registering CRI-O factory Sep 17 11:38:34.798498 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798498 2556 factory.go:223] Registration of the crio container factory successfully Sep 17 11:38:34.798651 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798535 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 17 11:38:34.798651 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798547 2556 factory.go:103] Registering Raw factory Sep 17 11:38:34.798651 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798557 2556 manager.go:1196] Started watching for new ooms in manager Sep 17 11:38:34.798924 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.798911 2556 manager.go:349] Starting recovery of all containers Sep 17 11:38:34.803588 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.803563 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-219.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 17 11:38:34.803945 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.803914 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 17 11:38:34.809732 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.809695 2556 manager.go:354] Recovery completed Sep 17 11:38:34.814325 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.814310 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 11:38:34.815924 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.815908 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Sep 17 11:38:34.815976 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.815936 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 11:38:34.815976 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.815946 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Sep 17 11:38:34.816494 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.816479 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 17 11:38:34.816494 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.816493 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 17 11:38:34.816609 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.816511 2556 state_mem.go:36] "Initialized new in-memory state store" Sep 17 11:38:34.816609 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.816480 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 11:38:34.817223 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.817208 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Sep 17 11:38:34.817266 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.817237 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 11:38:34.817266 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.817248 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Sep 17 11:38:34.818265 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.818195 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-219.ec2.internal.18d618bffe9dc7d2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-219.ec2.internal,UID:ip-10-0-130-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-219.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-219.ec2.internal,},FirstTimestamp:2026-09-17 11:38:34.815924178 +0000 UTC m=+0.411760550,LastTimestamp:2026-09-17 11:38:34.815924178 +0000 UTC m=+0.411760550,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-219.ec2.internal,}" Sep 17 11:38:34.818680 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.818667 2556 policy_none.go:49] "None policy: Start" Sep 17 11:38:34.818748 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.818685 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 17 11:38:34.818748 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.818697 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 17 11:38:34.820767 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.820754 2556 policy_none.go:47] "Start" Sep 17 11:38:34.827686 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.827630 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-219.ec2.internal.18d618bffe9e092f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-219.ec2.internal,UID:ip-10-0-130-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-219.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-219.ec2.internal,},FirstTimestamp:2026-09-17 11:38:34.815940911 +0000 UTC m=+0.411777283,LastTimestamp:2026-09-17 11:38:34.815940911 +0000 UTC m=+0.411777283,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-219.ec2.internal,}" Sep 17 11:38:34.832829 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.832813 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gdz6q" Sep 17 11:38:34.839643 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.839580 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-219.ec2.internal.18d618bffe9e2dee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-219.ec2.internal,UID:ip-10-0-130-219.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-219.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-219.ec2.internal,},FirstTimestamp:2026-09-17 11:38:34.815950318 +0000 UTC m=+0.411786690,LastTimestamp:2026-09-17 11:38:34.815950318 +0000 UTC m=+0.411786690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-219.ec2.internal,}" Sep 17 11:38:34.841613 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.841594 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gdz6q" Sep 17 11:38:34.856302 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.856288 2556 manager.go:337] "Starting Device Plugin manager" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.856327 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.856338 2556 server.go:87] "Starting device plugin registration server" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.856563 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.856574 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.856643 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.856737 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.856751 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.857279 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.857330 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.868822 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.870220 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.870264 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.870283 2556 kubelet.go:2448] "Starting kubelet main sync loop" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.870321 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 17 11:38:34.883316 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.872503 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 11:38:34.957531 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.957504 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 11:38:34.958458 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.958442 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Sep 17 11:38:34.958550 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.958475 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 11:38:34.958550 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.958492 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Sep 17 11:38:34.958550 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.958526 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-219.ec2.internal" Sep 17 11:38:34.967981 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.967962 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-219.ec2.internal" Sep 17 11:38:34.968065 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:34.967983 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-219.ec2.internal\": node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:34.971095 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.970987 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal"] Sep 17 11:38:34.971095 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.971067 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 11:38:34.972322 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.972305 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Sep 17 11:38:34.972418 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.972340 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 11:38:34.972418 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.972356 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Sep 17 11:38:34.974788 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.974774 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 11:38:34.974896 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.974880 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:34.974934 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.974922 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 11:38:34.975464 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.975448 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Sep 17 11:38:34.975515 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.975478 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 11:38:34.975515 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.975489 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Sep 17 11:38:34.975582 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.975448 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Sep 17 11:38:34.975582 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.975563 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 11:38:34.975582 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.975577 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Sep 17 11:38:34.977848 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.977835 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Sep 17 11:38:34.977913 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.977860 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 11:38:34.978733 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.978697 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Sep 17 11:38:34.978801 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.978750 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 11:38:34.978801 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:34.978771 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Sep 17 11:38:35.003313 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.003292 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-219.ec2.internal\" not found" node="ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.007589 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.007573 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-219.ec2.internal\" not found" node="ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.024121 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.024104 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.099898 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.099869 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7642d6e58dfac820e7e704736eb97795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"7642d6e58dfac820e7e704736eb97795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.099898 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.099897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7642d6e58dfac820e7e704736eb97795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"7642d6e58dfac820e7e704736eb97795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.100065 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.099914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68e6fc64f6f6999a4a59ae15d2e063cd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-219.ec2.internal\" (UID: \"68e6fc64f6f6999a4a59ae15d2e063cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.124340 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.124316 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.200994 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.200972 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68e6fc64f6f6999a4a59ae15d2e063cd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-219.ec2.internal\" (UID: \"68e6fc64f6f6999a4a59ae15d2e063cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.201100 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.200997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7642d6e58dfac820e7e704736eb97795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"7642d6e58dfac820e7e704736eb97795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.201100 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.201020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7642d6e58dfac820e7e704736eb97795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"7642d6e58dfac820e7e704736eb97795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.201100 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.201078 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68e6fc64f6f6999a4a59ae15d2e063cd-config\") pod \"kube-apiserver-proxy-ip-10-0-130-219.ec2.internal\" (UID: \"68e6fc64f6f6999a4a59ae15d2e063cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.201100 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.201091 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7642d6e58dfac820e7e704736eb97795-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"7642d6e58dfac820e7e704736eb97795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.201100 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.201093 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7642d6e58dfac820e7e704736eb97795-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal\" (UID: \"7642d6e58dfac820e7e704736eb97795\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.225153 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.225086 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.305812 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.305782 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.310670 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.310653 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Sep 17 11:38:35.325639 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.325622 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.426213 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.426182 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.526674 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.526615 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.627138 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.627104 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.727588 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.727561 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.740750 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.740728 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 17 11:38:35.740880 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.740862 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 17 11:38:35.828624 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.828595 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.837781 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.837760 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 17 11:38:35.839301 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.839283 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientMemory" Sep 17 11:38:35.839377 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.839324 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasNoDiskPressure" Sep 17 11:38:35.839377 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.839342 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeHasSufficientPID" Sep 17 11:38:35.847117 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.847091 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 11:33:35 +0000 UTC" deadline="2028-04-01 18:46:20.03061545 +0000 UTC" Sep 17 11:38:35.847117 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.847116 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13495h7m44.183502746s" Sep 17 11:38:35.884516 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.884490 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 11:38:35.922163 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:35.922130 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7642d6e58dfac820e7e704736eb97795.slice/crio-82cb0f350e940699a937d40ccc337fd812d8e875164e17a084cd6ee648f7232c WatchSource:0}: Error finding container 82cb0f350e940699a937d40ccc337fd812d8e875164e17a084cd6ee648f7232c: Status 404 returned error can't find the container with id 82cb0f350e940699a937d40ccc337fd812d8e875164e17a084cd6ee648f7232c Sep 17 11:38:35.923236 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:35.923208 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68e6fc64f6f6999a4a59ae15d2e063cd.slice/crio-22a838ebba6c86e80380316d1bcd3dc5e3c650ded36d355801993a560dd85737 WatchSource:0}: Error finding container 22a838ebba6c86e80380316d1bcd3dc5e3c650ded36d355801993a560dd85737: Status 404 returned error can't find the container with id 22a838ebba6c86e80380316d1bcd3dc5e3c650ded36d355801993a560dd85737 Sep 17 11:38:35.929077 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:35.929059 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:35.929152 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:35.929137 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 11:38:36.029365 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:36.029330 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-219.ec2.internal\" not found" Sep 17 11:38:36.058143 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.058086 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 11:38:36.098580 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.098560 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" Sep 17 11:38:36.114556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.114538 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 11:38:36.116299 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.116287 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" Sep 17 11:38:36.125824 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.125812 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 17 11:38:36.292391 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.292362 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 11:38:36.682168 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.682136 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 17 11:38:36.778766 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.778733 2556 apiserver.go:52] "Watching apiserver" Sep 17 11:38:36.784872 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.784847 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 17 11:38:36.785315 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.785288 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal","openshift-multus/network-metrics-daemon-plzr7","openshift-network-operator/iptables-alerter-6bnhg","openshift-ovn-kubernetes/ovnkube-node-dtdhb","kube-system/global-pull-secret-syncer-jjrgw","kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c","openshift-cluster-node-tuning-operator/tuned-8dhvz","openshift-dns/node-resolver-2fr74","openshift-multus/multus-additional-cni-plugins-96gd9","openshift-multus/multus-vffnr","openshift-network-diagnostics/network-check-target-59gxn","kube-system/konnectivity-agent-m59b7","openshift-image-registry/node-ca-9bfnx"] Sep 17 11:38:36.787845 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.787822 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.790140 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.790080 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:38:36.791004 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.790857 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 17 11:38:36.791260 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.791235 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 17 11:38:36.791516 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.791501 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 17 11:38:36.791749 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.791708 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hd9g8\"" Sep 17 11:38:36.794262 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.792368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.794262 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.792895 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 17 11:38:36.794262 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.792912 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c76j8\"" Sep 17 11:38:36.794262 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.793089 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 17 11:38:36.794712 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.794683 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.798480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.797776 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 17 11:38:36.798480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.797826 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 17 11:38:36.798480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.797852 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 17 11:38:36.798480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.798135 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-sqvhh\"" Sep 17 11:38:36.798480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.798278 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x5cs7\"" Sep 17 11:38:36.798480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.798288 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 17 11:38:36.798480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.798359 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 17 11:38:36.798480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.798376 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 17 11:38:36.798849 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.798733 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 17 11:38:36.800246 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.799019 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 17 11:38:36.800641 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.800621 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.800763 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:36.800736 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:36.804166 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.804146 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:36.806494 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.806476 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:36.807242 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.807224 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 17 11:38:36.807357 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.807341 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 17 11:38:36.807943 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.807923 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 17 11:38:36.808067 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.807924 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qhchk\"" Sep 17 11:38:36.808581 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.808564 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 17 11:38:36.808799 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.808784 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 17 11:38:36.809025 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809010 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.809452 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809430 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 17 11:38:36.809638 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809621 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cswwl\"" Sep 17 11:38:36.809842 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809827 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 17 11:38:36.809907 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-socket-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.809907 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809898 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-cni-netd\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810020 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809922 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovn-node-metrics-cert\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810020 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32e14d14-402a-433f-b533-2c283ff9ecbd-dbus\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.810020 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809962 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.810020 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809974 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-registration-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.810020 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.809988 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-systemd-units\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810020 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810029 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovnkube-config\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810044 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtlck\" (UniqueName: \"kubernetes.io/projected/b2c0f818-8e58-49af-8633-08ae590fb1d4-kube-api-access-xtlck\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810057 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c845f68c-3884-437d-ace1-924bbaca844b-host-slash\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810075 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk78q\" (UniqueName: \"kubernetes.io/projected/c845f68c-3884-437d-ace1-924bbaca844b-kube-api-access-sk78q\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810117 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-etc-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810147 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-env-overrides\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810168 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovnkube-script-lib\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-run-netns\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810197 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-ovn\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810210 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-cni-bin\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810222 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47c11ef0-b8ae-48d8-9cd5-69f5d486f526-agent-certs\") pod \"konnectivity-agent-m59b7\" (UID: \"47c11ef0-b8ae-48d8-9cd5-69f5d486f526\") " pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810244 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c845f68c-3884-437d-ace1-924bbaca844b-iptables-alerter-script\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810289 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-kubelet\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.810337 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810334 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47c11ef0-b8ae-48d8-9cd5-69f5d486f526-konnectivity-ca\") pod \"konnectivity-agent-m59b7\" (UID: \"47c11ef0-b8ae-48d8-9cd5-69f5d486f526\") " pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-slash\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810382 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-systemd\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810414 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb994\" (UniqueName: \"kubernetes.io/projected/b4546aec-8f06-435c-84fd-11331fe3c621-kube-api-access-bb994\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-device-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810473 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-sys-fs\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-var-lib-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810501 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-log-socket\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810520 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-node-log\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.811193 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.810562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32e14d14-402a-433f-b533-2c283ff9ecbd-kubelet-config\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.811759 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.811240 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:36.811759 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:36.811314 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:36.811759 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.811464 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 17 11:38:36.811759 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.811561 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 17 11:38:36.812187 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.812171 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bttjq\"" Sep 17 11:38:36.813641 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.813624 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:36.816089 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.816072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.816302 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.816282 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 17 11:38:36.816665 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.816645 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nc9k4\"" Sep 17 11:38:36.816887 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.816871 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 17 11:38:36.817156 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.817139 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 17 11:38:36.817304 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.817292 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 17 11:38:36.817388 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.817337 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 17 11:38:36.818753 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.818703 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:36.818854 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:36.818801 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:36.819569 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.819530 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zxmzt\"" Sep 17 11:38:36.819774 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.819755 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 17 11:38:36.823972 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.823950 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 17 11:38:36.845415 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.845371 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fn7kv" Sep 17 11:38:36.854500 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.854482 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fn7kv" Sep 17 11:38:36.876587 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.876546 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" event={"ID":"68e6fc64f6f6999a4a59ae15d2e063cd","Type":"ContainerStarted","Data":"22a838ebba6c86e80380316d1bcd3dc5e3c650ded36d355801993a560dd85737"} Sep 17 11:38:36.878901 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.878873 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" event={"ID":"7642d6e58dfac820e7e704736eb97795","Type":"ContainerStarted","Data":"82cb0f350e940699a937d40ccc337fd812d8e875164e17a084cd6ee648f7232c"} Sep 17 11:38:36.899694 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.899665 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 17 11:38:36.911096 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-socket-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.911211 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911105 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32e14d14-402a-433f-b533-2c283ff9ecbd-dbus\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.911211 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911134 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-cni-bin\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.911211 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911171 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-lib-modules\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.911211 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911206 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-systemd-units\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911263 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-cnibin\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:36.911428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911282 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-socket-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.911428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:36.911428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:36.911636 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911423 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-systemd-units\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911636 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911448 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk78q\" (UniqueName: \"kubernetes.io/projected/c845f68c-3884-437d-ace1-924bbaca844b-kube-api-access-sk78q\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.911636 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911460 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-run-ovn-kubernetes\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911636 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911512 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-etc-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911636 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovnkube-script-lib\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-etc-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911701 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4a86886-462f-4f14-991c-1480440b7d2f-hosts-file\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:36.911891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911777 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-systemd\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.911891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-ovn\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:36.911891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911846 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-cni-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.911891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911871 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-ovn\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.911891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-cnibin\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/754a307f-73dd-4bcb-8c05-1aed646bd573-serviceca\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-tuned\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.911970 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtp55\" (UniqueName: \"kubernetes.io/projected/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-kube-api-access-vtp55\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912011 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47c11ef0-b8ae-48d8-9cd5-69f5d486f526-agent-certs\") pod \"konnectivity-agent-m59b7\" (UID: \"47c11ef0-b8ae-48d8-9cd5-69f5d486f526\") " pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-socket-dir-parent\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-var-lib-kubelet\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912123 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-host\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912141 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-systemd\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912210 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912229 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-systemd\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912281 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-system-cni-dir\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:36.912308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912287 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovnkube-script-lib\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.912707 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912320 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-hostroot\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.912822 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912796 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/32e14d14-402a-433f-b533-2c283ff9ecbd-dbus\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.912909 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjkp7\" (UniqueName: \"kubernetes.io/projected/f4a86886-462f-4f14-991c-1480440b7d2f-kube-api-access-rjkp7\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:36.912944 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912932 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysctl-conf\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.913077 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.912953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-run\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.913211 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913193 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-sys\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.913269 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb994\" (UniqueName: \"kubernetes.io/projected/b4546aec-8f06-435c-84fd-11331fe3c621-kube-api-access-bb994\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.913421 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913396 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-var-lib-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.913474 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913458 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 17 11:38:36.913590 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prnlv\" (UniqueName: \"kubernetes.io/projected/164f8149-052b-4c3f-a849-78ae7b6d04ef-kube-api-access-prnlv\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:36.913705 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913684 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-var-lib-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.913860 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913838 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dpwq\" (UniqueName: \"kubernetes.io/projected/0b272b85-4330-455f-93c4-521f974e9d70-kube-api-access-9dpwq\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.913921 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913885 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-modprobe-d\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.913971 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-node-log\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.913971 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-multus-certs\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.914062 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.913978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysconfig\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.914062 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914012 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-cni-netd\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.914153 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914072 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovn-node-metrics-cert\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.914153 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914097 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-node-log\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.914153 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914114 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.914153 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914145 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-cni-netd\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.914153 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914149 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-registration-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.914334 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovnkube-config\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.914334 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914209 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-registration-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.914334 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914231 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtlck\" (UniqueName: \"kubernetes.io/projected/b2c0f818-8e58-49af-8633-08ae590fb1d4-kube-api-access-xtlck\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.914334 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914294 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:36.914334 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914329 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-netns\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.914586 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysctl-d\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.914586 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914403 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c845f68c-3884-437d-ace1-924bbaca844b-host-slash\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.914748 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.914851 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-env-overrides\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.914851 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914815 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:36.914968 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914850 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-run-netns\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.914968 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914944 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b272b85-4330-455f-93c4-521f974e9d70-cni-binary-copy\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.915079 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.914983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-kubernetes\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.915079 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915066 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-tmp\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.915173 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x5k7\" (UniqueName: \"kubernetes.io/projected/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-kube-api-access-8x5k7\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:36.915173 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915133 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-cni-bin\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.915274 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915174 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c845f68c-3884-437d-ace1-924bbaca844b-host-slash\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.915274 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915221 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c845f68c-3884-437d-ace1-924bbaca844b-iptables-alerter-script\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.915274 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915254 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.915417 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915288 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-kubelet\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.915417 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-etc-kubernetes\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.915517 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47c11ef0-b8ae-48d8-9cd5-69f5d486f526-konnectivity-ca\") pod \"konnectivity-agent-m59b7\" (UID: \"47c11ef0-b8ae-48d8-9cd5-69f5d486f526\") " pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:38:36.915517 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-slash\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.915517 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-k8s-cni-cncf-io\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.915655 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/754a307f-73dd-4bcb-8c05-1aed646bd573-host\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:36.915655 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915638 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db8kl\" (UniqueName: \"kubernetes.io/projected/754a307f-73dd-4bcb-8c05-1aed646bd573-kube-api-access-db8kl\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:36.915787 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a86886-462f-4f14-991c-1480440b7d2f-tmp-dir\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:36.915787 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915735 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-device-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.915787 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915773 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovnkube-config\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.915934 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915796 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-sys-fs\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.915934 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:36.915884 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:36.915934 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915923 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-sys-fs\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.916100 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:36.916014 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret podName:32e14d14-402a-433f-b533-2c283ff9ecbd nodeName:}" failed. No retries permitted until 2026-09-17 11:38:37.415963725 +0000 UTC m=+3.011800099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret") pod "global-pull-secret-syncer-jjrgw" (UID: "32e14d14-402a-433f-b533-2c283ff9ecbd") : object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:36.916100 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.915996 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.916245 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-log-socket\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.916322 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-system-cni-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.916408 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916338 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-conf-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.916408 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916387 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b272b85-4330-455f-93c4-521f974e9d70-multus-daemon-config\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.916505 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916425 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.916505 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916456 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32e14d14-402a-433f-b533-2c283ff9ecbd-kubelet-config\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.916505 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916473 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2c0f818-8e58-49af-8633-08ae590fb1d4-env-overrides\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.916697 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916554 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-cni-multus\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.916697 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916581 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-device-dir\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.916697 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-kubelet\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:36.916697 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:36.916915 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916796 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/32e14d14-402a-433f-b533-2c283ff9ecbd-kubelet-config\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:36.916915 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916845 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-log-socket\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.916915 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916902 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-run-netns\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.917048 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.916956 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-cni-bin\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.917514 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.917486 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c845f68c-3884-437d-ace1-924bbaca844b-iptables-alerter-script\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.917687 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.917626 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b4546aec-8f06-435c-84fd-11331fe3c621-etc-selinux\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.917774 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.917686 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-kubelet\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.917825 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.917758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-run-openvswitch\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.918020 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.917985 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2c0f818-8e58-49af-8633-08ae590fb1d4-host-slash\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.918990 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.918965 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2c0f818-8e58-49af-8633-08ae590fb1d4-ovn-node-metrics-cert\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:36.919494 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.919382 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/47c11ef0-b8ae-48d8-9cd5-69f5d486f526-konnectivity-ca\") pod \"konnectivity-agent-m59b7\" (UID: \"47c11ef0-b8ae-48d8-9cd5-69f5d486f526\") " pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:38:36.920662 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.920480 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/47c11ef0-b8ae-48d8-9cd5-69f5d486f526-agent-certs\") pod \"konnectivity-agent-m59b7\" (UID: \"47c11ef0-b8ae-48d8-9cd5-69f5d486f526\") " pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:38:36.922338 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.922317 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk78q\" (UniqueName: \"kubernetes.io/projected/c845f68c-3884-437d-ace1-924bbaca844b-kube-api-access-sk78q\") pod \"iptables-alerter-6bnhg\" (UID: \"c845f68c-3884-437d-ace1-924bbaca844b\") " pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:36.922839 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.922818 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb994\" (UniqueName: \"kubernetes.io/projected/b4546aec-8f06-435c-84fd-11331fe3c621-kube-api-access-bb994\") pod \"aws-ebs-csi-driver-node-fpt8c\" (UID: \"b4546aec-8f06-435c-84fd-11331fe3c621\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:36.924757 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:36.924735 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtlck\" (UniqueName: \"kubernetes.io/projected/b2c0f818-8e58-49af-8633-08ae590fb1d4-kube-api-access-xtlck\") pod \"ovnkube-node-dtdhb\" (UID: \"b2c0f818-8e58-49af-8633-08ae590fb1d4\") " pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:37.017099 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.017252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017110 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-netns\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.017252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysctl-d\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.017252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017166 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.017252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017206 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b272b85-4330-455f-93c4-521f974e9d70-cni-binary-copy\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.017252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017208 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-netns\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.017252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-kubernetes\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-tmp\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017284 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x5k7\" (UniqueName: \"kubernetes.io/projected/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-kube-api-access-8x5k7\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017311 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-etc-kubernetes\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017333 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-k8s-cni-cncf-io\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017357 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/754a307f-73dd-4bcb-8c05-1aed646bd573-host\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017363 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysctl-d\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017380 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8kl\" (UniqueName: \"kubernetes.io/projected/754a307f-73dd-4bcb-8c05-1aed646bd573-kube-api-access-db8kl\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017418 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a86886-462f-4f14-991c-1480440b7d2f-tmp-dir\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017448 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-system-cni-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017473 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-conf-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017499 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b272b85-4330-455f-93c4-521f974e9d70-multus-daemon-config\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.017556 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017558 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-cni-multus\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-kubelet\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017612 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-cni-bin\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017655 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-etc-kubernetes\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017668 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-lib-modules\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017694 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-cnibin\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017712 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-k8s-cni-cncf-io\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017719 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017757 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/754a307f-73dd-4bcb-8c05-1aed646bd573-host\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017795 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4a86886-462f-4f14-991c-1480440b7d2f-hosts-file\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017826 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-cni-multus\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017828 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017850 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-kubernetes\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017839 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-systemd\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017900 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-systemd\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.018243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017904 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0b272b85-4330-455f-93c4-521f974e9d70-cni-binary-copy\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017930 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-cni-binary-copy\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.017953 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-system-cni-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018009 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-conf-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018016 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-lib-modules\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-cni-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-cnibin\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018102 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/754a307f-73dd-4bcb-8c05-1aed646bd573-serviceca\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018108 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f4a86886-462f-4f14-991c-1480440b7d2f-hosts-file\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018128 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-tuned\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtp55\" (UniqueName: \"kubernetes.io/projected/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-kube-api-access-vtp55\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018171 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-kubelet\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018161 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4a86886-462f-4f14-991c-1480440b7d2f-tmp-dir\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018164 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-cnibin\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018193 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-socket-dir-parent\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018239 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-var-lib-kubelet\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.019104 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.018276 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018284 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-cnibin\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018267 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-host\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018327 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-system-cni-dir\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018339 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-host\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.018364 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs podName:a3cea07b-0f93-4d30-88db-fc3ff1783cbb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:37.518319307 +0000 UTC m=+3.114155670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs") pod "network-metrics-daemon-plzr7" (UID: "a3cea07b-0f93-4d30-88db-fc3ff1783cbb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018414 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-var-lib-cni-bin\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018469 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-cni-dir\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018365 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/164f8149-052b-4c3f-a849-78ae7b6d04ef-system-cni-dir\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018518 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-multus-socket-dir-parent\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0b272b85-4330-455f-93c4-521f974e9d70-multus-daemon-config\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018548 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-hostroot\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018568 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-var-lib-kubelet\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018578 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjkp7\" (UniqueName: \"kubernetes.io/projected/f4a86886-462f-4f14-991c-1480440b7d2f-kube-api-access-rjkp7\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysctl-conf\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018627 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-hostroot\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018650 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-run\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.019876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018677 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-sys\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prnlv\" (UniqueName: \"kubernetes.io/projected/164f8149-052b-4c3f-a849-78ae7b6d04ef-kube-api-access-prnlv\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dpwq\" (UniqueName: \"kubernetes.io/projected/0b272b85-4330-455f-93c4-521f974e9d70-kube-api-access-9dpwq\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018702 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/164f8149-052b-4c3f-a849-78ae7b6d04ef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-run\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-modprobe-d\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-multus-certs\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018864 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-modprobe-d\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018872 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysconfig\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018711 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/754a307f-73dd-4bcb-8c05-1aed646bd573-serviceca\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018889 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysctl-conf\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018883 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-sys\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.018957 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-sysconfig\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.020614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.019005 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0b272b85-4330-455f-93c4-521f974e9d70-host-run-multus-certs\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.021056 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.020617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-tmp\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.021092 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.021053 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-etc-tuned\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.028064 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.028039 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 11:38:37.028187 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.028072 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 11:38:37.028187 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.028087 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gfzf9 for pod openshift-network-diagnostics/network-check-target-59gxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:37.028187 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.028167 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9 podName:d0bf80ee-7a43-4f75-998e-ef6be1068beb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:37.528149797 +0000 UTC m=+3.123986177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gfzf9" (UniqueName: "kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9") pod "network-check-target-59gxn" (UID: "d0bf80ee-7a43-4f75-998e-ef6be1068beb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:37.030709 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.030672 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db8kl\" (UniqueName: \"kubernetes.io/projected/754a307f-73dd-4bcb-8c05-1aed646bd573-kube-api-access-db8kl\") pod \"node-ca-9bfnx\" (UID: \"754a307f-73dd-4bcb-8c05-1aed646bd573\") " pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:37.031139 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.031115 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x5k7\" (UniqueName: \"kubernetes.io/projected/81e1ce82-a776-4367-a666-e7b4c3ec6cd6-kube-api-access-8x5k7\") pod \"tuned-8dhvz\" (UID: \"81e1ce82-a776-4367-a666-e7b4c3ec6cd6\") " pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.034895 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.034850 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtp55\" (UniqueName: \"kubernetes.io/projected/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-kube-api-access-vtp55\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:37.039919 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.039864 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prnlv\" (UniqueName: \"kubernetes.io/projected/164f8149-052b-4c3f-a849-78ae7b6d04ef-kube-api-access-prnlv\") pod \"multus-additional-cni-plugins-96gd9\" (UID: \"164f8149-052b-4c3f-a849-78ae7b6d04ef\") " pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.040126 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.040107 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjkp7\" (UniqueName: \"kubernetes.io/projected/f4a86886-462f-4f14-991c-1480440b7d2f-kube-api-access-rjkp7\") pod \"node-resolver-2fr74\" (UID: \"f4a86886-462f-4f14-991c-1480440b7d2f\") " pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:37.041269 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.041148 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dpwq\" (UniqueName: \"kubernetes.io/projected/0b272b85-4330-455f-93c4-521f974e9d70-kube-api-access-9dpwq\") pod \"multus-vffnr\" (UID: \"0b272b85-4330-455f-93c4-521f974e9d70\") " pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.100795 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.100772 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" Sep 17 11:38:37.109871 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.109849 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:38:37.121899 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.121880 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6bnhg" Sep 17 11:38:37.126930 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.126912 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:38:37.132823 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.132791 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bfnx" Sep 17 11:38:37.141705 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.141682 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2fr74" Sep 17 11:38:37.149051 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.149032 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" Sep 17 11:38:37.156789 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.156767 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-96gd9" Sep 17 11:38:37.162645 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.162625 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vffnr" Sep 17 11:38:37.422224 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.422138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:37.422379 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.422271 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:37.422379 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.422345 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret podName:32e14d14-402a-433f-b533-2c283ff9ecbd nodeName:}" failed. No retries permitted until 2026-09-17 11:38:38.422319922 +0000 UTC m=+4.018156305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret") pod "global-pull-secret-syncer-jjrgw" (UID: "32e14d14-402a-433f-b533-2c283ff9ecbd") : object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:37.523091 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.523047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:37.523266 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.523243 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:37.523337 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.523327 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs podName:a3cea07b-0f93-4d30-88db-fc3ff1783cbb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:38.523311847 +0000 UTC m=+4.119148229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs") pod "network-metrics-daemon-plzr7" (UID: "a3cea07b-0f93-4d30-88db-fc3ff1783cbb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:37.624354 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.624322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:37.624506 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.624467 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 11:38:37.624506 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.624485 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 11:38:37.624506 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.624494 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gfzf9 for pod openshift-network-diagnostics/network-check-target-59gxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:37.624609 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:37.624544 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9 podName:d0bf80ee-7a43-4f75-998e-ef6be1068beb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:38.624532296 +0000 UTC m=+4.220368658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfzf9" (UniqueName: "kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9") pod "network-check-target-59gxn" (UID: "d0bf80ee-7a43-4f75-998e-ef6be1068beb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:37.858203 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.858109 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 11:33:37 +0000 UTC" deadline="2028-03-24 00:49:49.41156191 +0000 UTC" Sep 17 11:38:37.858203 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:37.858150 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13285h11m11.553417419s" Sep 17 11:38:38.002576 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:38.002548 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc845f68c_3884_437d_ace1_924bbaca844b.slice/crio-e4a8d497dc3aa48965ea4674643ae001a1c95cc88a3958dc2c80c08c289b6e06 WatchSource:0}: Error finding container e4a8d497dc3aa48965ea4674643ae001a1c95cc88a3958dc2c80c08c289b6e06: Status 404 returned error can't find the container with id e4a8d497dc3aa48965ea4674643ae001a1c95cc88a3958dc2c80c08c289b6e06 Sep 17 11:38:38.004240 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:38.004215 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754a307f_73dd_4bcb_8c05_1aed646bd573.slice/crio-56ddf960427afb8e18eea46e0a3690d88504d43e93f83ebd1551bbfb83eac19d WatchSource:0}: Error finding container 56ddf960427afb8e18eea46e0a3690d88504d43e93f83ebd1551bbfb83eac19d: Status 404 returned error can't find the container with id 56ddf960427afb8e18eea46e0a3690d88504d43e93f83ebd1551bbfb83eac19d Sep 17 11:38:38.028142 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:38.028116 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164f8149_052b_4c3f_a849_78ae7b6d04ef.slice/crio-fb8acb9540de5fdc257097c5475439c72ff171ba90f62edcd3baa34330bdb7f2 WatchSource:0}: Error finding container fb8acb9540de5fdc257097c5475439c72ff171ba90f62edcd3baa34330bdb7f2: Status 404 returned error can't find the container with id fb8acb9540de5fdc257097c5475439c72ff171ba90f62edcd3baa34330bdb7f2 Sep 17 11:38:38.029095 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:38.029069 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b272b85_4330_455f_93c4_521f974e9d70.slice/crio-8d527f32d01b22f0fd2590089c4eef873ca283b4abe58b7df3d82c3a96b837c7 WatchSource:0}: Error finding container 8d527f32d01b22f0fd2590089c4eef873ca283b4abe58b7df3d82c3a96b837c7: Status 404 returned error can't find the container with id 8d527f32d01b22f0fd2590089c4eef873ca283b4abe58b7df3d82c3a96b837c7 Sep 17 11:38:38.030480 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:38.030452 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e1ce82_a776_4367_a666_e7b4c3ec6cd6.slice/crio-66ff1357c0dba7672881d0b8c60d8524aabcc3df5c7ba62190e9ca2c78de1dee WatchSource:0}: Error finding container 66ff1357c0dba7672881d0b8c60d8524aabcc3df5c7ba62190e9ca2c78de1dee: Status 404 returned error can't find the container with id 66ff1357c0dba7672881d0b8c60d8524aabcc3df5c7ba62190e9ca2c78de1dee Sep 17 11:38:38.032874 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:38.031558 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4546aec_8f06_435c_84fd_11331fe3c621.slice/crio-8087c2039057c58886c88f0f6e822593aca24fdd9afe4e2734ee5977eaab62fb WatchSource:0}: Error finding container 8087c2039057c58886c88f0f6e822593aca24fdd9afe4e2734ee5977eaab62fb: Status 404 returned error can't find the container with id 8087c2039057c58886c88f0f6e822593aca24fdd9afe4e2734ee5977eaab62fb Sep 17 11:38:38.033413 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:38:38.033038 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c11ef0_b8ae_48d8_9cd5_69f5d486f526.slice/crio-3b791a087ee334f91b7a25d56e98c8a7495b735538a16219869d31c3926b17e5 WatchSource:0}: Error finding container 3b791a087ee334f91b7a25d56e98c8a7495b735538a16219869d31c3926b17e5: Status 404 returned error can't find the container with id 3b791a087ee334f91b7a25d56e98c8a7495b735538a16219869d31c3926b17e5 Sep 17 11:38:38.430648 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.430609 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:38.430827 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.430794 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:38.430868 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.430862 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret podName:32e14d14-402a-433f-b533-2c283ff9ecbd nodeName:}" failed. No retries permitted until 2026-09-17 11:38:40.430844456 +0000 UTC m=+6.026680817 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret") pod "global-pull-secret-syncer-jjrgw" (UID: "32e14d14-402a-433f-b533-2c283ff9ecbd") : object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:38.531721 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.531632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:38.531913 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.531802 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:38.531913 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.531862 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs podName:a3cea07b-0f93-4d30-88db-fc3ff1783cbb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:40.531848853 +0000 UTC m=+6.127685229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs") pod "network-metrics-daemon-plzr7" (UID: "a3cea07b-0f93-4d30-88db-fc3ff1783cbb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:38.632132 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.632089 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:38.632311 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.632282 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 11:38:38.632311 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.632307 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 11:38:38.632439 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.632322 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gfzf9 for pod openshift-network-diagnostics/network-check-target-59gxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:38.632439 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.632394 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9 podName:d0bf80ee-7a43-4f75-998e-ef6be1068beb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:40.632375014 +0000 UTC m=+6.228211396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfzf9" (UniqueName: "kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9") pod "network-check-target-59gxn" (UID: "d0bf80ee-7a43-4f75-998e-ef6be1068beb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:38.858889 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.858715 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 11:33:37 +0000 UTC" deadline="2028-03-16 19:10:16.962467874 +0000 UTC" Sep 17 11:38:38.858889 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.858800 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13111h31m38.103673395s" Sep 17 11:38:38.874675 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.873723 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:38.874675 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.873881 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:38.874675 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.874347 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:38.874675 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.874455 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:38.874675 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.874531 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:38.874675 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:38.874618 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:38.906247 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.906214 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"06db47a85701e856a863542a0e4486914d1c2246a1e3c7ac0bcfd404888823dc"} Sep 17 11:38:38.911282 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.911223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2fr74" event={"ID":"f4a86886-462f-4f14-991c-1480440b7d2f","Type":"ContainerStarted","Data":"e29036828b80462ec2c384c4b333908b543c2007c3a610172c7099f699bf0782"} Sep 17 11:38:38.916710 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.916683 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" event={"ID":"81e1ce82-a776-4367-a666-e7b4c3ec6cd6","Type":"ContainerStarted","Data":"66ff1357c0dba7672881d0b8c60d8524aabcc3df5c7ba62190e9ca2c78de1dee"} Sep 17 11:38:38.942297 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.942206 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vffnr" event={"ID":"0b272b85-4330-455f-93c4-521f974e9d70","Type":"ContainerStarted","Data":"8d527f32d01b22f0fd2590089c4eef873ca283b4abe58b7df3d82c3a96b837c7"} Sep 17 11:38:38.946850 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.946669 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bfnx" event={"ID":"754a307f-73dd-4bcb-8c05-1aed646bd573","Type":"ContainerStarted","Data":"56ddf960427afb8e18eea46e0a3690d88504d43e93f83ebd1551bbfb83eac19d"} Sep 17 11:38:38.948385 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.948356 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6bnhg" event={"ID":"c845f68c-3884-437d-ace1-924bbaca844b","Type":"ContainerStarted","Data":"e4a8d497dc3aa48965ea4674643ae001a1c95cc88a3958dc2c80c08c289b6e06"} Sep 17 11:38:38.952951 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.952883 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" event={"ID":"68e6fc64f6f6999a4a59ae15d2e063cd","Type":"ContainerStarted","Data":"7e479c0a96384d95d8350b44cf1c06513251ffbd6a8c04e7b217bed38741af58"} Sep 17 11:38:38.961998 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.961971 2556 generic.go:356] "Generic (PLEG): container finished" podID="7642d6e58dfac820e7e704736eb97795" containerID="a813ca53cdccae64fb3fff5a8ddb310bdfc25bfc82b67b241a6237fc6a3349f8" exitCode=0 Sep 17 11:38:38.962126 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.962064 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" event={"ID":"7642d6e58dfac820e7e704736eb97795","Type":"ContainerDied","Data":"a813ca53cdccae64fb3fff5a8ddb310bdfc25bfc82b67b241a6237fc6a3349f8"} Sep 17 11:38:38.976428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.976361 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m59b7" event={"ID":"47c11ef0-b8ae-48d8-9cd5-69f5d486f526","Type":"ContainerStarted","Data":"3b791a087ee334f91b7a25d56e98c8a7495b735538a16219869d31c3926b17e5"} Sep 17 11:38:38.977654 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.976978 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-219.ec2.internal" podStartSLOduration=2.976959512 podStartE2EDuration="2.976959512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:38:38.976088706 +0000 UTC m=+4.571925093" watchObservedRunningTime="2026-09-17 11:38:38.976959512 +0000 UTC m=+4.572795898" Sep 17 11:38:38.986864 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:38.986807 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" event={"ID":"b4546aec-8f06-435c-84fd-11331fe3c621","Type":"ContainerStarted","Data":"8087c2039057c58886c88f0f6e822593aca24fdd9afe4e2734ee5977eaab62fb"} Sep 17 11:38:39.000608 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:39.000538 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerStarted","Data":"fb8acb9540de5fdc257097c5475439c72ff171ba90f62edcd3baa34330bdb7f2"} Sep 17 11:38:40.033541 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:40.033458 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" event={"ID":"7642d6e58dfac820e7e704736eb97795","Type":"ContainerStarted","Data":"ef342816d06f59ef3e492f6d25315c886b5a34269dd9edbfd69f338868cdb50e"} Sep 17 11:38:40.453921 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:40.453205 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:40.453921 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.453414 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:40.453921 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.453484 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret podName:32e14d14-402a-433f-b533-2c283ff9ecbd nodeName:}" failed. No retries permitted until 2026-09-17 11:38:44.453464948 +0000 UTC m=+10.049301322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret") pod "global-pull-secret-syncer-jjrgw" (UID: "32e14d14-402a-433f-b533-2c283ff9ecbd") : object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:40.554192 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:40.553646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:40.554192 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.553803 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:40.554192 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.553878 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs podName:a3cea07b-0f93-4d30-88db-fc3ff1783cbb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:44.553861997 +0000 UTC m=+10.149698359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs") pod "network-metrics-daemon-plzr7" (UID: "a3cea07b-0f93-4d30-88db-fc3ff1783cbb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:40.654973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:40.654220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:40.654973 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.654456 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 11:38:40.654973 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.654486 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 11:38:40.654973 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.654500 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gfzf9 for pod openshift-network-diagnostics/network-check-target-59gxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:40.654973 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.654565 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9 podName:d0bf80ee-7a43-4f75-998e-ef6be1068beb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:44.654546412 +0000 UTC m=+10.250382789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfzf9" (UniqueName: "kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9") pod "network-check-target-59gxn" (UID: "d0bf80ee-7a43-4f75-998e-ef6be1068beb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:40.874393 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:40.873479 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:40.874393 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.873629 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:40.874393 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:40.874065 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:40.874393 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.874158 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:40.874393 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:40.874216 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:40.874393 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:40.874288 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:42.871084 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:42.871051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:42.871084 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:42.871083 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:42.871573 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:42.871051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:42.871573 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:42.871187 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:42.871573 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:42.871290 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:42.871573 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:42.871367 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:44.492411 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:44.492233 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:44.492916 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.492418 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:44.492916 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.492499 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret podName:32e14d14-402a-433f-b533-2c283ff9ecbd nodeName:}" failed. No retries permitted until 2026-09-17 11:38:52.492478517 +0000 UTC m=+18.088314895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret") pod "global-pull-secret-syncer-jjrgw" (UID: "32e14d14-402a-433f-b533-2c283ff9ecbd") : object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:44.593572 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:44.592991 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:44.593572 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.593156 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:44.593572 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.593224 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs podName:a3cea07b-0f93-4d30-88db-fc3ff1783cbb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:52.593204951 +0000 UTC m=+18.189041325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs") pod "network-metrics-daemon-plzr7" (UID: "a3cea07b-0f93-4d30-88db-fc3ff1783cbb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:44.693927 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:44.693884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:44.694104 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.694064 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 11:38:44.694104 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.694091 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 11:38:44.694104 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.694104 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gfzf9 for pod openshift-network-diagnostics/network-check-target-59gxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:44.694268 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.694162 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9 podName:d0bf80ee-7a43-4f75-998e-ef6be1068beb nodeName:}" failed. No retries permitted until 2026-09-17 11:38:52.694144836 +0000 UTC m=+18.289981217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfzf9" (UniqueName: "kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9") pod "network-check-target-59gxn" (UID: "d0bf80ee-7a43-4f75-998e-ef6be1068beb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:44.871429 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:44.871357 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:44.871671 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:44.871431 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:44.871803 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.871780 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:44.871894 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.871798 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:44.871966 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:44.871449 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:44.872133 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:44.872095 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:46.871169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:46.871069 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:46.871169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:46.871115 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:46.871169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:46.871072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:46.871756 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:46.871220 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:46.871756 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:46.871313 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:46.871756 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:46.871430 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:48.870818 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:48.870768 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:48.870818 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:48.870806 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:48.871233 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:48.870774 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:48.871233 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:48.870903 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:48.871233 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:48.870953 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:48.871233 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:48.871053 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:50.871351 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:50.871309 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:50.871833 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:50.871308 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:50.871833 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:50.871431 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:50.871833 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:50.871455 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:50.871833 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:50.871548 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:50.871833 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:50.871631 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:52.554901 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:52.554856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:52.555367 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.555003 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:52.555367 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.555079 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret podName:32e14d14-402a-433f-b533-2c283ff9ecbd nodeName:}" failed. No retries permitted until 2026-09-17 11:39:08.555059666 +0000 UTC m=+34.150896040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret") pod "global-pull-secret-syncer-jjrgw" (UID: "32e14d14-402a-433f-b533-2c283ff9ecbd") : object "kube-system"/"original-pull-secret" not registered Sep 17 11:38:52.655703 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:52.655655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:52.655887 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.655827 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:52.655972 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.655911 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs podName:a3cea07b-0f93-4d30-88db-fc3ff1783cbb nodeName:}" failed. No retries permitted until 2026-09-17 11:39:08.655890117 +0000 UTC m=+34.251726490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs") pod "network-metrics-daemon-plzr7" (UID: "a3cea07b-0f93-4d30-88db-fc3ff1783cbb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:38:52.756762 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:52.756697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:52.756924 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.756871 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 11:38:52.756924 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.756893 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 11:38:52.756924 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.756904 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gfzf9 for pod openshift-network-diagnostics/network-check-target-59gxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:52.757076 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.756972 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9 podName:d0bf80ee-7a43-4f75-998e-ef6be1068beb nodeName:}" failed. No retries permitted until 2026-09-17 11:39:08.756951823 +0000 UTC m=+34.352788203 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfzf9" (UniqueName: "kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9") pod "network-check-target-59gxn" (UID: "d0bf80ee-7a43-4f75-998e-ef6be1068beb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:38:52.874112 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:52.874033 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:52.874274 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.874125 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:52.874274 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:52.874147 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:52.874274 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:52.874171 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:52.874274 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.874260 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:52.874453 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:52.874356 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:54.876311 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:54.876269 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:54.876804 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:54.876389 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:54.876804 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:54.876402 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:54.876804 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:54.876433 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:54.876804 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:54.876522 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:54.876804 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:54.876613 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:56.876911 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:56.876640 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:56.877704 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:56.876676 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:56.877704 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:56.877022 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:56.877704 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:56.876694 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:56.877704 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:56.877093 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:56.877704 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:56.877153 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:57.074166 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.074135 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-m59b7" event={"ID":"47c11ef0-b8ae-48d8-9cd5-69f5d486f526","Type":"ContainerStarted","Data":"96e4b8c0e43de0cae83f025ee89768cdfadeaa54975bdf0f69237c31b5e53b55"} Sep 17 11:38:57.076467 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.076182 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" event={"ID":"b4546aec-8f06-435c-84fd-11331fe3c621","Type":"ContainerStarted","Data":"fe58f0515eeb7711bf4d45b067c4b7c0353445fc3f09eb3084b185e9894f345f"} Sep 17 11:38:57.078037 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.078013 2556 generic.go:356] "Generic (PLEG): container finished" podID="164f8149-052b-4c3f-a849-78ae7b6d04ef" containerID="5bb35ae07aa280681ea926a1951e437865cedf5aeab34b47c2ac4d3dffee5015" exitCode=0 Sep 17 11:38:57.078148 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.078098 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerDied","Data":"5bb35ae07aa280681ea926a1951e437865cedf5aeab34b47c2ac4d3dffee5015"} Sep 17 11:38:57.081448 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.081425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"65b846810fe5d14879fc55be1a0f8d3fae63d19ac5b620d87cdde2c98043a292"} Sep 17 11:38:57.081550 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.081502 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"94cac057f758dc20aa7e44778c9a9bbdc57fd6ae79cc055b13ec90afbadeff5e"} Sep 17 11:38:57.081664 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.081558 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"a49fee4be08eb6ae6b1766ef9fcea56b38886f6870153e1523f03f02a5d45da0"} Sep 17 11:38:57.081664 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.081607 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"a93523639c0e303387e16a586c6ddf6f927ead2c74d327ea470e56e336beaa58"} Sep 17 11:38:57.081664 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.081657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"5ad0cafcddc4d98cccf83af4803591ba19d979300e24d12fae21b6fa06e98dc9"} Sep 17 11:38:57.083106 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.083083 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2fr74" event={"ID":"f4a86886-462f-4f14-991c-1480440b7d2f","Type":"ContainerStarted","Data":"42fdf56db7ece39bc102f39367387293b24cd9f15f757a9da7a65723f93e1c80"} Sep 17 11:38:57.084563 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.084538 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" event={"ID":"81e1ce82-a776-4367-a666-e7b4c3ec6cd6","Type":"ContainerStarted","Data":"a59b09a1531fb79a15d241eb362da6ad5672e996147ec5121edc8e08d48d7d19"} Sep 17 11:38:57.086044 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.086023 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vffnr" event={"ID":"0b272b85-4330-455f-93c4-521f974e9d70","Type":"ContainerStarted","Data":"fea171efa2ee82c277a01d84fdfce3b3561da03dd8b77bf84f18b51c01ee1cd8"} Sep 17 11:38:57.087531 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.087502 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bfnx" event={"ID":"754a307f-73dd-4bcb-8c05-1aed646bd573","Type":"ContainerStarted","Data":"af25dc8bb040a9d4b5797b9aaa5a53995625aae34f80b719c0ebd4066a3d72ea"} Sep 17 11:38:57.110912 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.110862 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-m59b7" podStartSLOduration=6.9197746559999995 podStartE2EDuration="22.110845053s" totalImagesPullingTime="15.191070397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:38:57.110231207 +0000 UTC m=+22.706067588" watchObservedRunningTime="2026-09-17 11:38:57.110845053 +0000 UTC m=+22.706681435" Sep 17 11:38:57.111044 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.110972 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-219.ec2.internal" podStartSLOduration=21.110966373 podStartE2EDuration="21.110966373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:38:40.052757014 +0000 UTC m=+5.648593402" watchObservedRunningTime="2026-09-17 11:38:57.110966373 +0000 UTC m=+22.706802755" Sep 17 11:38:57.203669 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.203620 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vffnr" podStartSLOduration=3.635669661 podStartE2EDuration="22.203604314s" totalImagesPullingTime="18.567934653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:38:57.202608793 +0000 UTC m=+22.798445185" watchObservedRunningTime="2026-09-17 11:38:57.203604314 +0000 UTC m=+22.799440696" Sep 17 11:38:57.203887 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.203856 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9bfnx" podStartSLOduration=3.672683554 podStartE2EDuration="22.203842748s" totalImagesPullingTime="18.531159194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:38:57.170399509 +0000 UTC m=+22.766235891" watchObservedRunningTime="2026-09-17 11:38:57.203842748 +0000 UTC m=+22.799679130" Sep 17 11:38:57.290493 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.290433 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8dhvz" podStartSLOduration=3.755151472 podStartE2EDuration="22.290418514s" totalImagesPullingTime="18.535267042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:38:57.290180332 +0000 UTC m=+22.886016714" watchObservedRunningTime="2026-09-17 11:38:57.290418514 +0000 UTC m=+22.886254895" Sep 17 11:38:57.290681 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:57.290553 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2fr74" podStartSLOduration=3.768760286 podStartE2EDuration="22.290544419s" totalImagesPullingTime="18.521784133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:38:57.256662669 +0000 UTC m=+22.852499050" watchObservedRunningTime="2026-09-17 11:38:57.290544419 +0000 UTC m=+22.886380827" Sep 17 11:38:58.094153 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.094119 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"73f7a59f46ae51f2d450c5c31239e9f4f6e6407fcb456ae04d030a04e296a542"} Sep 17 11:38:58.095963 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.095927 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6bnhg" event={"ID":"c845f68c-3884-437d-ace1-924bbaca844b","Type":"ContainerStarted","Data":"e1d25154bee70665b030d1cabc1cdc424cd5d0ea013a4fe6db94ce488e5e042c"} Sep 17 11:38:58.280930 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.280898 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 17 11:38:58.869762 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.869628 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T11:38:58.280921947Z","UUID":"8fbc8390-df25-47c3-8334-a41b1821db1c","Handler":null,"Name":"","Endpoint":""} Sep 17 11:38:58.871233 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.871208 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 17 11:38:58.871367 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.871249 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 17 11:38:58.874810 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.874789 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:38:58.874810 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.874822 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:38:58.874995 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:58.874789 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:38:58.874995 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:58.874907 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:38:58.875095 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:58.874989 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:38:58.875095 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:38:58.875069 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:38:59.102175 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:38:59.102135 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" event={"ID":"b4546aec-8f06-435c-84fd-11331fe3c621","Type":"ContainerStarted","Data":"761f80aec861eed752f03675a93b160b95ebe52a53095115d8f9be6e72394f86"} Sep 17 11:39:00.107344 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:00.107296 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" event={"ID":"b4546aec-8f06-435c-84fd-11331fe3c621","Type":"ContainerStarted","Data":"615cb3fe432796a1fc5b163fd17e3d6334ad69247304acddbc098ee1011249e2"} Sep 17 11:39:00.117549 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:00.117515 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"fc193e3f1e509718a8022dfbc41340263ea4d0baea0025d2fda8174ed1b3854f"} Sep 17 11:39:00.133519 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:00.133457 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6bnhg" podStartSLOduration=6.610733886 podStartE2EDuration="25.133434693s" totalImagesPullingTime="18.522700807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:38:58.12680999 +0000 UTC m=+23.722646374" watchObservedRunningTime="2026-09-17 11:39:00.133434693 +0000 UTC m=+25.729271072" Sep 17 11:39:00.133868 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:00.133832 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fpt8c" podStartSLOduration=4.181062046 podStartE2EDuration="25.133821138s" totalImagesPullingTime="20.952759092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:39:00.13318431 +0000 UTC m=+25.729020715" watchObservedRunningTime="2026-09-17 11:39:00.133821138 +0000 UTC m=+25.729657520" Sep 17 11:39:00.870910 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:00.870872 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:39:00.870910 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:00.870902 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:00.871151 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:00.870905 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:00.871151 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:00.871017 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:39:00.871151 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:00.871092 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:39:00.871278 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:00.871214 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:39:01.265289 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:01.265252 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:39:01.265872 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:01.265850 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:39:02.127666 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:02.127389 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" event={"ID":"b2c0f818-8e58-49af-8633-08ae590fb1d4","Type":"ContainerStarted","Data":"fff6f39b7af09ffd2e37c93c3850496b20f09e21181f45ea98b275ca2f0486bc"} Sep 17 11:39:02.127666 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:02.127655 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:39:02.129628 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:02.129596 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerStarted","Data":"e98d70bea127f5fbd69e42ac32b2a6b88da4778be11d4c4b8f46d8ec67594af6"} Sep 17 11:39:02.144084 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:02.144045 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:39:02.175813 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:02.175712 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" podStartSLOduration=8.552381702 podStartE2EDuration="27.17569468s" totalImagesPullingTime="18.623312978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:39:02.175188601 +0000 UTC m=+27.771024987" watchObservedRunningTime="2026-09-17 11:39:02.17569468 +0000 UTC m=+27.771531061" Sep 17 11:39:02.871186 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:02.871142 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:02.871925 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:02.871148 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:39:02.871925 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:02.871265 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:39:02.871925 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:02.871280 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:02.871925 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:02.871407 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:39:02.871925 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:02.871494 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:39:03.135321 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:03.135212 2556 generic.go:356] "Generic (PLEG): container finished" podID="164f8149-052b-4c3f-a849-78ae7b6d04ef" containerID="e98d70bea127f5fbd69e42ac32b2a6b88da4778be11d4c4b8f46d8ec67594af6" exitCode=0 Sep 17 11:39:03.137150 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:03.137114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerDied","Data":"e98d70bea127f5fbd69e42ac32b2a6b88da4778be11d4c4b8f46d8ec67594af6"} Sep 17 11:39:03.137298 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:03.137180 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:39:03.137348 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:03.137311 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:39:03.165129 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:03.165101 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:39:04.031811 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:04.031608 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-59gxn"] Sep 17 11:39:04.032191 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:04.031886 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:04.032191 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:04.031966 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:39:04.037080 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:04.037057 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jjrgw"] Sep 17 11:39:04.037195 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:04.037143 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:04.037238 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:04.037221 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:39:04.038491 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:04.038471 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-plzr7"] Sep 17 11:39:04.038584 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:04.038546 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:39:04.038631 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:04.038616 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:39:04.139519 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:04.139435 2556 generic.go:356] "Generic (PLEG): container finished" podID="164f8149-052b-4c3f-a849-78ae7b6d04ef" containerID="fe092e9d41ebddc38891ac6cbf9ec93555ea6aec92b5fd03effc7eaef5faa827" exitCode=0 Sep 17 11:39:04.139651 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:04.139513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerDied","Data":"fe092e9d41ebddc38891ac6cbf9ec93555ea6aec92b5fd03effc7eaef5faa827"} Sep 17 11:39:05.144111 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:05.144060 2556 generic.go:356] "Generic (PLEG): container finished" podID="164f8149-052b-4c3f-a849-78ae7b6d04ef" containerID="fbd19652dfdc772f56a2da1adcfba03a01661401ca2643c1db38c32b7a334794" exitCode=0 Sep 17 11:39:05.144538 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:05.144146 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerDied","Data":"fbd19652dfdc772f56a2da1adcfba03a01661401ca2643c1db38c32b7a334794"} Sep 17 11:39:05.870852 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:05.870817 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:05.871010 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:05.870829 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:39:05.871010 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:05.870956 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:05.871010 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:05.870956 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:39:05.871128 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:05.871059 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:39:05.871165 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:05.871141 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:39:06.127197 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:06.127117 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:39:06.127366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:06.127275 2556 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 17 11:39:06.127949 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:06.127927 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-m59b7" Sep 17 11:39:07.871330 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:07.871107 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:39:07.871758 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:07.871148 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:07.871758 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:07.871449 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-plzr7" podUID="a3cea07b-0f93-4d30-88db-fc3ff1783cbb" Sep 17 11:39:07.871758 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:07.871477 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jjrgw" podUID="32e14d14-402a-433f-b533-2c283ff9ecbd" Sep 17 11:39:07.871758 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:07.871157 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:07.871758 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:07.871544 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-59gxn" podUID="d0bf80ee-7a43-4f75-998e-ef6be1068beb" Sep 17 11:39:08.569650 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:08.569611 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:08.569878 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:08.569805 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 17 11:39:08.569941 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:08.569887 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret podName:32e14d14-402a-433f-b533-2c283ff9ecbd nodeName:}" failed. No retries permitted until 2026-09-17 11:39:40.569866347 +0000 UTC m=+66.165702721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret") pod "global-pull-secret-syncer-jjrgw" (UID: "32e14d14-402a-433f-b533-2c283ff9ecbd") : object "kube-system"/"original-pull-secret" not registered Sep 17 11:39:08.670418 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:08.670386 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:39:08.670573 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:08.670503 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:39:08.670573 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:08.670561 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs podName:a3cea07b-0f93-4d30-88db-fc3ff1783cbb nodeName:}" failed. No retries permitted until 2026-09-17 11:39:40.670545846 +0000 UTC m=+66.266382206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs") pod "network-metrics-daemon-plzr7" (UID: "a3cea07b-0f93-4d30-88db-fc3ff1783cbb") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 17 11:39:08.771242 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:08.771198 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:08.771417 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:08.771378 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 17 11:39:08.771417 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:08.771407 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 17 11:39:08.771545 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:08.771422 2556 projected.go:196] Error preparing data for projected volume kube-api-access-gfzf9 for pod openshift-network-diagnostics/network-check-target-59gxn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:39:08.771545 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:08.771489 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9 podName:d0bf80ee-7a43-4f75-998e-ef6be1068beb nodeName:}" failed. No retries permitted until 2026-09-17 11:39:40.771472016 +0000 UTC m=+66.367308397 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gfzf9" (UniqueName: "kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9") pod "network-check-target-59gxn" (UID: "d0bf80ee-7a43-4f75-998e-ef6be1068beb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 17 11:39:09.201212 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.201182 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-219.ec2.internal" event="NodeReady" Sep 17 11:39:09.201668 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.201324 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 17 11:39:09.273462 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.273427 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dd654b5fb-ld5v2"] Sep 17 11:39:09.286928 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.286890 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.291504 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.291479 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 17 11:39:09.291646 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.291562 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 17 11:39:09.291646 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.291586 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 17 11:39:09.291942 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.291923 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvw4r\"" Sep 17 11:39:09.301291 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.301270 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 17 11:39:09.301917 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.301895 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd654b5fb-ld5v2"] Sep 17 11:39:09.332462 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.332426 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v4fch"] Sep 17 11:39:09.344629 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.344594 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.354118 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.354050 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v4fch"] Sep 17 11:39:09.359307 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.359278 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 17 11:39:09.359630 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.359610 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 17 11:39:09.366872 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.366845 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hs2cv\"" Sep 17 11:39:09.375795 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.375766 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-certificates\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.375935 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.375805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-installation-pull-secrets\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.375935 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.375845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-bound-sa-token\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.375935 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.375894 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.376105 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.375948 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-trusted-ca\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.376105 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.375987 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d2398e4-1f97-43d1-abfc-74f97ad7a888-ca-trust-extracted\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.376105 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.376002 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg5h9\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-kube-api-access-cg5h9\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.376105 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.376019 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-image-registry-private-configuration\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.397069 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.397040 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-587wt"] Sep 17 11:39:09.402887 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.402866 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-587wt" Sep 17 11:39:09.405731 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.405690 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k5pqb\"" Sep 17 11:39:09.405859 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.405695 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 17 11:39:09.405859 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.405741 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 17 11:39:09.405859 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.405740 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 17 11:39:09.411755 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.411708 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-587wt"] Sep 17 11:39:09.477042 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477004 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.477216 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477053 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-certificates\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.477216 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477076 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-installation-pull-secrets\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.477216 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477101 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1f3938a-91dd-4473-b40a-55f2ca5f5cf4-cert\") pod \"ingress-canary-587wt\" (UID: \"e1f3938a-91dd-4473-b40a-55f2ca5f5cf4\") " pod="openshift-ingress-canary/ingress-canary-587wt" Sep 17 11:39:09.477216 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477134 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-bound-sa-token\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.477423 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477239 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cccc0856-d27d-4dad-80fa-a116933e75ca-config-volume\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.477423 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477284 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvkpb\" (UniqueName: \"kubernetes.io/projected/cccc0856-d27d-4dad-80fa-a116933e75ca-kube-api-access-wvkpb\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.477423 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477320 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.477423 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-trusted-ca\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.477577 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477447 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpvsb\" (UniqueName: \"kubernetes.io/projected/e1f3938a-91dd-4473-b40a-55f2ca5f5cf4-kube-api-access-fpvsb\") pod \"ingress-canary-587wt\" (UID: \"e1f3938a-91dd-4473-b40a-55f2ca5f5cf4\") " pod="openshift-ingress-canary/ingress-canary-587wt" Sep 17 11:39:09.477577 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:09.477459 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 11:39:09.477577 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:09.477481 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd654b5fb-ld5v2: secret "image-registry-tls" not found Sep 17 11:39:09.477577 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477489 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cccc0856-d27d-4dad-80fa-a116933e75ca-tmp-dir\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.477577 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477532 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d2398e4-1f97-43d1-abfc-74f97ad7a888-ca-trust-extracted\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.477577 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:09.477563 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls podName:1d2398e4-1f97-43d1-abfc-74f97ad7a888 nodeName:}" failed. No retries permitted until 2026-09-17 11:39:09.977541932 +0000 UTC m=+35.573378309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls") pod "image-registry-dd654b5fb-ld5v2" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888") : secret "image-registry-tls" not found Sep 17 11:39:09.477912 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477584 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg5h9\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-kube-api-access-cg5h9\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.477912 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477621 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-image-registry-private-configuration\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.477912 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-certificates\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.478059 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.477942 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d2398e4-1f97-43d1-abfc-74f97ad7a888-ca-trust-extracted\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.478371 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.478352 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-trusted-ca\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.481781 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.481736 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-installation-pull-secrets\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.482434 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.482411 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-image-registry-private-configuration\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.487170 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.487148 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-bound-sa-token\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.487535 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.487509 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg5h9\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-kube-api-access-cg5h9\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.578677 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.578632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1f3938a-91dd-4473-b40a-55f2ca5f5cf4-cert\") pod \"ingress-canary-587wt\" (UID: \"e1f3938a-91dd-4473-b40a-55f2ca5f5cf4\") " pod="openshift-ingress-canary/ingress-canary-587wt" Sep 17 11:39:09.578887 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.578692 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cccc0856-d27d-4dad-80fa-a116933e75ca-config-volume\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.578887 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.578783 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkpb\" (UniqueName: \"kubernetes.io/projected/cccc0856-d27d-4dad-80fa-a116933e75ca-kube-api-access-wvkpb\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.579008 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.578888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpvsb\" (UniqueName: \"kubernetes.io/projected/e1f3938a-91dd-4473-b40a-55f2ca5f5cf4-kube-api-access-fpvsb\") pod \"ingress-canary-587wt\" (UID: \"e1f3938a-91dd-4473-b40a-55f2ca5f5cf4\") " pod="openshift-ingress-canary/ingress-canary-587wt" Sep 17 11:39:09.579008 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.578912 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cccc0856-d27d-4dad-80fa-a116933e75ca-tmp-dir\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.579008 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.578968 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.579167 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:09.579076 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 11:39:09.579167 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:09.579146 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls podName:cccc0856-d27d-4dad-80fa-a116933e75ca nodeName:}" failed. No retries permitted until 2026-09-17 11:39:10.079128261 +0000 UTC m=+35.674964635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls") pod "dns-default-v4fch" (UID: "cccc0856-d27d-4dad-80fa-a116933e75ca") : secret "dns-default-metrics-tls" not found Sep 17 11:39:09.579339 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.579313 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cccc0856-d27d-4dad-80fa-a116933e75ca-tmp-dir\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.579339 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.579329 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cccc0856-d27d-4dad-80fa-a116933e75ca-config-volume\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.581820 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.581793 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e1f3938a-91dd-4473-b40a-55f2ca5f5cf4-cert\") pod \"ingress-canary-587wt\" (UID: \"e1f3938a-91dd-4473-b40a-55f2ca5f5cf4\") " pod="openshift-ingress-canary/ingress-canary-587wt" Sep 17 11:39:09.589503 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.589478 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkpb\" (UniqueName: \"kubernetes.io/projected/cccc0856-d27d-4dad-80fa-a116933e75ca-kube-api-access-wvkpb\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:09.604487 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.604409 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpvsb\" (UniqueName: \"kubernetes.io/projected/e1f3938a-91dd-4473-b40a-55f2ca5f5cf4-kube-api-access-fpvsb\") pod \"ingress-canary-587wt\" (UID: \"e1f3938a-91dd-4473-b40a-55f2ca5f5cf4\") " pod="openshift-ingress-canary/ingress-canary-587wt" Sep 17 11:39:09.713384 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.713348 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-587wt" Sep 17 11:39:09.871333 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.871254 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:09.871503 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.871256 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:39:09.871503 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.871254 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:09.875702 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.875670 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 11:39:09.875702 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.875672 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 11:39:09.875923 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.875742 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 11:39:09.875993 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.875970 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 11:39:09.876053 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.876038 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l8fq5\"" Sep 17 11:39:09.876103 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.876053 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nrbmw\"" Sep 17 11:39:09.981802 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:09.981762 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:09.981973 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:09.981914 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 11:39:09.981973 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:09.981932 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd654b5fb-ld5v2: secret "image-registry-tls" not found Sep 17 11:39:09.982109 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:09.982004 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls podName:1d2398e4-1f97-43d1-abfc-74f97ad7a888 nodeName:}" failed. No retries permitted until 2026-09-17 11:39:10.981985944 +0000 UTC m=+36.577822322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls") pod "image-registry-dd654b5fb-ld5v2" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888") : secret "image-registry-tls" not found Sep 17 11:39:10.082828 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:10.082780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:10.083016 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:10.082962 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 11:39:10.083060 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:10.083035 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls podName:cccc0856-d27d-4dad-80fa-a116933e75ca nodeName:}" failed. No retries permitted until 2026-09-17 11:39:11.083019754 +0000 UTC m=+36.678856133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls") pod "dns-default-v4fch" (UID: "cccc0856-d27d-4dad-80fa-a116933e75ca") : secret "dns-default-metrics-tls" not found Sep 17 11:39:10.565524 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:10.565346 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-587wt"] Sep 17 11:39:10.569336 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:39:10.569296 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f3938a_91dd_4473_b40a_55f2ca5f5cf4.slice/crio-959e3f36c5a153feda0690096a1dcdc3e25d946680b2019cdbcf1abf9b4de795 WatchSource:0}: Error finding container 959e3f36c5a153feda0690096a1dcdc3e25d946680b2019cdbcf1abf9b4de795: Status 404 returned error can't find the container with id 959e3f36c5a153feda0690096a1dcdc3e25d946680b2019cdbcf1abf9b4de795 Sep 17 11:39:10.990827 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:10.990584 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:10.990827 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:10.990749 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 11:39:10.990827 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:10.990813 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd654b5fb-ld5v2: secret "image-registry-tls" not found Sep 17 11:39:10.991049 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:10.990867 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls podName:1d2398e4-1f97-43d1-abfc-74f97ad7a888 nodeName:}" failed. No retries permitted until 2026-09-17 11:39:12.990854655 +0000 UTC m=+38.586691028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls") pod "image-registry-dd654b5fb-ld5v2" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888") : secret "image-registry-tls" not found Sep 17 11:39:11.091326 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:11.091286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:11.091503 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:11.091436 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 11:39:11.091544 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:11.091507 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls podName:cccc0856-d27d-4dad-80fa-a116933e75ca nodeName:}" failed. No retries permitted until 2026-09-17 11:39:13.091490124 +0000 UTC m=+38.687326500 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls") pod "dns-default-v4fch" (UID: "cccc0856-d27d-4dad-80fa-a116933e75ca") : secret "dns-default-metrics-tls" not found Sep 17 11:39:11.164513 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:11.164477 2556 generic.go:356] "Generic (PLEG): container finished" podID="164f8149-052b-4c3f-a849-78ae7b6d04ef" containerID="fd5a4badeebf45370a954b71111180262294acb3a6eda9e06b893b2e09ddf34a" exitCode=0 Sep 17 11:39:11.164693 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:11.164545 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerDied","Data":"fd5a4badeebf45370a954b71111180262294acb3a6eda9e06b893b2e09ddf34a"} Sep 17 11:39:11.165695 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:11.165673 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-587wt" event={"ID":"e1f3938a-91dd-4473-b40a-55f2ca5f5cf4","Type":"ContainerStarted","Data":"959e3f36c5a153feda0690096a1dcdc3e25d946680b2019cdbcf1abf9b4de795"} Sep 17 11:39:12.173079 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:12.173041 2556 generic.go:356] "Generic (PLEG): container finished" podID="164f8149-052b-4c3f-a849-78ae7b6d04ef" containerID="12efd63e266c847aa5223af0d501866e383396ef3f7df51a20f3f54a66904da9" exitCode=0 Sep 17 11:39:12.173507 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:12.173111 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerDied","Data":"12efd63e266c847aa5223af0d501866e383396ef3f7df51a20f3f54a66904da9"} Sep 17 11:39:13.005615 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:13.005575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:13.005815 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:13.005707 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 11:39:13.005815 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:13.005736 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd654b5fb-ld5v2: secret "image-registry-tls" not found Sep 17 11:39:13.005815 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:13.005792 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls podName:1d2398e4-1f97-43d1-abfc-74f97ad7a888 nodeName:}" failed. No retries permitted until 2026-09-17 11:39:17.005778265 +0000 UTC m=+42.601614639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls") pod "image-registry-dd654b5fb-ld5v2" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888") : secret "image-registry-tls" not found Sep 17 11:39:13.106001 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:13.105962 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:13.106172 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:13.106117 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 11:39:13.106220 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:13.106184 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls podName:cccc0856-d27d-4dad-80fa-a116933e75ca nodeName:}" failed. No retries permitted until 2026-09-17 11:39:17.106168406 +0000 UTC m=+42.702004788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls") pod "dns-default-v4fch" (UID: "cccc0856-d27d-4dad-80fa-a116933e75ca") : secret "dns-default-metrics-tls" not found Sep 17 11:39:13.179327 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:13.179284 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-96gd9" event={"ID":"164f8149-052b-4c3f-a849-78ae7b6d04ef","Type":"ContainerStarted","Data":"d59408bf05e0cad77844aa14974e1aaea5d2cff5597a1b5e207ebe7565c8ea64"} Sep 17 11:39:13.209123 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:13.209063 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-96gd9" podStartSLOduration=8.183944327 podStartE2EDuration="38.209046011s" totalImagesPullingTime="30.025101684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:39:13.207701147 +0000 UTC m=+38.803537538" watchObservedRunningTime="2026-09-17 11:39:13.209046011 +0000 UTC m=+38.804882393" Sep 17 11:39:14.183229 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:14.183182 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-587wt" event={"ID":"e1f3938a-91dd-4473-b40a-55f2ca5f5cf4","Type":"ContainerStarted","Data":"df5aff2db9c59e37101e374933614eb0d21688bbf931c113d34fac9190549151"} Sep 17 11:39:14.218454 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:14.218404 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-587wt" podStartSLOduration=2.560565436 podStartE2EDuration="5.218389537s" totalImagesPullingTime="2.657824101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:39:14.215689129 +0000 UTC m=+39.811525510" watchObservedRunningTime="2026-09-17 11:39:14.218389537 +0000 UTC m=+39.814225918" Sep 17 11:39:17.033022 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:17.032983 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:17.033386 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:17.033115 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 11:39:17.033386 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:17.033128 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd654b5fb-ld5v2: secret "image-registry-tls" not found Sep 17 11:39:17.033386 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:17.033180 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls podName:1d2398e4-1f97-43d1-abfc-74f97ad7a888 nodeName:}" failed. No retries permitted until 2026-09-17 11:39:25.033165677 +0000 UTC m=+50.629002050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls") pod "image-registry-dd654b5fb-ld5v2" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888") : secret "image-registry-tls" not found Sep 17 11:39:17.133978 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:17.133943 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:17.134120 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:17.134100 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 11:39:17.134175 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:17.134168 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls podName:cccc0856-d27d-4dad-80fa-a116933e75ca nodeName:}" failed. No retries permitted until 2026-09-17 11:39:25.134154128 +0000 UTC m=+50.729990501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls") pod "dns-default-v4fch" (UID: "cccc0856-d27d-4dad-80fa-a116933e75ca") : secret "dns-default-metrics-tls" not found Sep 17 11:39:25.095158 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:25.095118 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:25.095588 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:25.095273 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 11:39:25.095588 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:25.095292 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd654b5fb-ld5v2: secret "image-registry-tls" not found Sep 17 11:39:25.095588 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:25.095362 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls podName:1d2398e4-1f97-43d1-abfc-74f97ad7a888 nodeName:}" failed. No retries permitted until 2026-09-17 11:39:41.095346319 +0000 UTC m=+66.691182693 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls") pod "image-registry-dd654b5fb-ld5v2" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888") : secret "image-registry-tls" not found Sep 17 11:39:25.196225 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:25.196182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:25.196403 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:25.196330 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 11:39:25.196403 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:25.196394 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls podName:cccc0856-d27d-4dad-80fa-a116933e75ca nodeName:}" failed. No retries permitted until 2026-09-17 11:39:41.196380517 +0000 UTC m=+66.792216903 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls") pod "dns-default-v4fch" (UID: "cccc0856-d27d-4dad-80fa-a116933e75ca") : secret "dns-default-metrics-tls" not found Sep 17 11:39:35.155434 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:35.155403 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dtdhb" Sep 17 11:39:40.605931 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.605885 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:40.611347 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.611321 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 17 11:39:40.620682 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.620653 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/32e14d14-402a-433f-b533-2c283ff9ecbd-original-pull-secret\") pod \"global-pull-secret-syncer-jjrgw\" (UID: \"32e14d14-402a-433f-b533-2c283ff9ecbd\") " pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:40.707030 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.706989 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:39:40.709826 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.709807 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 17 11:39:40.718136 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:40.718116 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 17 11:39:40.718227 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:40.718174 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs podName:a3cea07b-0f93-4d30-88db-fc3ff1783cbb nodeName:}" failed. No retries permitted until 2026-09-17 11:40:44.718157625 +0000 UTC m=+130.313993989 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs") pod "network-metrics-daemon-plzr7" (UID: "a3cea07b-0f93-4d30-88db-fc3ff1783cbb") : secret "metrics-daemon-secret" not found Sep 17 11:39:40.795357 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.795315 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jjrgw" Sep 17 11:39:40.807833 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.807797 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:40.810943 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.810925 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 17 11:39:40.820443 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.820425 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 17 11:39:40.830699 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:40.830677 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfzf9\" (UniqueName: \"kubernetes.io/projected/d0bf80ee-7a43-4f75-998e-ef6be1068beb-kube-api-access-gfzf9\") pod \"network-check-target-59gxn\" (UID: \"d0bf80ee-7a43-4f75-998e-ef6be1068beb\") " pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:41.085860 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:41.085831 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nrbmw\"" Sep 17 11:39:41.093327 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:41.093267 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jjrgw"] Sep 17 11:39:41.093327 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:41.093284 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:41.097088 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:39:41.097065 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32e14d14_402a_433f_b533_2c283ff9ecbd.slice/crio-d3501cb105092130f05ef315e4ab68a5aea4fe91a6e3c0cb191846f770f5c125 WatchSource:0}: Error finding container d3501cb105092130f05ef315e4ab68a5aea4fe91a6e3c0cb191846f770f5c125: Status 404 returned error can't find the container with id d3501cb105092130f05ef315e4ab68a5aea4fe91a6e3c0cb191846f770f5c125 Sep 17 11:39:41.110906 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:41.110888 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:39:41.110991 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:41.110983 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 17 11:39:41.111041 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:41.110995 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dd654b5fb-ld5v2: secret "image-registry-tls" not found Sep 17 11:39:41.111078 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:41.111048 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls podName:1d2398e4-1f97-43d1-abfc-74f97ad7a888 nodeName:}" failed. No retries permitted until 2026-09-17 11:40:13.111032545 +0000 UTC m=+98.706868923 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls") pod "image-registry-dd654b5fb-ld5v2" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888") : secret "image-registry-tls" not found Sep 17 11:39:41.211301 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:41.211263 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:39:41.211466 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:41.211430 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 17 11:39:41.211505 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:41.211499 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls podName:cccc0856-d27d-4dad-80fa-a116933e75ca nodeName:}" failed. No retries permitted until 2026-09-17 11:40:13.211481019 +0000 UTC m=+98.807317396 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls") pod "dns-default-v4fch" (UID: "cccc0856-d27d-4dad-80fa-a116933e75ca") : secret "dns-default-metrics-tls" not found Sep 17 11:39:41.248653 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:41.248619 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jjrgw" event={"ID":"32e14d14-402a-433f-b533-2c283ff9ecbd","Type":"ContainerStarted","Data":"d3501cb105092130f05ef315e4ab68a5aea4fe91a6e3c0cb191846f770f5c125"} Sep 17 11:39:41.386440 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:41.386352 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-59gxn"] Sep 17 11:39:41.389827 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:39:41.389799 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bf80ee_7a43_4f75_998e_ef6be1068beb.slice/crio-5b6676472e0e0574b091f75a146bc91b81b9c8c6259fa3c7b2e6d3c6ab55212f WatchSource:0}: Error finding container 5b6676472e0e0574b091f75a146bc91b81b9c8c6259fa3c7b2e6d3c6ab55212f: Status 404 returned error can't find the container with id 5b6676472e0e0574b091f75a146bc91b81b9c8c6259fa3c7b2e6d3c6ab55212f Sep 17 11:39:42.253334 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:42.253257 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-59gxn" event={"ID":"d0bf80ee-7a43-4f75-998e-ef6be1068beb","Type":"ContainerStarted","Data":"5b6676472e0e0574b091f75a146bc91b81b9c8c6259fa3c7b2e6d3c6ab55212f"} Sep 17 11:39:44.159205 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.159171 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-krpbp"] Sep 17 11:39:44.162100 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.162081 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.165415 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.165391 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 17 11:39:44.165530 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.165500 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 17 11:39:44.166443 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.166423 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qklrf\"" Sep 17 11:39:44.166537 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.166473 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 17 11:39:44.166687 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.166596 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 17 11:39:44.182899 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.182867 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krpbp"] Sep 17 11:39:44.232117 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.232082 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.232306 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.232126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1a1d44f-108e-48e0-9a94-553e4d1e512c-crio-socket\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.232306 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.232236 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2kf\" (UniqueName: \"kubernetes.io/projected/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-api-access-kd2kf\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.232427 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.232303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1a1d44f-108e-48e0-9a94-553e4d1e512c-data-volume\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.232427 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.232328 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.332799 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.332766 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.332799 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.332812 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1a1d44f-108e-48e0-9a94-553e4d1e512c-crio-socket\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.333044 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.332890 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2kf\" (UniqueName: \"kubernetes.io/projected/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-api-access-kd2kf\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.333044 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.332941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1a1d44f-108e-48e0-9a94-553e4d1e512c-data-volume\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.333044 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.332970 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a1a1d44f-108e-48e0-9a94-553e4d1e512c-crio-socket\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.333044 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:44.333030 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 11:39:44.333243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.333078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.333243 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:44.333111 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:44.833089948 +0000 UTC m=+70.428926334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : secret "insights-runtime-extractor-tls" not found Sep 17 11:39:44.333243 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:44.333139 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 11:39:44.333243 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:44.333197 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:44.8331864 +0000 UTC m=+70.429022779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : configmap "kube-rbac-proxy" not found Sep 17 11:39:44.333441 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.333253 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1a1d44f-108e-48e0-9a94-553e4d1e512c-data-volume\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.345092 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.345067 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2kf\" (UniqueName: \"kubernetes.io/projected/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-api-access-kd2kf\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.836535 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.836489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.836737 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:44.836546 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:44.836737 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:44.836632 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 11:39:44.836737 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:44.836678 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 11:39:44.836876 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:44.836764 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:45.836735761 +0000 UTC m=+71.432572141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : configmap "kube-rbac-proxy" not found Sep 17 11:39:44.836876 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:44.836791 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:45.836778728 +0000 UTC m=+71.432615105 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : secret "insights-runtime-extractor-tls" not found Sep 17 11:39:45.846093 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:45.846058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:45.846580 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:45.846115 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:45.846580 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:45.846205 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 11:39:45.846580 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:45.846290 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 11:39:45.846580 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:45.846294 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:47.846273723 +0000 UTC m=+73.442110104 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : configmap "kube-rbac-proxy" not found Sep 17 11:39:45.846580 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:45.846368 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:47.846350409 +0000 UTC m=+73.442186776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : secret "insights-runtime-extractor-tls" not found Sep 17 11:39:45.914328 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:45.914294 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2fr74_f4a86886-462f-4f14-991c-1480440b7d2f/dns-node-resolver/0.log" Sep 17 11:39:46.266671 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:46.266625 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jjrgw" event={"ID":"32e14d14-402a-433f-b533-2c283ff9ecbd","Type":"ContainerStarted","Data":"286251b99ddc190a8981e61e13ab9fb20a5b3378e70c43a2edc00f109e01a686"} Sep 17 11:39:46.268136 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:46.268110 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-59gxn" event={"ID":"d0bf80ee-7a43-4f75-998e-ef6be1068beb","Type":"ContainerStarted","Data":"1eda2ddaebba7dcf517072ee52e66979f1a46d5c8b77b3b696b327e3871a835e"} Sep 17 11:39:46.268269 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:46.268253 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:39:46.285753 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:46.285689 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jjrgw" podStartSLOduration=66.270347159 podStartE2EDuration="1m11.285672037s" totalImagesPullingTime="5.015324878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:39:46.284684648 +0000 UTC m=+71.880521047" watchObservedRunningTime="2026-09-17 11:39:46.285672037 +0000 UTC m=+71.881508416" Sep 17 11:39:46.308499 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:46.308446 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-59gxn" podStartSLOduration=66.591305959 podStartE2EDuration="1m11.308430201s" totalImagesPullingTime="4.717124242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:39:46.307973102 +0000 UTC m=+71.903809484" watchObservedRunningTime="2026-09-17 11:39:46.308430201 +0000 UTC m=+71.904266584" Sep 17 11:39:46.712225 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:46.712201 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bfnx_754a307f-73dd-4bcb-8c05-1aed646bd573/node-ca/0.log" Sep 17 11:39:47.512654 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:47.512625 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-587wt_e1f3938a-91dd-4473-b40a-55f2ca5f5cf4/serve-healthcheck-canary/0.log" Sep 17 11:39:47.862800 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:47.862695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:47.862800 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:47.862759 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:47.862993 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:47.862819 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 11:39:47.862993 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:47.862854 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 11:39:47.862993 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:47.862882 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:51.862867771 +0000 UTC m=+77.458704150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : configmap "kube-rbac-proxy" not found Sep 17 11:39:47.862993 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:47.862899 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:51.862888498 +0000 UTC m=+77.458724859 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : secret "insights-runtime-extractor-tls" not found Sep 17 11:39:51.892252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:51.892200 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:51.892252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:51.892255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:51.892796 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:51.892350 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 11:39:51.892796 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:51.892347 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 17 11:39:51.892796 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:51.892416 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:59.892400889 +0000 UTC m=+85.488237249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : secret "insights-runtime-extractor-tls" not found Sep 17 11:39:51.892796 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:51.892446 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:39:59.892424889 +0000 UTC m=+85.488261264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : configmap "kube-rbac-proxy" not found Sep 17 11:39:57.095598 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.095481 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-chlrg"] Sep 17 11:39:57.098475 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.098458 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.101876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.101853 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 17 11:39:57.101995 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.101928 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 17 11:39:57.103069 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.103050 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 17 11:39:57.103139 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.103064 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bffrn\"" Sep 17 11:39:57.103139 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.103087 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 17 11:39:57.108262 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.108237 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-chlrg"] Sep 17 11:39:57.132646 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.132615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79gxn\" (UniqueName: \"kubernetes.io/projected/acd61057-91f9-47dc-99b7-b8b9a1121762-kube-api-access-79gxn\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.132783 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.132678 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acd61057-91f9-47dc-99b7-b8b9a1121762-signing-key\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.132783 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.132742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acd61057-91f9-47dc-99b7-b8b9a1121762-signing-cabundle\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.233896 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.233855 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79gxn\" (UniqueName: \"kubernetes.io/projected/acd61057-91f9-47dc-99b7-b8b9a1121762-kube-api-access-79gxn\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.234090 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.233953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acd61057-91f9-47dc-99b7-b8b9a1121762-signing-key\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.234090 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.233983 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acd61057-91f9-47dc-99b7-b8b9a1121762-signing-cabundle\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.234660 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.234633 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/acd61057-91f9-47dc-99b7-b8b9a1121762-signing-cabundle\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.236594 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.236575 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/acd61057-91f9-47dc-99b7-b8b9a1121762-signing-key\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.244819 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.244797 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79gxn\" (UniqueName: \"kubernetes.io/projected/acd61057-91f9-47dc-99b7-b8b9a1121762-kube-api-access-79gxn\") pod \"service-ca-568869fdc5-chlrg\" (UID: \"acd61057-91f9-47dc-99b7-b8b9a1121762\") " pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.407117 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.407009 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-chlrg" Sep 17 11:39:57.684958 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:57.684872 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-chlrg"] Sep 17 11:39:57.688924 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:39:57.688897 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd61057_91f9_47dc_99b7_b8b9a1121762.slice/crio-4ba61789e4cb5007cf7da88aca421421b7c8a7974f09becf6e07ec54b07be6d3 WatchSource:0}: Error finding container 4ba61789e4cb5007cf7da88aca421421b7c8a7974f09becf6e07ec54b07be6d3: Status 404 returned error can't find the container with id 4ba61789e4cb5007cf7da88aca421421b7c8a7974f09becf6e07ec54b07be6d3 Sep 17 11:39:58.299059 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:58.299017 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-chlrg" event={"ID":"acd61057-91f9-47dc-99b7-b8b9a1121762","Type":"ContainerStarted","Data":"4ba61789e4cb5007cf7da88aca421421b7c8a7974f09becf6e07ec54b07be6d3"} Sep 17 11:39:59.955834 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:59.955790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:59.955834 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:59.955843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:39:59.956405 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:59.955977 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 17 11:39:59.956405 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:39:59.956078 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls podName:a1a1d44f-108e-48e0-9a94-553e4d1e512c nodeName:}" failed. No retries permitted until 2026-09-17 11:40:15.95605726 +0000 UTC m=+101.551893641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-krpbp" (UID: "a1a1d44f-108e-48e0-9a94-553e4d1e512c") : secret "insights-runtime-extractor-tls" not found Sep 17 11:39:59.956542 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:39:59.956514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a1a1d44f-108e-48e0-9a94-553e4d1e512c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:40:00.306295 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:00.306255 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-chlrg" event={"ID":"acd61057-91f9-47dc-99b7-b8b9a1121762","Type":"ContainerStarted","Data":"98b8b98bf9926b450bf83c5108f53529a9eaa8349b88147099db376bf09b855a"} Sep 17 11:40:00.327491 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:00.327441 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-chlrg" podStartSLOduration=1.51497144 podStartE2EDuration="3.327425106s" totalImagesPullingTime="1.812453666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:00.326208924 +0000 UTC m=+85.922045307" watchObservedRunningTime="2026-09-17 11:40:00.327425106 +0000 UTC m=+85.923261488" Sep 17 11:40:13.162977 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.162940 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:40:13.165313 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.165283 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"image-registry-dd654b5fb-ld5v2\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:40:13.201264 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.201239 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mvw4r\"" Sep 17 11:40:13.208450 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.208429 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:40:13.263787 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.263760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:40:13.266439 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.266416 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cccc0856-d27d-4dad-80fa-a116933e75ca-metrics-tls\") pod \"dns-default-v4fch\" (UID: \"cccc0856-d27d-4dad-80fa-a116933e75ca\") " pod="openshift-dns/dns-default-v4fch" Sep 17 11:40:13.492878 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.492791 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd654b5fb-ld5v2"] Sep 17 11:40:13.496638 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:13.496609 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2398e4_1f97_43d1_abfc_74f97ad7a888.slice/crio-6fdc9a26d55c66f682639b2ee9f4cdaf2ec157725dc9c3664e7295c5e230eb06 WatchSource:0}: Error finding container 6fdc9a26d55c66f682639b2ee9f4cdaf2ec157725dc9c3664e7295c5e230eb06: Status 404 returned error can't find the container with id 6fdc9a26d55c66f682639b2ee9f4cdaf2ec157725dc9c3664e7295c5e230eb06 Sep 17 11:40:13.559161 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.559133 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hs2cv\"" Sep 17 11:40:13.566966 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.566944 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v4fch" Sep 17 11:40:13.843970 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:13.843938 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v4fch"] Sep 17 11:40:13.846890 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:13.846859 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcccc0856_d27d_4dad_80fa_a116933e75ca.slice/crio-76053e6be9c42c8e5873c04684d4ad81ee585d6bbdc7a6b589ef5fafe4df7381 WatchSource:0}: Error finding container 76053e6be9c42c8e5873c04684d4ad81ee585d6bbdc7a6b589ef5fafe4df7381: Status 404 returned error can't find the container with id 76053e6be9c42c8e5873c04684d4ad81ee585d6bbdc7a6b589ef5fafe4df7381 Sep 17 11:40:14.343328 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:14.343286 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" event={"ID":"1d2398e4-1f97-43d1-abfc-74f97ad7a888","Type":"ContainerStarted","Data":"185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f"} Sep 17 11:40:14.343779 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:14.343345 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" event={"ID":"1d2398e4-1f97-43d1-abfc-74f97ad7a888","Type":"ContainerStarted","Data":"6fdc9a26d55c66f682639b2ee9f4cdaf2ec157725dc9c3664e7295c5e230eb06"} Sep 17 11:40:14.343779 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:14.343463 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:40:14.344490 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:14.344465 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v4fch" event={"ID":"cccc0856-d27d-4dad-80fa-a116933e75ca","Type":"ContainerStarted","Data":"76053e6be9c42c8e5873c04684d4ad81ee585d6bbdc7a6b589ef5fafe4df7381"} Sep 17 11:40:14.373503 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:14.373442 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" podStartSLOduration=99.373425229 podStartE2EDuration="1m39.373425229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:14.372671948 +0000 UTC m=+99.968508355" watchObservedRunningTime="2026-09-17 11:40:14.373425229 +0000 UTC m=+99.969261611" Sep 17 11:40:15.986375 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:15.986280 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:40:15.988799 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:15.988779 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a1a1d44f-108e-48e0-9a94-553e4d1e512c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krpbp\" (UID: \"a1a1d44f-108e-48e0-9a94-553e4d1e512c\") " pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:40:16.273064 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:16.273032 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krpbp" Sep 17 11:40:16.354323 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:16.354281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v4fch" event={"ID":"cccc0856-d27d-4dad-80fa-a116933e75ca","Type":"ContainerStarted","Data":"27d99bbdeda899386f22ce8b67402193637fa9da2f6a1d5e3a04698a3ceaac5d"} Sep 17 11:40:16.354455 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:16.354341 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v4fch" event={"ID":"cccc0856-d27d-4dad-80fa-a116933e75ca","Type":"ContainerStarted","Data":"f02b313859977940b6d897d2e4deff0a54ef89311f4170fb8ead78234be8f924"} Sep 17 11:40:16.354455 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:16.354382 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v4fch" Sep 17 11:40:16.376456 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:16.376400 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v4fch" podStartSLOduration=65.631310728 podStartE2EDuration="1m7.376385052s" totalImagesPullingTime="1.745074324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:39:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:16.375778633 +0000 UTC m=+101.971615015" watchObservedRunningTime="2026-09-17 11:40:16.376385052 +0000 UTC m=+101.972221433" Sep 17 11:40:16.550545 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:16.550468 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krpbp"] Sep 17 11:40:16.554217 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:16.554187 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a1d44f_108e_48e0_9a94_553e4d1e512c.slice/crio-9186f52be6f544a26442b415b63e8ba9a112bb5fd943b8014c305cb93a0cf401 WatchSource:0}: Error finding container 9186f52be6f544a26442b415b63e8ba9a112bb5fd943b8014c305cb93a0cf401: Status 404 returned error can't find the container with id 9186f52be6f544a26442b415b63e8ba9a112bb5fd943b8014c305cb93a0cf401 Sep 17 11:40:17.273508 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:17.273478 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-59gxn" Sep 17 11:40:17.358889 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:17.358848 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krpbp" event={"ID":"a1a1d44f-108e-48e0-9a94-553e4d1e512c","Type":"ContainerStarted","Data":"c4e8d02548295750eecacc2bea95faaa504742f994d75f14d19b16f7fb53446b"} Sep 17 11:40:17.359047 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:17.358916 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krpbp" event={"ID":"a1a1d44f-108e-48e0-9a94-553e4d1e512c","Type":"ContainerStarted","Data":"f26a4b3c62f3154922ad4138619a89397eee8dfa7732122b9648a747d7e9c5f5"} Sep 17 11:40:17.359047 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:17.358945 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krpbp" event={"ID":"a1a1d44f-108e-48e0-9a94-553e4d1e512c","Type":"ContainerStarted","Data":"9186f52be6f544a26442b415b63e8ba9a112bb5fd943b8014c305cb93a0cf401"} Sep 17 11:40:19.370939 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:19.370904 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krpbp" event={"ID":"a1a1d44f-108e-48e0-9a94-553e4d1e512c","Type":"ContainerStarted","Data":"25d035efb349f77e99c28f4a50bd1c4abab720572e045f330ca1ea145894688c"} Sep 17 11:40:19.391979 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:19.391922 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-krpbp" podStartSLOduration=33.493196601 podStartE2EDuration="35.391884059s" totalImagesPullingTime="1.898687458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 11:39:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:19.390941054 +0000 UTC m=+104.986777436" watchObservedRunningTime="2026-09-17 11:40:19.391884059 +0000 UTC m=+104.987720438" Sep 17 11:40:20.667658 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.667628 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj"] Sep 17 11:40:20.713001 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.712972 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4"] Sep 17 11:40:20.713172 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.713108 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" Sep 17 11:40:20.716074 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.716050 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 17 11:40:20.716205 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.716187 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 17 11:40:20.716699 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.716680 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9rjd6\"" Sep 17 11:40:20.736811 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.736787 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj"] Sep 17 11:40:20.736909 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.736821 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4"] Sep 17 11:40:20.736909 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.736900 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.746187 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.746169 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 17 11:40:20.748366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.748346 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 17 11:40:20.750021 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.750003 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 17 11:40:20.750102 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.750010 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 17 11:40:20.753469 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.753453 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 17 11:40:20.753764 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.753749 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 17 11:40:20.753764 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.753759 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 17 11:40:20.826148 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.826114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqszz\" (UniqueName: \"kubernetes.io/projected/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-kube-api-access-nqszz\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.826148 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.826148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.826341 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.826173 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-ca\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.826341 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.826189 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.826341 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.826237 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-additional-service-ca\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.826341 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.826272 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-hub\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.826341 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.826315 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92239a79-33e8-49fb-8e42-ed615400f0f6-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4jhtj\" (UID: \"92239a79-33e8-49fb-8e42-ed615400f0f6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" Sep 17 11:40:20.826494 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.826339 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92239a79-33e8-49fb-8e42-ed615400f0f6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4jhtj\" (UID: \"92239a79-33e8-49fb-8e42-ed615400f0f6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" Sep 17 11:40:20.927034 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.926953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-additional-service-ca\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.927034 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.926986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-hub\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.927034 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.927020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92239a79-33e8-49fb-8e42-ed615400f0f6-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4jhtj\" (UID: \"92239a79-33e8-49fb-8e42-ed615400f0f6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" Sep 17 11:40:20.927296 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.927037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92239a79-33e8-49fb-8e42-ed615400f0f6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4jhtj\" (UID: \"92239a79-33e8-49fb-8e42-ed615400f0f6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" Sep 17 11:40:20.927296 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.927086 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqszz\" (UniqueName: \"kubernetes.io/projected/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-kube-api-access-nqszz\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.927296 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.927113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.927448 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.927294 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-ca\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.927582 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.927557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.927902 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.927866 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-additional-service-ca\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.928061 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.928030 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/92239a79-33e8-49fb-8e42-ed615400f0f6-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-4jhtj\" (UID: \"92239a79-33e8-49fb-8e42-ed615400f0f6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" Sep 17 11:40:20.929940 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.929916 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/92239a79-33e8-49fb-8e42-ed615400f0f6-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-4jhtj\" (UID: \"92239a79-33e8-49fb-8e42-ed615400f0f6\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" Sep 17 11:40:20.930042 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.929909 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-ca\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.930152 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.930133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.930221 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.930205 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-hub\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.930295 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.930274 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:20.937523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:20.937501 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqszz\" (UniqueName: \"kubernetes.io/projected/8d0f625e-65a2-4f9b-85cc-53f4c75e5906-kube-api-access-nqszz\") pod \"cluster-proxy-proxy-agent-658969cdb-kqwj4\" (UID: \"8d0f625e-65a2-4f9b-85cc-53f4c75e5906\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:21.021296 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:21.021263 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" Sep 17 11:40:21.052607 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:21.052577 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" Sep 17 11:40:21.313517 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:21.313494 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj"] Sep 17 11:40:21.315218 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:21.315187 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92239a79_33e8_49fb_8e42_ed615400f0f6.slice/crio-3f44cc042853c82ef64ac12082ea7e306499fcecd0ff3993968267bbe314df73 WatchSource:0}: Error finding container 3f44cc042853c82ef64ac12082ea7e306499fcecd0ff3993968267bbe314df73: Status 404 returned error can't find the container with id 3f44cc042853c82ef64ac12082ea7e306499fcecd0ff3993968267bbe314df73 Sep 17 11:40:21.351239 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:21.351216 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4"] Sep 17 11:40:21.353363 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:21.353340 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d0f625e_65a2_4f9b_85cc_53f4c75e5906.slice/crio-d70477fe211c83806fd14723ed1dadd76f0c59085dccf32b1ce6844c0df2ebf5 WatchSource:0}: Error finding container d70477fe211c83806fd14723ed1dadd76f0c59085dccf32b1ce6844c0df2ebf5: Status 404 returned error can't find the container with id d70477fe211c83806fd14723ed1dadd76f0c59085dccf32b1ce6844c0df2ebf5 Sep 17 11:40:21.377507 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:21.377470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" event={"ID":"8d0f625e-65a2-4f9b-85cc-53f4c75e5906","Type":"ContainerStarted","Data":"d70477fe211c83806fd14723ed1dadd76f0c59085dccf32b1ce6844c0df2ebf5"} Sep 17 11:40:21.378581 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:21.378558 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" event={"ID":"92239a79-33e8-49fb-8e42-ed615400f0f6","Type":"ContainerStarted","Data":"3f44cc042853c82ef64ac12082ea7e306499fcecd0ff3993968267bbe314df73"} Sep 17 11:40:23.193292 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.193213 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2"] Sep 17 11:40:23.196844 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.196821 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.200188 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.200142 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 17 11:40:23.201267 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.201214 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 17 11:40:23.201267 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.201260 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 17 11:40:23.201821 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.201434 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 17 11:40:23.201821 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.201449 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 17 11:40:23.201821 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.201660 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-4tv59\"" Sep 17 11:40:23.217108 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.212856 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2"] Sep 17 11:40:23.350291 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.350034 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.350291 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.350100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8dnz\" (UniqueName: \"kubernetes.io/projected/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-kube-api-access-s8dnz\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.350291 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.350136 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.350291 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.350167 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.387863 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.387819 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" event={"ID":"92239a79-33e8-49fb-8e42-ed615400f0f6","Type":"ContainerStarted","Data":"a83ae5eede196969b3c72d1aac5fa8ac901fdc45b06a11739aadf86611740e0c"} Sep 17 11:40:23.408016 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.407833 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-4jhtj" podStartSLOduration=1.9514515540000001 podStartE2EDuration="3.407810703s" totalImagesPullingTime="1.456359149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:23.406349071 +0000 UTC m=+109.002185456" watchObservedRunningTime="2026-09-17 11:40:23.407810703 +0000 UTC m=+109.003647103" Sep 17 11:40:23.451521 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.450854 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.451521 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.450965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.451521 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.451009 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8dnz\" (UniqueName: \"kubernetes.io/projected/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-kube-api-access-s8dnz\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.451521 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.451037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.451521 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:23.451140 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 17 11:40:23.451521 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:23.451214 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-tls podName:8d7f7d6e-4568-435b-8fba-6b509cb24a4a nodeName:}" failed. No retries permitted until 2026-09-17 11:40:23.951193589 +0000 UTC m=+109.547029972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-tls") pod "prometheus-operator-68bcd7f987-gsdt2" (UID: "8d7f7d6e-4568-435b-8fba-6b509cb24a4a") : secret "prometheus-operator-tls" not found Sep 17 11:40:23.452602 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.452530 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.456273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.456173 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.461920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.461875 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8dnz\" (UniqueName: \"kubernetes.io/projected/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-kube-api-access-s8dnz\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.956300 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.956265 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:23.959226 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:23.959199 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d7f7d6e-4568-435b-8fba-6b509cb24a4a-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-gsdt2\" (UID: \"8d7f7d6e-4568-435b-8fba-6b509cb24a4a\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:24.112475 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:24.112438 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" Sep 17 11:40:24.672643 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:24.672552 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2"] Sep 17 11:40:25.645320 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:25.645282 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d7f7d6e_4568_435b_8fba_6b509cb24a4a.slice/crio-860f52adc60593243d0bd1385d65385b7d19040e4802219b89a321f4e2c3c381 WatchSource:0}: Error finding container 860f52adc60593243d0bd1385d65385b7d19040e4802219b89a321f4e2c3c381: Status 404 returned error can't find the container with id 860f52adc60593243d0bd1385d65385b7d19040e4802219b89a321f4e2c3c381 Sep 17 11:40:26.362208 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:26.362170 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v4fch" Sep 17 11:40:26.406626 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:26.404599 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" event={"ID":"8d7f7d6e-4568-435b-8fba-6b509cb24a4a","Type":"ContainerStarted","Data":"860f52adc60593243d0bd1385d65385b7d19040e4802219b89a321f4e2c3c381"} Sep 17 11:40:26.407537 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:26.407499 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" event={"ID":"8d0f625e-65a2-4f9b-85cc-53f4c75e5906","Type":"ContainerStarted","Data":"9a5de5244f0d7a7a1fb663691ee2cc0aa3fe3313adaaf2f89f10ad22e8986df5"} Sep 17 11:40:26.407669 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:26.407551 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" event={"ID":"8d0f625e-65a2-4f9b-85cc-53f4c75e5906","Type":"ContainerStarted","Data":"d4e8d780a681befdfaebc86f7a730849e000158504c275e10cc1112046529b50"} Sep 17 11:40:26.407669 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:26.407573 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" event={"ID":"8d0f625e-65a2-4f9b-85cc-53f4c75e5906","Type":"ContainerStarted","Data":"9e94a75f507170d4100c7d2b09aa831819e9843717389462afe405b2b1b8970b"} Sep 17 11:40:26.434382 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:26.434328 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-658969cdb-kqwj4" podStartSLOduration=2.079924875 podStartE2EDuration="6.434307419s" totalImagesPullingTime="4.354382544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:26.43350094 +0000 UTC m=+112.029337332" watchObservedRunningTime="2026-09-17 11:40:26.434307419 +0000 UTC m=+112.030143800" Sep 17 11:40:27.412881 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:27.412843 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" event={"ID":"8d7f7d6e-4568-435b-8fba-6b509cb24a4a","Type":"ContainerStarted","Data":"f32b7518a7ccf9ce87be931778d50f93c5d4d8c4b7664455ce2b74fe7ae14e0f"} Sep 17 11:40:27.413298 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:27.412901 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" event={"ID":"8d7f7d6e-4568-435b-8fba-6b509cb24a4a","Type":"ContainerStarted","Data":"8d31811c0fae344998af7652fe675756f2be7093846d88547135a701aa0e10bf"} Sep 17 11:40:27.442214 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:27.442156 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-gsdt2" podStartSLOduration=3.111740302 podStartE2EDuration="4.442140679s" totalImagesPullingTime="1.330400377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:27.440629565 +0000 UTC m=+113.036465960" watchObservedRunningTime="2026-09-17 11:40:27.442140679 +0000 UTC m=+113.037977060" Sep 17 11:40:29.834355 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:29.834317 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gvjvw"] Sep 17 11:40:29.837661 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:29.837639 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:29.840693 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:29.840663 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-gvjvw\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" podUID="aceb5d44-7cd3-4fd7-9ae5-2f0471cae541" pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:29.841034 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:29.841004 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-bphnw\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bphnw\"" type="*v1.Secret" Sep 17 11:40:29.841152 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:29.841029 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Sep 17 11:40:29.841152 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:29.841046 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" Sep 17 11:40:29.841477 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:29.841449 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Sep 17 11:40:30.007775 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.007707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kth8z\" (UniqueName: \"kubernetes.io/projected/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-kube-api-access-kth8z\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.007973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.007799 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-root\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.007973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.007824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-wtmp\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.007973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.007878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-sys\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.007973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.007903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-textfile\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.007973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.007946 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-metrics-client-ca\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.008217 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.007977 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.008217 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.008036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.008217 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.008090 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-tls\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109331 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109232 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-sys\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109331 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-textfile\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109331 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109316 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-metrics-client-ca\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109587 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109345 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-sys\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109587 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109348 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109587 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109587 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109466 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-tls\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109587 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109520 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kth8z\" (UniqueName: \"kubernetes.io/projected/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-kube-api-access-kth8z\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109587 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-root\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109587 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109576 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-wtmp\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109944 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109638 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-root\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109944 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109684 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-textfile\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.109944 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.109748 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-wtmp\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.110087 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.110011 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-metrics-client-ca\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.120893 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.120869 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kth8z\" (UniqueName: \"kubernetes.io/projected/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-kube-api-access-kth8z\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:30.746983 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.746950 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 17 11:40:30.752540 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:30.752520 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-tls\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:31.109846 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:31.109813 2556 configmap.go:193] Couldn't get configMap openshift-monitoring/node-exporter-accelerators-collector-config: failed to sync configmap cache: timed out waiting for the condition Sep 17 11:40:31.110192 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:31.109904 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-accelerators-collector-config podName:aceb5d44-7cd3-4fd7-9ae5-2f0471cae541 nodeName:}" failed. No retries permitted until 2026-09-17 11:40:31.609887382 +0000 UTC m=+117.205723748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-accelerators-collector-config" (UniqueName: "kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-accelerators-collector-config") pod "node-exporter-gvjvw" (UID: "aceb5d44-7cd3-4fd7-9ae5-2f0471cae541") : failed to sync configmap cache: timed out waiting for the condition Sep 17 11:40:31.110192 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:31.109814 2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition Sep 17 11:40:31.110192 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:40:31.109967 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-kube-rbac-proxy-config podName:aceb5d44-7cd3-4fd7-9ae5-2f0471cae541 nodeName:}" failed. No retries permitted until 2026-09-17 11:40:31.609953008 +0000 UTC m=+117.205789390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-kube-rbac-proxy-config") pod "node-exporter-gvjvw" (UID: "aceb5d44-7cd3-4fd7-9ae5-2f0471cae541") : failed to sync secret cache: timed out waiting for the condition Sep 17 11:40:31.125069 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:31.125037 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 17 11:40:31.190496 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:31.190467 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 17 11:40:31.232325 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:31.232295 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bphnw\"" Sep 17 11:40:31.622181 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:31.622145 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:31.622324 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:31.622186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:31.622691 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:31.622670 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-accelerators-collector-config\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:31.624613 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:31.624595 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aceb5d44-7cd3-4fd7-9ae5-2f0471cae541-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gvjvw\" (UID: \"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541\") " pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:31.647305 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:31.647276 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gvjvw" Sep 17 11:40:31.659848 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:31.659820 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaceb5d44_7cd3_4fd7_9ae5_2f0471cae541.slice/crio-06a3ea565292077b11b2143f17a3ef370276d2accfd34e0d586809f286b1a37a WatchSource:0}: Error finding container 06a3ea565292077b11b2143f17a3ef370276d2accfd34e0d586809f286b1a37a: Status 404 returned error can't find the container with id 06a3ea565292077b11b2143f17a3ef370276d2accfd34e0d586809f286b1a37a Sep 17 11:40:32.431820 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:32.431776 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvjvw" event={"ID":"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541","Type":"ContainerStarted","Data":"06a3ea565292077b11b2143f17a3ef370276d2accfd34e0d586809f286b1a37a"} Sep 17 11:40:33.214332 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:33.214253 2556 patch_prober.go:28] interesting pod/image-registry-dd654b5fb-ld5v2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 17 11:40:33.214332 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:33.214315 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" podUID="1d2398e4-1f97-43d1-abfc-74f97ad7a888" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 17 11:40:33.436775 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:33.436742 2556 generic.go:356] "Generic (PLEG): container finished" podID="aceb5d44-7cd3-4fd7-9ae5-2f0471cae541" containerID="c6d605468f6a78c638b77378191fb58741b66a930539653f269d39803713033c" exitCode=0 Sep 17 11:40:33.437240 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:33.436788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvjvw" event={"ID":"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541","Type":"ContainerDied","Data":"c6d605468f6a78c638b77378191fb58741b66a930539653f269d39803713033c"} Sep 17 11:40:34.392133 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.392103 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d7485b976-kx4pz"] Sep 17 11:40:34.395853 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.395834 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.399977 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.399948 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 17 11:40:34.400089 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.400042 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e5hfj8jhq8v8k\"" Sep 17 11:40:34.402529 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.402505 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 17 11:40:34.402636 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.402546 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 17 11:40:34.402712 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.402689 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-2m5sp\"" Sep 17 11:40:34.403057 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.402820 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 17 11:40:34.416524 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.416496 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d7485b976-kx4pz"] Sep 17 11:40:34.442144 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.442117 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvjvw" event={"ID":"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541","Type":"ContainerStarted","Data":"af165666fb4e49a1f6e1ff08a7f40fbfdb92e762e777a93549674e3cf043d9ee"} Sep 17 11:40:34.442547 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.442176 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gvjvw" event={"ID":"aceb5d44-7cd3-4fd7-9ae5-2f0471cae541","Type":"ContainerStarted","Data":"1b6a5afe224f01bb5dd9a63f6eb04c134f3ef44686041073286ecea5610f2f15"} Sep 17 11:40:34.442922 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.442904 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-secret-metrics-server-client-certs\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.442963 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.442932 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ba739d4-443a-4760-85e0-74ce96510b69-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.442963 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.442953 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-client-ca-bundle\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.443088 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.443070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-secret-metrics-server-tls\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.443143 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.443110 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ba739d4-443a-4760-85e0-74ce96510b69-audit-log\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.443212 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.443191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ba739d4-443a-4760-85e0-74ce96510b69-metrics-server-audit-profiles\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.443254 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.443223 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flcdw\" (UniqueName: \"kubernetes.io/projected/9ba739d4-443a-4760-85e0-74ce96510b69-kube-api-access-flcdw\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.484386 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.484338 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gvjvw" podStartSLOduration=4.211428995 podStartE2EDuration="5.484322681s" totalImagesPullingTime="1.202060048s" totalInitContainerRuntime="70.833638ms" isStatefulPod=true podCreationTimestamp="2026-09-17 11:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:34.483773915 +0000 UTC m=+120.079610298" watchObservedRunningTime="2026-09-17 11:40:34.484322681 +0000 UTC m=+120.080159057" Sep 17 11:40:34.544234 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.544191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-secret-metrics-server-client-certs\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.544234 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.544248 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ba739d4-443a-4760-85e0-74ce96510b69-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.544491 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.544293 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-client-ca-bundle\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.544491 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.544371 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-secret-metrics-server-tls\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.544491 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.544407 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ba739d4-443a-4760-85e0-74ce96510b69-audit-log\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.544491 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.544461 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ba739d4-443a-4760-85e0-74ce96510b69-metrics-server-audit-profiles\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.544693 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.544492 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flcdw\" (UniqueName: \"kubernetes.io/projected/9ba739d4-443a-4760-85e0-74ce96510b69-kube-api-access-flcdw\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.545214 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.545071 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ba739d4-443a-4760-85e0-74ce96510b69-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.545476 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.545426 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/9ba739d4-443a-4760-85e0-74ce96510b69-audit-log\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.545821 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.545780 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/9ba739d4-443a-4760-85e0-74ce96510b69-metrics-server-audit-profiles\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.547190 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.547169 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-client-ca-bundle\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.547305 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.547281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-secret-metrics-server-tls\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.547364 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.547344 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/9ba739d4-443a-4760-85e0-74ce96510b69-secret-metrics-server-client-certs\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.572622 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.568039 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flcdw\" (UniqueName: \"kubernetes.io/projected/9ba739d4-443a-4760-85e0-74ce96510b69-kube-api-access-flcdw\") pod \"metrics-server-6d7485b976-kx4pz\" (UID: \"9ba739d4-443a-4760-85e0-74ce96510b69\") " pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:34.705580 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:34.705499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:35.001027 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:35.000951 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d7485b976-kx4pz"] Sep 17 11:40:35.004052 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:35.004024 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba739d4_443a_4760_85e0_74ce96510b69.slice/crio-e74f28c024e5b1ee89a981f1fa1c527869efddbac56780fc86c36beb244a3147 WatchSource:0}: Error finding container e74f28c024e5b1ee89a981f1fa1c527869efddbac56780fc86c36beb244a3147: Status 404 returned error can't find the container with id e74f28c024e5b1ee89a981f1fa1c527869efddbac56780fc86c36beb244a3147 Sep 17 11:40:35.352168 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:35.352141 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:40:35.446586 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:35.446551 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" event={"ID":"9ba739d4-443a-4760-85e0-74ce96510b69","Type":"ContainerStarted","Data":"e74f28c024e5b1ee89a981f1fa1c527869efddbac56780fc86c36beb244a3147"} Sep 17 11:40:37.457126 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:37.457092 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" event={"ID":"9ba739d4-443a-4760-85e0-74ce96510b69","Type":"ContainerStarted","Data":"b318f1bb6414ccf373cf7406af26483871a4e3aa8feff8c37f8511f6e35e3e5d"} Sep 17 11:40:42.817440 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:42.817382 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" podStartSLOduration=7.051399882 podStartE2EDuration="8.817364601s" totalImagesPullingTime="1.765964719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:37.486431344 +0000 UTC m=+123.082267726" watchObservedRunningTime="2026-09-17 11:40:42.817364601 +0000 UTC m=+128.413200983" Sep 17 11:40:42.817919 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:42.817522 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dd654b5fb-ld5v2"] Sep 17 11:40:44.729175 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:44.729123 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:40:44.731599 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:44.731570 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3cea07b-0f93-4d30-88db-fc3ff1783cbb-metrics-certs\") pod \"network-metrics-daemon-plzr7\" (UID: \"a3cea07b-0f93-4d30-88db-fc3ff1783cbb\") " pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:40:44.993410 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:44.993324 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l8fq5\"" Sep 17 11:40:44.999920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:44.999899 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-plzr7" Sep 17 11:40:45.279090 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:45.279010 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-plzr7"] Sep 17 11:40:45.281793 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:40:45.281734 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3cea07b_0f93_4d30_88db_fc3ff1783cbb.slice/crio-313d38bfa3552d01c718ae8b71c6c5866a0940d3cb737aaa792f0a766655c7ee WatchSource:0}: Error finding container 313d38bfa3552d01c718ae8b71c6c5866a0940d3cb737aaa792f0a766655c7ee: Status 404 returned error can't find the container with id 313d38bfa3552d01c718ae8b71c6c5866a0940d3cb737aaa792f0a766655c7ee Sep 17 11:40:45.487930 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:45.487894 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-plzr7" event={"ID":"a3cea07b-0f93-4d30-88db-fc3ff1783cbb","Type":"ContainerStarted","Data":"313d38bfa3552d01c718ae8b71c6c5866a0940d3cb737aaa792f0a766655c7ee"} Sep 17 11:40:46.492894 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:46.492859 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-plzr7" event={"ID":"a3cea07b-0f93-4d30-88db-fc3ff1783cbb","Type":"ContainerStarted","Data":"359abb065cceb0c60afafd14e36705f7a3c472c97d1b3ef9684a09781a3ecda2"} Sep 17 11:40:47.497593 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:47.497549 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-plzr7" event={"ID":"a3cea07b-0f93-4d30-88db-fc3ff1783cbb","Type":"ContainerStarted","Data":"c37c5102aedbac238fbe9e61889d5ed6dc1b34ed8c328a3f72cea55814529b23"} Sep 17 11:40:54.706086 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:54.706041 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:40:54.706537 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:40:54.706120 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:41:07.836151 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:07.836072 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" podUID="1d2398e4-1f97-43d1-abfc-74f97ad7a888" containerName="registry" containerID="cri-o://185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f" gracePeriod=30 Sep 17 11:41:08.071834 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.071808 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:41:08.097166 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.097067 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-plzr7" podStartSLOduration=152.038407524 podStartE2EDuration="2m33.097043422s" totalImagesPullingTime="1.058635898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:40:47.518005863 +0000 UTC m=+133.113842267" watchObservedRunningTime="2026-09-17 11:41:08.097043422 +0000 UTC m=+153.692879805" Sep 17 11:41:08.213571 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.213535 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") pod \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " Sep 17 11:41:08.213571 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.213574 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-image-registry-private-configuration\") pod \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " Sep 17 11:41:08.213819 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.213612 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-trusted-ca\") pod \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " Sep 17 11:41:08.213819 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.213644 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-bound-sa-token\") pod \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " Sep 17 11:41:08.213819 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.213668 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-installation-pull-secrets\") pod \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " Sep 17 11:41:08.213819 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.213699 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cg5h9\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-kube-api-access-cg5h9\") pod \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " Sep 17 11:41:08.213819 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.213748 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-certificates\") pod \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " Sep 17 11:41:08.213819 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.213799 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d2398e4-1f97-43d1-abfc-74f97ad7a888-ca-trust-extracted\") pod \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\" (UID: \"1d2398e4-1f97-43d1-abfc-74f97ad7a888\") " Sep 17 11:41:08.214279 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.214242 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1d2398e4-1f97-43d1-abfc-74f97ad7a888" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 11:41:08.216141 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.216002 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1d2398e4-1f97-43d1-abfc-74f97ad7a888" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 11:41:08.218039 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.218000 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1d2398e4-1f97-43d1-abfc-74f97ad7a888" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:41:08.221382 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.219462 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1d2398e4-1f97-43d1-abfc-74f97ad7a888" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:41:08.221382 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.221306 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1d2398e4-1f97-43d1-abfc-74f97ad7a888" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:41:08.221602 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.221423 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1d2398e4-1f97-43d1-abfc-74f97ad7a888" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:41:08.221757 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.221606 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-kube-api-access-cg5h9" (OuterVolumeSpecName: "kube-api-access-cg5h9") pod "1d2398e4-1f97-43d1-abfc-74f97ad7a888" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888"). InnerVolumeSpecName "kube-api-access-cg5h9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:41:08.226370 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.226344 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d2398e4-1f97-43d1-abfc-74f97ad7a888-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1d2398e4-1f97-43d1-abfc-74f97ad7a888" (UID: "1d2398e4-1f97-43d1-abfc-74f97ad7a888"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 11:41:08.314546 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.314515 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:41:08.314546 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.314544 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-image-registry-private-configuration\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:41:08.314546 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.314554 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-trusted-ca\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:41:08.314784 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.314564 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-bound-sa-token\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:41:08.314784 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.314572 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d2398e4-1f97-43d1-abfc-74f97ad7a888-installation-pull-secrets\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:41:08.314784 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.314581 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cg5h9\" (UniqueName: \"kubernetes.io/projected/1d2398e4-1f97-43d1-abfc-74f97ad7a888-kube-api-access-cg5h9\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:41:08.314784 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.314589 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d2398e4-1f97-43d1-abfc-74f97ad7a888-registry-certificates\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:41:08.314784 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.314596 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d2398e4-1f97-43d1-abfc-74f97ad7a888-ca-trust-extracted\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:41:08.569778 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.569744 2556 generic.go:356] "Generic (PLEG): container finished" podID="1d2398e4-1f97-43d1-abfc-74f97ad7a888" containerID="185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f" exitCode=0 Sep 17 11:41:08.569944 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.569827 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" event={"ID":"1d2398e4-1f97-43d1-abfc-74f97ad7a888","Type":"ContainerDied","Data":"185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f"} Sep 17 11:41:08.569944 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.569851 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" Sep 17 11:41:08.569944 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.569893 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd654b5fb-ld5v2" event={"ID":"1d2398e4-1f97-43d1-abfc-74f97ad7a888","Type":"ContainerDied","Data":"6fdc9a26d55c66f682639b2ee9f4cdaf2ec157725dc9c3664e7295c5e230eb06"} Sep 17 11:41:08.569944 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.569913 2556 scope.go:117] "RemoveContainer" containerID="185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f" Sep 17 11:41:08.578300 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.578281 2556 scope.go:117] "RemoveContainer" containerID="185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f" Sep 17 11:41:08.578580 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:41:08.578560 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f\": container with ID starting with 185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f not found: ID does not exist" containerID="185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f" Sep 17 11:41:08.578625 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.578589 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f"} err="failed to get container status \"185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f\": rpc error: code = NotFound desc = could not find container \"185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f\": container with ID starting with 185dda73a9856e0ed1b3688acfe910dd935ac6f8b7dd48f2345e554d91ee138f not found: ID does not exist" Sep 17 11:41:08.591900 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.591880 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dd654b5fb-ld5v2"] Sep 17 11:41:08.596016 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.595997 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dd654b5fb-ld5v2"] Sep 17 11:41:08.875552 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:08.875457 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d2398e4-1f97-43d1-abfc-74f97ad7a888" path="/var/lib/kubelet/pods/1d2398e4-1f97-43d1-abfc-74f97ad7a888/volumes" Sep 17 11:41:14.711297 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:14.711267 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:41:14.715125 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:14.715101 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d7485b976-kx4pz" Sep 17 11:41:17.088418 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:17.088383 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d7485b976-kx4pz_9ba739d4-443a-4760-85e0-74ce96510b69/metrics-server/0.log" Sep 17 11:41:18.088259 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:18.088226 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvjvw_aceb5d44-7cd3-4fd7-9ae5-2f0471cae541/init-textfile/0.log" Sep 17 11:41:18.288845 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:18.288815 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvjvw_aceb5d44-7cd3-4fd7-9ae5-2f0471cae541/node-exporter/0.log" Sep 17 11:41:18.486428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:18.486356 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvjvw_aceb5d44-7cd3-4fd7-9ae5-2f0471cae541/kube-rbac-proxy/0.log" Sep 17 11:41:21.288364 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:21.288334 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gsdt2_8d7f7d6e-4568-435b-8fba-6b509cb24a4a/prometheus-operator/0.log" Sep 17 11:41:21.486451 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:21.486407 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gsdt2_8d7f7d6e-4568-435b-8fba-6b509cb24a4a/kube-rbac-proxy/0.log" Sep 17 11:41:23.688420 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:41:23.688388 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-4jhtj_92239a79-33e8-49fb-8e42-ed615400f0f6/networking-console-plugin/0.log" Sep 17 11:43:34.815142 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:43:34.815107 2556 kubelet.go:1648] "Image garbage collection succeeded" Sep 17 11:44:16.410708 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.410668 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9"] Sep 17 11:44:16.413066 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.410919 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d2398e4-1f97-43d1-abfc-74f97ad7a888" containerName="registry" Sep 17 11:44:16.413066 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.410930 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d2398e4-1f97-43d1-abfc-74f97ad7a888" containerName="registry" Sep 17 11:44:16.413066 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.410976 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d2398e4-1f97-43d1-abfc-74f97ad7a888" containerName="registry" Sep 17 11:44:16.413915 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.413899 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:44:16.417691 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.417671 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-9xpzz\"" Sep 17 11:44:16.418748 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.418707 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 17 11:44:16.418847 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.418777 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 17 11:44:16.420355 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.420295 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp6k7\" (UniqueName: \"kubernetes.io/projected/1bb2063d-23ef-4d99-8dd8-fb697263408c-kube-api-access-mp6k7\") pod \"feast-operator-controller-manager-6b97449968-5p2v9\" (UID: \"1bb2063d-23ef-4d99-8dd8-fb697263408c\") " pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:44:16.428105 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.428083 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9"] Sep 17 11:44:16.521189 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.521151 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp6k7\" (UniqueName: \"kubernetes.io/projected/1bb2063d-23ef-4d99-8dd8-fb697263408c-kube-api-access-mp6k7\") pod \"feast-operator-controller-manager-6b97449968-5p2v9\" (UID: \"1bb2063d-23ef-4d99-8dd8-fb697263408c\") " pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:44:16.533049 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.533010 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp6k7\" (UniqueName: \"kubernetes.io/projected/1bb2063d-23ef-4d99-8dd8-fb697263408c-kube-api-access-mp6k7\") pod \"feast-operator-controller-manager-6b97449968-5p2v9\" (UID: \"1bb2063d-23ef-4d99-8dd8-fb697263408c\") " pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:44:16.723894 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.723800 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:44:16.993675 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.993599 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9"] Sep 17 11:44:16.996592 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:44:16.996563 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb2063d_23ef_4d99_8dd8_fb697263408c.slice/crio-737cd99e50a87baaf0b642672f33cd2e5bd10d6b4b290817a61027a06ed79907 WatchSource:0}: Error finding container 737cd99e50a87baaf0b642672f33cd2e5bd10d6b4b290817a61027a06ed79907: Status 404 returned error can't find the container with id 737cd99e50a87baaf0b642672f33cd2e5bd10d6b4b290817a61027a06ed79907 Sep 17 11:44:16.998896 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:16.998877 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 11:44:17.196962 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:17.196925 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" event={"ID":"1bb2063d-23ef-4d99-8dd8-fb697263408c","Type":"ContainerStarted","Data":"737cd99e50a87baaf0b642672f33cd2e5bd10d6b4b290817a61027a06ed79907"} Sep 17 11:44:20.209594 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:20.209555 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" event={"ID":"1bb2063d-23ef-4d99-8dd8-fb697263408c","Type":"ContainerStarted","Data":"d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755"} Sep 17 11:44:20.210070 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:20.209631 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:44:20.240851 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:20.240800 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" podStartSLOduration=1.9066316159999999 podStartE2EDuration="4.240784303s" totalImagesPullingTime="2.334152687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:44:20.24038556 +0000 UTC m=+345.836221965" watchObservedRunningTime="2026-09-17 11:44:20.240784303 +0000 UTC m=+345.836620684" Sep 17 11:44:31.215140 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:31.215066 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:44:54.351538 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.351503 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g"] Sep 17 11:44:54.358120 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.358094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.364816 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.364785 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 17 11:44:54.365006 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.364992 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 17 11:44:54.365075 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.365023 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 17 11:44:54.365168 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.365145 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 17 11:44:54.366076 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.366050 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 17 11:44:54.366076 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.366071 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4frp6\"" Sep 17 11:44:54.366271 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.366128 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 17 11:44:54.366271 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.366061 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 17 11:44:54.393522 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.393490 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g"] Sep 17 11:44:54.497550 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.497517 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb66c69d-bcc3-4a95-8139-4afaa010747d-feast-data\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.497550 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.497555 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-ui-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.497797 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.497591 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-offline-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.497797 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.497611 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-registry-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.497797 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.497666 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdxjg\" (UniqueName: \"kubernetes.io/projected/bb66c69d-bcc3-4a95-8139-4afaa010747d-kube-api-access-hdxjg\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.497797 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.497707 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-online-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.598526 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.598491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-online-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.598526 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.598529 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb66c69d-bcc3-4a95-8139-4afaa010747d-feast-data\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.598805 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.598549 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-ui-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.598805 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.598664 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-offline-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.598805 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.598710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-registry-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.598805 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.598764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdxjg\" (UniqueName: \"kubernetes.io/projected/bb66c69d-bcc3-4a95-8139-4afaa010747d-kube-api-access-hdxjg\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.599004 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.598954 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb66c69d-bcc3-4a95-8139-4afaa010747d-feast-data\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.601302 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.601274 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-registry-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.601448 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.601394 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-online-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.601531 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.601511 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-ui-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.601600 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.601515 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-offline-tls\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.613090 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.613056 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdxjg\" (UniqueName: \"kubernetes.io/projected/bb66c69d-bcc3-4a95-8139-4afaa010747d-kube-api-access-hdxjg\") pod \"feast-simple-feast-setup-555d8d5757-8xw9g\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.667864 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.667834 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:44:54.956011 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:54.955986 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g"] Sep 17 11:44:54.958293 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:44:54.958264 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb66c69d_bcc3_4a95_8139_4afaa010747d.slice/crio-f5638134242d8e2c27e86baa8c68a617de371a94036e3cd4f1f19196f7b49c29 WatchSource:0}: Error finding container f5638134242d8e2c27e86baa8c68a617de371a94036e3cd4f1f19196f7b49c29: Status 404 returned error can't find the container with id f5638134242d8e2c27e86baa8c68a617de371a94036e3cd4f1f19196f7b49c29 Sep 17 11:44:55.326940 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:44:55.326903 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerStarted","Data":"f5638134242d8e2c27e86baa8c68a617de371a94036e3cd4f1f19196f7b49c29"} Sep 17 11:45:22.436998 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:22.436959 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerStarted","Data":"2f7f2d69bc6c5552669b76195c92bdd4367e10e098f365e23988e7077a6f48b9"} Sep 17 11:45:27.455702 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:27.455664 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerID="2f7f2d69bc6c5552669b76195c92bdd4367e10e098f365e23988e7077a6f48b9" exitCode=0 Sep 17 11:45:27.456266 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:27.455708 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerDied","Data":"2f7f2d69bc6c5552669b76195c92bdd4367e10e098f365e23988e7077a6f48b9"} Sep 17 11:45:28.461674 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:28.461636 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerStarted","Data":"5222fa41e379e2d39f666e3fb821cdfbd57961653dc29846c53b7fb41a47f2a5"} Sep 17 11:45:33.480867 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:33.480773 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerID="5222fa41e379e2d39f666e3fb821cdfbd57961653dc29846c53b7fb41a47f2a5" exitCode=0 Sep 17 11:45:33.480867 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:33.480854 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerDied","Data":"5222fa41e379e2d39f666e3fb821cdfbd57961653dc29846c53b7fb41a47f2a5"} Sep 17 11:45:34.489917 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.489872 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerStarted","Data":"4bb9cadb764486df8d94c1b8fcc89e64f7ce2de6843d7a5dac7395d83e2c6d0a"} Sep 17 11:45:34.490412 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.489939 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerStarted","Data":"19f40b236997feabad24c8eaaf81156333728a11344be7a291ebbe694596f8e7"} Sep 17 11:45:34.490412 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.489961 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerStarted","Data":"61b5e4486d839c26fd2c90005687dba91b9a02d573113a103ffc6382564b44f6"} Sep 17 11:45:34.490412 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.489980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerStarted","Data":"79c1fcd284fabaa0928edb02c270d33fcd1af02d515eef6fa24af39475694292"} Sep 17 11:45:34.541697 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.541630 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podStartSLOduration=13.550099521 podStartE2EDuration="40.54160768s" totalImagesPullingTime="26.991508159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:45:34.539750266 +0000 UTC m=+420.135586649" watchObservedRunningTime="2026-09-17 11:45:34.54160768 +0000 UTC m=+420.137444066" Sep 17 11:45:34.668513 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.668452 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:34.668709 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.668524 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:34.668709 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.668547 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:34.668709 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:34.668569 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:36.668688 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:36.668640 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:36.669338 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:36.669311 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:36.669338 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:36.669347 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:36.669519 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:36.669367 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:36.670973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:36.670938 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.16:8816: connect: connection refused" Sep 17 11:45:36.671075 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:36.670957 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 11:45:36.671075 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:36.671011 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 11:45:36.671216 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:36.670956 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.16:6571: connect: connection refused" Sep 17 11:45:39.669189 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:39.669055 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.16:8816: connect: connection refused" Sep 17 11:45:39.669189 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:39.669101 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 11:45:39.669189 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:39.669065 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.16:6571: connect: connection refused" Sep 17 11:45:39.669189 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:39.669052 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 11:45:42.668839 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:42.668795 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:42.669294 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:42.669271 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:42.669590 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:42.669568 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:42.669911 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:42.669895 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:42.674291 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:42.674273 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:43.538824 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:43.538793 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:43.539069 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:43.538871 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:45:43.541490 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:45:43.541468 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:46:46.589319 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:46.589287 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g"] Sep 17 11:46:46.589867 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:46.589507 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="registry" containerID="cri-o://79c1fcd284fabaa0928edb02c270d33fcd1af02d515eef6fa24af39475694292" gracePeriod=30 Sep 17 11:46:46.589867 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:46.589585 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" containerID="cri-o://4bb9cadb764486df8d94c1b8fcc89e64f7ce2de6843d7a5dac7395d83e2c6d0a" gracePeriod=30 Sep 17 11:46:46.589867 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:46.589616 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="offline" containerID="cri-o://19f40b236997feabad24c8eaaf81156333728a11344be7a291ebbe694596f8e7" gracePeriod=30 Sep 17 11:46:46.589867 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:46.589582 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" containerID="cri-o://61b5e4486d839c26fd2c90005687dba91b9a02d573113a103ffc6382564b44f6" gracePeriod=30 Sep 17 11:46:46.992486 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:46.992388 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx"] Sep 17 11:46:47.002817 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.002777 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.005832 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.005805 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-7qcn7\"" Sep 17 11:46:47.024043 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.024013 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx"] Sep 17 11:46:47.052684 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.052651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwvhs\" (UniqueName: \"kubernetes.io/projected/c96bbfc9-98c4-4888-98a6-381f220e55b9-kube-api-access-wwvhs\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.052684 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.052690 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-ui-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.052937 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.052746 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-offline-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.052937 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.052786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c96bbfc9-98c4-4888-98a6-381f220e55b9-feast-data\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.052937 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.052829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.052937 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.052851 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-registry-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.153972 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.153933 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwvhs\" (UniqueName: \"kubernetes.io/projected/c96bbfc9-98c4-4888-98a6-381f220e55b9-kube-api-access-wwvhs\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.153972 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.153983 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-ui-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.154225 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.154020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-offline-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.154225 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.154051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c96bbfc9-98c4-4888-98a6-381f220e55b9-feast-data\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.154312 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:46:47.154272 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 17 11:46:47.154361 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:46:47.154354 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls podName:c96bbfc9-98c4-4888-98a6-381f220e55b9 nodeName:}" failed. No retries permitted until 2026-09-17 11:46:47.654333775 +0000 UTC m=+493.250170139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls") pod "feast-simple-feast-setup-555d8d5757-bkvxx" (UID: "c96bbfc9-98c4-4888-98a6-381f220e55b9") : secret "feast-simple-feast-setup-online-tls" not found Sep 17 11:46:47.154593 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.154547 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c96bbfc9-98c4-4888-98a6-381f220e55b9-feast-data\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.154765 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.154090 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.154904 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.154878 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-registry-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.157400 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.157362 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-ui-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.157703 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.157679 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-registry-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.157938 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.157915 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-offline-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.168382 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.168354 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwvhs\" (UniqueName: \"kubernetes.io/projected/c96bbfc9-98c4-4888-98a6-381f220e55b9-kube-api-access-wwvhs\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.658738 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.658635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.661225 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.661203 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls\") pod \"feast-simple-feast-setup-555d8d5757-bkvxx\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:47.762671 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.762634 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerID="4bb9cadb764486df8d94c1b8fcc89e64f7ce2de6843d7a5dac7395d83e2c6d0a" exitCode=0 Sep 17 11:46:47.762671 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.762665 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerID="61b5e4486d839c26fd2c90005687dba91b9a02d573113a103ffc6382564b44f6" exitCode=0 Sep 17 11:46:47.762872 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.762699 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerDied","Data":"4bb9cadb764486df8d94c1b8fcc89e64f7ce2de6843d7a5dac7395d83e2c6d0a"} Sep 17 11:46:47.762872 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.762765 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerDied","Data":"61b5e4486d839c26fd2c90005687dba91b9a02d573113a103ffc6382564b44f6"} Sep 17 11:46:47.914131 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:47.914048 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:46:48.192805 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:48.192700 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx"] Sep 17 11:46:48.194929 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:46:48.194899 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc96bbfc9_98c4_4888_98a6_381f220e55b9.slice/crio-505c3311faf45295c7c27e952a8d83333592aaf9505937cd4ae927f48b1f406f WatchSource:0}: Error finding container 505c3311faf45295c7c27e952a8d83333592aaf9505937cd4ae927f48b1f406f: Status 404 returned error can't find the container with id 505c3311faf45295c7c27e952a8d83333592aaf9505937cd4ae927f48b1f406f Sep 17 11:46:48.768067 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:48.768028 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerStarted","Data":"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe"} Sep 17 11:46:48.768430 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:48.768074 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerStarted","Data":"505c3311faf45295c7c27e952a8d83333592aaf9505937cd4ae927f48b1f406f"} Sep 17 11:46:52.669538 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:52.669498 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 11:46:53.539273 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:53.539231 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 11:46:53.790014 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:53.789929 2556 generic.go:356] "Generic (PLEG): container finished" podID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerID="2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe" exitCode=0 Sep 17 11:46:53.790014 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:53.789968 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerDied","Data":"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe"} Sep 17 11:46:54.795920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:54.795888 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerStarted","Data":"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb"} Sep 17 11:46:59.816375 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:59.816341 2556 generic.go:356] "Generic (PLEG): container finished" podID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerID="3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb" exitCode=0 Sep 17 11:46:59.816744 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:46:59.816394 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerDied","Data":"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb"} Sep 17 11:47:00.826964 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:00.826925 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerStarted","Data":"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0"} Sep 17 11:47:00.827470 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:00.826990 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerStarted","Data":"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749"} Sep 17 11:47:00.827470 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:00.827009 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerStarted","Data":"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2"} Sep 17 11:47:00.827470 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:00.827027 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerStarted","Data":"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67"} Sep 17 11:47:00.869345 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:00.869282 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podStartSLOduration=14.869260389 podStartE2EDuration="14.869260389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:47:00.869141317 +0000 UTC m=+506.464977712" watchObservedRunningTime="2026-09-17 11:47:00.869260389 +0000 UTC m=+506.465096773" Sep 17 11:47:02.669730 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.669657 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 11:47:02.914881 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.914841 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:02.915090 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.914908 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:02.915090 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.914931 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:02.915090 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.914948 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:02.924958 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.916939 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 11:47:02.924958 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.916942 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused" Sep 17 11:47:02.924958 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.916959 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 11:47:02.924958 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:02.916987 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused" Sep 17 11:47:03.539582 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:03.539516 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 11:47:05.914694 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:05.914589 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.17:6571: connect: connection refused" Sep 17 11:47:05.914694 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:05.914616 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 11:47:05.914694 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:05.914629 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.17:8816: connect: connection refused" Sep 17 11:47:05.914694 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:05.914669 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 11:47:07.914669 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:07.914630 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:07.915065 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:07.914691 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:07.915065 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:07.914711 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:07.915065 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:07.914742 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:08.915909 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:08.915867 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:08.916333 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:08.916059 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:08.916333 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:08.916313 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:08.921458 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:08.921438 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:09.871276 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:09.871231 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:09.871546 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:09.871527 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:09.871654 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:09.871642 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:09.874095 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:09.874077 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:47:12.670374 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:12.670334 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.16:8443: connect: connection refused" Sep 17 11:47:12.670806 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:12.670467 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:47:13.539202 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:13.539148 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.16:6567/health\": dial tcp 10.132.0.16:6567: connect: connection refused" Sep 17 11:47:13.539392 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:13.539299 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:47:16.900824 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:16.900792 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerID="19f40b236997feabad24c8eaaf81156333728a11344be7a291ebbe694596f8e7" exitCode=137 Sep 17 11:47:16.900824 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:16.900816 2556 generic.go:356] "Generic (PLEG): container finished" podID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerID="79c1fcd284fabaa0928edb02c270d33fcd1af02d515eef6fa24af39475694292" exitCode=137 Sep 17 11:47:16.901173 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:16.900862 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerDied","Data":"19f40b236997feabad24c8eaaf81156333728a11344be7a291ebbe694596f8e7"} Sep 17 11:47:16.901173 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:16.900900 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerDied","Data":"79c1fcd284fabaa0928edb02c270d33fcd1af02d515eef6fa24af39475694292"} Sep 17 11:47:17.234404 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.234376 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:47:17.300012 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.299984 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-ui-tls\") pod \"bb66c69d-bcc3-4a95-8139-4afaa010747d\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " Sep 17 11:47:17.300169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.300026 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-offline-tls\") pod \"bb66c69d-bcc3-4a95-8139-4afaa010747d\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " Sep 17 11:47:17.300169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.300061 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-registry-tls\") pod \"bb66c69d-bcc3-4a95-8139-4afaa010747d\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " Sep 17 11:47:17.300169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.300094 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-online-tls\") pod \"bb66c69d-bcc3-4a95-8139-4afaa010747d\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " Sep 17 11:47:17.300169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.300135 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb66c69d-bcc3-4a95-8139-4afaa010747d-feast-data\") pod \"bb66c69d-bcc3-4a95-8139-4afaa010747d\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " Sep 17 11:47:17.300169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.300164 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdxjg\" (UniqueName: \"kubernetes.io/projected/bb66c69d-bcc3-4a95-8139-4afaa010747d-kube-api-access-hdxjg\") pod \"bb66c69d-bcc3-4a95-8139-4afaa010747d\" (UID: \"bb66c69d-bcc3-4a95-8139-4afaa010747d\") " Sep 17 11:47:17.300871 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.300757 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb66c69d-bcc3-4a95-8139-4afaa010747d-feast-data" (OuterVolumeSpecName: "feast-data") pod "bb66c69d-bcc3-4a95-8139-4afaa010747d" (UID: "bb66c69d-bcc3-4a95-8139-4afaa010747d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 11:47:17.302456 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.302422 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "bb66c69d-bcc3-4a95-8139-4afaa010747d" (UID: "bb66c69d-bcc3-4a95-8139-4afaa010747d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:47:17.302544 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.302491 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-online-tls" (OuterVolumeSpecName: "online-tls") pod "bb66c69d-bcc3-4a95-8139-4afaa010747d" (UID: "bb66c69d-bcc3-4a95-8139-4afaa010747d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:47:17.302600 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.302573 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb66c69d-bcc3-4a95-8139-4afaa010747d-kube-api-access-hdxjg" (OuterVolumeSpecName: "kube-api-access-hdxjg") pod "bb66c69d-bcc3-4a95-8139-4afaa010747d" (UID: "bb66c69d-bcc3-4a95-8139-4afaa010747d"). InnerVolumeSpecName "kube-api-access-hdxjg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:47:17.302692 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.302667 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bb66c69d-bcc3-4a95-8139-4afaa010747d" (UID: "bb66c69d-bcc3-4a95-8139-4afaa010747d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:47:17.302765 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.302686 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "bb66c69d-bcc3-4a95-8139-4afaa010747d" (UID: "bb66c69d-bcc3-4a95-8139-4afaa010747d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:47:17.405846 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.401838 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-ui-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:47:17.405846 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.401875 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-offline-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:47:17.405846 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.401894 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-registry-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:47:17.405846 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.401909 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bb66c69d-bcc3-4a95-8139-4afaa010747d-online-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:47:17.405846 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.401930 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bb66c69d-bcc3-4a95-8139-4afaa010747d-feast-data\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:47:17.405846 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.401943 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdxjg\" (UniqueName: \"kubernetes.io/projected/bb66c69d-bcc3-4a95-8139-4afaa010747d-kube-api-access-hdxjg\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:47:17.907568 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.907534 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" event={"ID":"bb66c69d-bcc3-4a95-8139-4afaa010747d","Type":"ContainerDied","Data":"f5638134242d8e2c27e86baa8c68a617de371a94036e3cd4f1f19196f7b49c29"} Sep 17 11:47:17.908070 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.907583 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g" Sep 17 11:47:17.908070 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.907586 2556 scope.go:117] "RemoveContainer" containerID="4bb9cadb764486df8d94c1b8fcc89e64f7ce2de6843d7a5dac7395d83e2c6d0a" Sep 17 11:47:17.916868 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.916851 2556 scope.go:117] "RemoveContainer" containerID="19f40b236997feabad24c8eaaf81156333728a11344be7a291ebbe694596f8e7" Sep 17 11:47:17.924050 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.924034 2556 scope.go:117] "RemoveContainer" containerID="61b5e4486d839c26fd2c90005687dba91b9a02d573113a103ffc6382564b44f6" Sep 17 11:47:17.931854 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.931832 2556 scope.go:117] "RemoveContainer" containerID="79c1fcd284fabaa0928edb02c270d33fcd1af02d515eef6fa24af39475694292" Sep 17 11:47:17.938867 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.938849 2556 scope.go:117] "RemoveContainer" containerID="5222fa41e379e2d39f666e3fb821cdfbd57961653dc29846c53b7fb41a47f2a5" Sep 17 11:47:17.941644 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.941619 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g"] Sep 17 11:47:17.945920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.945903 2556 scope.go:117] "RemoveContainer" containerID="2f7f2d69bc6c5552669b76195c92bdd4367e10e098f365e23988e7077a6f48b9" Sep 17 11:47:17.949269 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:17.949249 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-8xw9g"] Sep 17 11:47:18.875198 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:47:18.875163 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" path="/var/lib/kubelet/pods/bb66c69d-bcc3-4a95-8139-4afaa010747d/volumes" Sep 17 11:48:12.166987 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.166948 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr"] Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167219 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="feast-apply" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167231 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="feast-apply" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167241 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167247 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167258 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="registry" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167264 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="registry" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167270 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="offline" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167274 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="offline" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167279 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167285 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167297 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="feast-init" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167302 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="feast-init" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167341 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="ui" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167349 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="offline" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167356 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="online" Sep 17 11:48:12.167539 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.167363 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb66c69d-bcc3-4a95-8139-4afaa010747d" containerName="registry" Sep 17 11:48:12.170189 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.170161 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.173243 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.173204 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 17 11:48:12.173369 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.173264 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 17 11:48:12.173605 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.173587 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 17 11:48:12.173712 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.173623 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 17 11:48:12.173712 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.173686 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-qd9kv\"" Sep 17 11:48:12.173846 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.173783 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 17 11:48:12.173953 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.173930 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 17 11:48:12.173953 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.173948 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 17 11:48:12.184762 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.184738 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr"] Sep 17 11:48:12.283393 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.283355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-offline-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.283547 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.283409 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mscb7\" (UniqueName: \"kubernetes.io/projected/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-kube-api-access-mscb7\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.283547 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.283439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-feast-data\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.283547 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.283502 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-ui-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.283707 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.283545 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-registry-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.283707 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.283622 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.384207 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.384171 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-registry-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.384349 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.384228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.384349 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.384276 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-offline-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.384349 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.384313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscb7\" (UniqueName: \"kubernetes.io/projected/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-kube-api-access-mscb7\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.384349 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.384340 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-feast-data\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.384567 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.384371 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-ui-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.384567 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:48:12.384435 2556 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 17 11:48:12.384567 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:48:12.384546 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls podName:c2cdcfbf-6a38-4508-8400-b575a6cf9ecf nodeName:}" failed. No retries permitted until 2026-09-17 11:48:12.88452124 +0000 UTC m=+578.480357606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls") pod "feast-simple-feast-remote-setup-5f9945f56-2pnpr" (UID: "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 17 11:48:12.384883 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.384857 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-feast-data\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.384980 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.384937 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-registry-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.387051 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.387025 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-offline-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.387152 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.387029 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-ui-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.394524 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.394498 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mscb7\" (UniqueName: \"kubernetes.io/projected/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-kube-api-access-mscb7\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.888760 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.888730 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:12.891187 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:12.891158 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls\") pod \"feast-simple-feast-remote-setup-5f9945f56-2pnpr\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:13.081586 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:13.081533 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:13.364152 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:13.364005 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr"] Sep 17 11:48:13.366589 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:48:13.366561 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2cdcfbf_6a38_4508_8400_b575a6cf9ecf.slice/crio-46b4b052509379d2f46c86de4ab3ae7ab7840de8c1be5471e84ed297d681babd WatchSource:0}: Error finding container 46b4b052509379d2f46c86de4ab3ae7ab7840de8c1be5471e84ed297d681babd: Status 404 returned error can't find the container with id 46b4b052509379d2f46c86de4ab3ae7ab7840de8c1be5471e84ed297d681babd Sep 17 11:48:14.104110 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:14.104056 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerStarted","Data":"b2c3c6889e7ca7006614ec7e6075f542d5cdd8e9783c7f35e63369fdf0a7c8d1"} Sep 17 11:48:14.104268 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:14.104127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerStarted","Data":"46b4b052509379d2f46c86de4ab3ae7ab7840de8c1be5471e84ed297d681babd"} Sep 17 11:48:19.124387 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:19.124345 2556 generic.go:356] "Generic (PLEG): container finished" podID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerID="b2c3c6889e7ca7006614ec7e6075f542d5cdd8e9783c7f35e63369fdf0a7c8d1" exitCode=0 Sep 17 11:48:19.124918 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:19.124422 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerDied","Data":"b2c3c6889e7ca7006614ec7e6075f542d5cdd8e9783c7f35e63369fdf0a7c8d1"} Sep 17 11:48:20.130024 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:20.129986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerStarted","Data":"04c95ab8b5d85478b8521b6979317ee8558486a961f37a27f31f4711d4580cb3"} Sep 17 11:48:44.218007 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:44.217972 2556 generic.go:356] "Generic (PLEG): container finished" podID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerID="04c95ab8b5d85478b8521b6979317ee8558486a961f37a27f31f4711d4580cb3" exitCode=0 Sep 17 11:48:44.218339 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:44.218049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerDied","Data":"04c95ab8b5d85478b8521b6979317ee8558486a961f37a27f31f4711d4580cb3"} Sep 17 11:48:44.223136 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:44.223115 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 17 11:48:45.225537 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:45.225504 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerStarted","Data":"ad8381f34110419f76e420041ad06e6ef642a485b34abbb4fb0201236f49808e"} Sep 17 11:48:45.226043 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:45.225559 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerStarted","Data":"05e36e0e6ccb1ebbdb49cdf41f681388da58ceef76bcf4e408a7ca950fdcc215"} Sep 17 11:48:45.226043 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:45.225577 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerStarted","Data":"9b88e66daef0f71ca3f4b0093541c29e69a1c5354c6d296325c9cbfac49e6da9"} Sep 17 11:48:45.253566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:45.253514 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podStartSLOduration=33.253494513 podStartE2EDuration="33.253494513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:48:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:48:45.252611944 +0000 UTC m=+610.848448329" watchObservedRunningTime="2026-09-17 11:48:45.253494513 +0000 UTC m=+610.849330895" Sep 17 11:48:46.081751 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:46.081696 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:46.082095 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:46.082073 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:46.082197 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:46.082103 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:46.083431 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:46.083395 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused" Sep 17 11:48:46.083547 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:46.083461 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.18:8816: connect: connection refused" Sep 17 11:48:46.083547 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:46.083404 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused" Sep 17 11:48:49.082681 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:49.082635 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.18:8816: connect: connection refused" Sep 17 11:48:49.083152 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:49.082635 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused" Sep 17 11:48:49.083152 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:49.082655 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused" Sep 17 11:48:52.082203 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:52.082152 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused" Sep 17 11:48:52.082992 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:52.082967 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:52.083463 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:52.083440 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:52.083855 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:52.083836 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:52.112967 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:52.112942 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:52.255651 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:52.255623 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:52.279343 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:52.279310 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:53.082146 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:53.082109 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:55.083058 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:55.083025 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:48:55.267263 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:48:55.267228 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:49:56.551557 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.551523 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr"] Sep 17 11:49:56.552096 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.551757 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" containerID="cri-o://9b88e66daef0f71ca3f4b0093541c29e69a1c5354c6d296325c9cbfac49e6da9" gracePeriod=30 Sep 17 11:49:56.552096 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.551917 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" containerID="cri-o://ad8381f34110419f76e420041ad06e6ef642a485b34abbb4fb0201236f49808e" gracePeriod=30 Sep 17 11:49:56.552096 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.552000 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="offline" containerID="cri-o://05e36e0e6ccb1ebbdb49cdf41f681388da58ceef76bcf4e408a7ca950fdcc215" gracePeriod=30 Sep 17 11:49:56.685302 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.685269 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx"] Sep 17 11:49:56.685564 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.685538 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="registry" containerID="cri-o://157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67" gracePeriod=30 Sep 17 11:49:56.685677 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.685650 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" containerID="cri-o://43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2" gracePeriod=30 Sep 17 11:49:56.685760 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.685689 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" containerID="cri-o://e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0" gracePeriod=30 Sep 17 11:49:56.685824 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:56.685636 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="offline" containerID="cri-o://a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749" gracePeriod=30 Sep 17 11:49:57.493659 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:57.493629 2556 generic.go:356] "Generic (PLEG): container finished" podID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerID="e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0" exitCode=0 Sep 17 11:49:57.493788 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:57.493702 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerDied","Data":"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0"} Sep 17 11:49:57.496422 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:57.496403 2556 generic.go:356] "Generic (PLEG): container finished" podID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerID="ad8381f34110419f76e420041ad06e6ef642a485b34abbb4fb0201236f49808e" exitCode=0 Sep 17 11:49:57.496422 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:57.496420 2556 generic.go:356] "Generic (PLEG): container finished" podID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerID="9b88e66daef0f71ca3f4b0093541c29e69a1c5354c6d296325c9cbfac49e6da9" exitCode=0 Sep 17 11:49:57.496541 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:57.496438 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerDied","Data":"ad8381f34110419f76e420041ad06e6ef642a485b34abbb4fb0201236f49808e"} Sep 17 11:49:57.496541 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:57.496467 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerDied","Data":"9b88e66daef0f71ca3f4b0093541c29e69a1c5354c6d296325c9cbfac49e6da9"} Sep 17 11:49:58.503785 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:58.503756 2556 generic.go:356] "Generic (PLEG): container finished" podID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerID="43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2" exitCode=0 Sep 17 11:49:58.504151 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:58.503804 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerDied","Data":"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2"} Sep 17 11:49:59.871111 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:59.871061 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 11:49:59.871543 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:49:59.871139 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 11:50:02.256732 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:02.256684 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused" Sep 17 11:50:05.267442 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:05.267398 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused" Sep 17 11:50:09.871072 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:09.871026 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 11:50:09.871475 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:09.871068 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 11:50:12.256606 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:12.256570 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused" Sep 17 11:50:15.267077 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:15.267029 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused" Sep 17 11:50:19.871544 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:19.871494 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.17:8443: connect: connection refused" Sep 17 11:50:19.872092 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:19.871522 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.17:6567/health\": dial tcp 10.132.0.17:6567: connect: connection refused" Sep 17 11:50:19.872092 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:19.871649 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:50:19.872092 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:19.871744 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:50:22.256459 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:22.256408 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" probeResult="failure" output="Get \"https://10.132.0.18:6567/health\": dial tcp 10.132.0.18:6567: connect: connection refused" Sep 17 11:50:22.256948 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:22.256518 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:50:25.267314 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:25.267272 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.18:8443: connect: connection refused" Sep 17 11:50:25.267673 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:25.267457 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:50:26.605891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:26.605865 2556 generic.go:356] "Generic (PLEG): container finished" podID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerID="05e36e0e6ccb1ebbdb49cdf41f681388da58ceef76bcf4e408a7ca950fdcc215" exitCode=137 Sep 17 11:50:26.606185 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:26.605938 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerDied","Data":"05e36e0e6ccb1ebbdb49cdf41f681388da58ceef76bcf4e408a7ca950fdcc215"} Sep 17 11:50:27.195523 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.195500 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:50:27.290213 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.290176 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-offline-tls\") pod \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " Sep 17 11:50:27.290366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.290230 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls\") pod \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " Sep 17 11:50:27.290366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.290278 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-feast-data\") pod \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " Sep 17 11:50:27.290366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.290310 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-registry-tls\") pod \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " Sep 17 11:50:27.290366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.290335 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-ui-tls\") pod \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " Sep 17 11:50:27.290366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.290365 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mscb7\" (UniqueName: \"kubernetes.io/projected/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-kube-api-access-mscb7\") pod \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\" (UID: \"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf\") " Sep 17 11:50:27.290881 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.290843 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-feast-data" (OuterVolumeSpecName: "feast-data") pod "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" (UID: "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 11:50:27.291553 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.290877 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" (UID: "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 17 11:50:27.293041 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.293012 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" (UID: "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:50:27.293140 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.293123 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-kube-api-access-mscb7" (OuterVolumeSpecName: "kube-api-access-mscb7") pod "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" (UID: "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf"). InnerVolumeSpecName "kube-api-access-mscb7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:50:27.293192 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.293136 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" (UID: "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:50:27.293192 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.293168 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls" (OuterVolumeSpecName: "online-tls") pod "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" (UID: "c2cdcfbf-6a38-4508-8400-b575a6cf9ecf"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:50:27.332552 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.332532 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:50:27.391130 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.391093 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-offline-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.391263 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.391143 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-online-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.391263 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.391153 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-feast-data\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.391263 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.391161 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-registry-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.391263 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.391175 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-ui-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.391263 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.391186 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mscb7\" (UniqueName: \"kubernetes.io/projected/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf-kube-api-access-mscb7\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.492357 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.492325 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-offline-tls\") pod \"c96bbfc9-98c4-4888-98a6-381f220e55b9\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " Sep 17 11:50:27.492504 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.492369 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwvhs\" (UniqueName: \"kubernetes.io/projected/c96bbfc9-98c4-4888-98a6-381f220e55b9-kube-api-access-wwvhs\") pod \"c96bbfc9-98c4-4888-98a6-381f220e55b9\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " Sep 17 11:50:27.492504 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.492403 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls\") pod \"c96bbfc9-98c4-4888-98a6-381f220e55b9\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " Sep 17 11:50:27.492504 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.492437 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-registry-tls\") pod \"c96bbfc9-98c4-4888-98a6-381f220e55b9\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " Sep 17 11:50:27.492677 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.492528 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-ui-tls\") pod \"c96bbfc9-98c4-4888-98a6-381f220e55b9\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " Sep 17 11:50:27.492677 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.492560 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c96bbfc9-98c4-4888-98a6-381f220e55b9-feast-data\") pod \"c96bbfc9-98c4-4888-98a6-381f220e55b9\" (UID: \"c96bbfc9-98c4-4888-98a6-381f220e55b9\") " Sep 17 11:50:27.493429 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.493379 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c96bbfc9-98c4-4888-98a6-381f220e55b9-feast-data" (OuterVolumeSpecName: "feast-data") pod "c96bbfc9-98c4-4888-98a6-381f220e55b9" (UID: "c96bbfc9-98c4-4888-98a6-381f220e55b9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 11:50:27.494848 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.494782 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c96bbfc9-98c4-4888-98a6-381f220e55b9" (UID: "c96bbfc9-98c4-4888-98a6-381f220e55b9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:50:27.494964 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.494880 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "c96bbfc9-98c4-4888-98a6-381f220e55b9" (UID: "c96bbfc9-98c4-4888-98a6-381f220e55b9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:50:27.494964 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.494903 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls" (OuterVolumeSpecName: "online-tls") pod "c96bbfc9-98c4-4888-98a6-381f220e55b9" (UID: "c96bbfc9-98c4-4888-98a6-381f220e55b9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:50:27.495167 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.495150 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "c96bbfc9-98c4-4888-98a6-381f220e55b9" (UID: "c96bbfc9-98c4-4888-98a6-381f220e55b9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:50:27.495227 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.495171 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c96bbfc9-98c4-4888-98a6-381f220e55b9-kube-api-access-wwvhs" (OuterVolumeSpecName: "kube-api-access-wwvhs") pod "c96bbfc9-98c4-4888-98a6-381f220e55b9" (UID: "c96bbfc9-98c4-4888-98a6-381f220e55b9"). InnerVolumeSpecName "kube-api-access-wwvhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:50:27.593455 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.593398 2556 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-ui-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.593455 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.593422 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/c96bbfc9-98c4-4888-98a6-381f220e55b9-feast-data\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.593455 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.593432 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-offline-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.593455 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.593440 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwvhs\" (UniqueName: \"kubernetes.io/projected/c96bbfc9-98c4-4888-98a6-381f220e55b9-kube-api-access-wwvhs\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.593455 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.593449 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-online-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.593455 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.593457 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/c96bbfc9-98c4-4888-98a6-381f220e55b9-registry-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:50:27.612560 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.612532 2556 generic.go:356] "Generic (PLEG): container finished" podID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerID="a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749" exitCode=137 Sep 17 11:50:27.612560 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.612554 2556 generic.go:356] "Generic (PLEG): container finished" podID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerID="157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67" exitCode=137 Sep 17 11:50:27.612998 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.612613 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" Sep 17 11:50:27.612998 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.612609 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerDied","Data":"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749"} Sep 17 11:50:27.612998 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.612759 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerDied","Data":"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67"} Sep 17 11:50:27.612998 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.612786 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx" event={"ID":"c96bbfc9-98c4-4888-98a6-381f220e55b9","Type":"ContainerDied","Data":"505c3311faf45295c7c27e952a8d83333592aaf9505937cd4ae927f48b1f406f"} Sep 17 11:50:27.612998 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.612802 2556 scope.go:117] "RemoveContainer" containerID="e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0" Sep 17 11:50:27.615669 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.615647 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" event={"ID":"c2cdcfbf-6a38-4508-8400-b575a6cf9ecf","Type":"ContainerDied","Data":"46b4b052509379d2f46c86de4ab3ae7ab7840de8c1be5471e84ed297d681babd"} Sep 17 11:50:27.615781 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.615702 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr" Sep 17 11:50:27.622189 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.622172 2556 scope.go:117] "RemoveContainer" containerID="a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749" Sep 17 11:50:27.629627 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.629611 2556 scope.go:117] "RemoveContainer" containerID="43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2" Sep 17 11:50:27.636977 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.636953 2556 scope.go:117] "RemoveContainer" containerID="157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67" Sep 17 11:50:27.643957 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.643926 2556 scope.go:117] "RemoveContainer" containerID="3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb" Sep 17 11:50:27.650668 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.650653 2556 scope.go:117] "RemoveContainer" containerID="2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe" Sep 17 11:50:27.653106 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.653086 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx"] Sep 17 11:50:27.657659 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.657643 2556 scope.go:117] "RemoveContainer" containerID="e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0" Sep 17 11:50:27.657958 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:50:27.657940 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0\": container with ID starting with e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0 not found: ID does not exist" containerID="e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0" Sep 17 11:50:27.658025 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.657965 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0"} err="failed to get container status \"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0\": rpc error: code = NotFound desc = could not find container \"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0\": container with ID starting with e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0 not found: ID does not exist" Sep 17 11:50:27.658025 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.657984 2556 scope.go:117] "RemoveContainer" containerID="a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749" Sep 17 11:50:27.658205 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:50:27.658190 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749\": container with ID starting with a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749 not found: ID does not exist" containerID="a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749" Sep 17 11:50:27.658239 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.658209 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749"} err="failed to get container status \"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749\": rpc error: code = NotFound desc = could not find container \"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749\": container with ID starting with a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749 not found: ID does not exist" Sep 17 11:50:27.658239 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.658224 2556 scope.go:117] "RemoveContainer" containerID="43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2" Sep 17 11:50:27.658438 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:50:27.658419 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2\": container with ID starting with 43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2 not found: ID does not exist" containerID="43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2" Sep 17 11:50:27.658502 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.658448 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2"} err="failed to get container status \"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2\": rpc error: code = NotFound desc = could not find container \"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2\": container with ID starting with 43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2 not found: ID does not exist" Sep 17 11:50:27.658502 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.658471 2556 scope.go:117] "RemoveContainer" containerID="157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67" Sep 17 11:50:27.658737 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:50:27.658697 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67\": container with ID starting with 157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67 not found: ID does not exist" containerID="157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67" Sep 17 11:50:27.658776 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.658736 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67"} err="failed to get container status \"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67\": rpc error: code = NotFound desc = could not find container \"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67\": container with ID starting with 157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67 not found: ID does not exist" Sep 17 11:50:27.658776 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.658751 2556 scope.go:117] "RemoveContainer" containerID="3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb" Sep 17 11:50:27.658981 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:50:27.658966 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb\": container with ID starting with 3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb not found: ID does not exist" containerID="3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb" Sep 17 11:50:27.659022 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.658984 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb"} err="failed to get container status \"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb\": rpc error: code = NotFound desc = could not find container \"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb\": container with ID starting with 3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb not found: ID does not exist" Sep 17 11:50:27.659022 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.658996 2556 scope.go:117] "RemoveContainer" containerID="2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe" Sep 17 11:50:27.659227 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:50:27.659209 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe\": container with ID starting with 2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe not found: ID does not exist" containerID="2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe" Sep 17 11:50:27.659301 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.659231 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe"} err="failed to get container status \"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe\": rpc error: code = NotFound desc = could not find container \"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe\": container with ID starting with 2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe not found: ID does not exist" Sep 17 11:50:27.659301 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.659256 2556 scope.go:117] "RemoveContainer" containerID="e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0" Sep 17 11:50:27.659511 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.659488 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0"} err="failed to get container status \"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0\": rpc error: code = NotFound desc = could not find container \"e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0\": container with ID starting with e7e2c8efab0523fb800e1a6da99899a342b3560c6510b1b2b332cbdd10c3b2d0 not found: ID does not exist" Sep 17 11:50:27.659607 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.659512 2556 scope.go:117] "RemoveContainer" containerID="a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749" Sep 17 11:50:27.660009 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.659990 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749"} err="failed to get container status \"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749\": rpc error: code = NotFound desc = could not find container \"a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749\": container with ID starting with a9eacd65bd8f31d9d5663c717ad8128d6fc4fcc2874cbe6363bad6aea1026749 not found: ID does not exist" Sep 17 11:50:27.660068 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660010 2556 scope.go:117] "RemoveContainer" containerID="43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2" Sep 17 11:50:27.660231 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660213 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2"} err="failed to get container status \"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2\": rpc error: code = NotFound desc = could not find container \"43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2\": container with ID starting with 43b2fc1e072ba0aa31fcc405492cbd04bac7bc9995b3b3dc2766d112e24313f2 not found: ID does not exist" Sep 17 11:50:27.660286 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660231 2556 scope.go:117] "RemoveContainer" containerID="157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67" Sep 17 11:50:27.660480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660453 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67"} err="failed to get container status \"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67\": rpc error: code = NotFound desc = could not find container \"157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67\": container with ID starting with 157e7360ddf30f634bcacb2bf8c59cc7cfa5dab8ba1b36806e0440040d971d67 not found: ID does not exist" Sep 17 11:50:27.660480 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660480 2556 scope.go:117] "RemoveContainer" containerID="3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb" Sep 17 11:50:27.660704 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660688 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb"} err="failed to get container status \"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb\": rpc error: code = NotFound desc = could not find container \"3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb\": container with ID starting with 3af9463814e26b1254c9878678d17a939f6d14823f3ca21f4d4d027017390ccb not found: ID does not exist" Sep 17 11:50:27.660704 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660704 2556 scope.go:117] "RemoveContainer" containerID="2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe" Sep 17 11:50:27.660952 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660934 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe"} err="failed to get container status \"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe\": rpc error: code = NotFound desc = could not find container \"2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe\": container with ID starting with 2be71a791a2aaddaf9b61418ae5af08bbd56f4ad29188ffb031ac86f221255fe not found: ID does not exist" Sep 17 11:50:27.660994 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.660953 2556 scope.go:117] "RemoveContainer" containerID="ad8381f34110419f76e420041ad06e6ef642a485b34abbb4fb0201236f49808e" Sep 17 11:50:27.666297 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.666278 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-555d8d5757-bkvxx"] Sep 17 11:50:27.668301 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.668287 2556 scope.go:117] "RemoveContainer" containerID="05e36e0e6ccb1ebbdb49cdf41f681388da58ceef76bcf4e408a7ca950fdcc215" Sep 17 11:50:27.675029 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.675001 2556 scope.go:117] "RemoveContainer" containerID="9b88e66daef0f71ca3f4b0093541c29e69a1c5354c6d296325c9cbfac49e6da9" Sep 17 11:50:27.681654 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.681638 2556 scope.go:117] "RemoveContainer" containerID="04c95ab8b5d85478b8521b6979317ee8558486a961f37a27f31f4711d4580cb3" Sep 17 11:50:27.688410 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.688377 2556 scope.go:117] "RemoveContainer" containerID="b2c3c6889e7ca7006614ec7e6075f542d5cdd8e9783c7f35e63369fdf0a7c8d1" Sep 17 11:50:27.689745 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.689710 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr"] Sep 17 11:50:27.696037 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:27.696020 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5f9945f56-2pnpr"] Sep 17 11:50:28.874870 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:28.874838 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" path="/var/lib/kubelet/pods/c2cdcfbf-6a38-4508-8400-b575a6cf9ecf/volumes" Sep 17 11:50:28.875366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:28.875352 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" path="/var/lib/kubelet/pods/c96bbfc9-98c4-4888-98a6-381f220e55b9/volumes" Sep 17 11:50:39.932911 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.932881 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-qkzbt"] Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933110 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="offline" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933120 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="offline" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933130 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933136 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933147 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933153 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933160 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="feast-init" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933165 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="feast-init" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933171 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="feast-apply" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933176 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="feast-apply" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933181 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933187 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933193 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933198 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933205 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="feast-apply" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933210 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="feast-apply" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933218 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="offline" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933222 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="offline" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933229 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="registry" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933236 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="registry" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933240 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="feast-init" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933245 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="feast-init" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933280 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="offline" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933286 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="ui" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933291 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="registry" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933297 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="offline" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933302 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="ui" Sep 17 11:50:39.933293 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933307 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c96bbfc9-98c4-4888-98a6-381f220e55b9" containerName="online" Sep 17 11:50:39.934360 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.933312 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2cdcfbf-6a38-4508-8400-b575a6cf9ecf" containerName="online" Sep 17 11:50:39.937493 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.937472 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qkzbt" Sep 17 11:50:39.940364 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.940342 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 17 11:50:39.940466 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.940390 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-qxcvl\"" Sep 17 11:50:39.941459 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.941436 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 17 11:50:39.946370 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:39.946346 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qkzbt"] Sep 17 11:50:40.084437 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:40.084396 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8v5c\" (UniqueName: \"kubernetes.io/projected/e1d486a0-9551-499f-88a3-5443c954ab73-kube-api-access-b8v5c\") pod \"redis-69bbd798b6-qkzbt\" (UID: \"e1d486a0-9551-499f-88a3-5443c954ab73\") " pod="test-ns-feast/redis-69bbd798b6-qkzbt" Sep 17 11:50:40.185452 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:40.185373 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8v5c\" (UniqueName: \"kubernetes.io/projected/e1d486a0-9551-499f-88a3-5443c954ab73-kube-api-access-b8v5c\") pod \"redis-69bbd798b6-qkzbt\" (UID: \"e1d486a0-9551-499f-88a3-5443c954ab73\") " pod="test-ns-feast/redis-69bbd798b6-qkzbt" Sep 17 11:50:40.195308 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:40.195279 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8v5c\" (UniqueName: \"kubernetes.io/projected/e1d486a0-9551-499f-88a3-5443c954ab73-kube-api-access-b8v5c\") pod \"redis-69bbd798b6-qkzbt\" (UID: \"e1d486a0-9551-499f-88a3-5443c954ab73\") " pod="test-ns-feast/redis-69bbd798b6-qkzbt" Sep 17 11:50:40.248234 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:40.248207 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qkzbt" Sep 17 11:50:40.516572 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:40.516538 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qkzbt"] Sep 17 11:50:40.519456 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:50:40.519428 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1d486a0_9551_499f_88a3_5443c954ab73.slice/crio-a0eb1105e1bc2a35898539c5cc439372b64cd532fcdfb6d08fbcbe2afdd251b5 WatchSource:0}: Error finding container a0eb1105e1bc2a35898539c5cc439372b64cd532fcdfb6d08fbcbe2afdd251b5: Status 404 returned error can't find the container with id a0eb1105e1bc2a35898539c5cc439372b64cd532fcdfb6d08fbcbe2afdd251b5 Sep 17 11:50:40.521269 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:40.521250 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 11:50:40.664448 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:40.664421 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qkzbt" event={"ID":"e1d486a0-9551-499f-88a3-5443c954ab73","Type":"ContainerStarted","Data":"a0eb1105e1bc2a35898539c5cc439372b64cd532fcdfb6d08fbcbe2afdd251b5"} Sep 17 11:50:42.672498 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:42.672470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qkzbt" event={"ID":"e1d486a0-9551-499f-88a3-5443c954ab73","Type":"ContainerStarted","Data":"968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378"} Sep 17 11:50:42.689941 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:42.689895 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-qkzbt" podStartSLOduration=1.694654283 podStartE2EDuration="3.689880405s" totalImagesPullingTime="1.995226122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:50:42.689675123 +0000 UTC m=+728.285511506" watchObservedRunningTime="2026-09-17 11:50:42.689880405 +0000 UTC m=+728.285716787" Sep 17 11:50:48.791892 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.791836 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47"] Sep 17 11:50:48.795197 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.795176 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:48.798204 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.798183 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 17 11:50:48.798334 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.798212 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 17 11:50:48.798399 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.798333 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 17 11:50:48.798763 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.798745 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 17 11:50:48.798922 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.798899 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-cl2fh\"" Sep 17 11:50:48.799447 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.799427 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 17 11:50:48.814335 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.814314 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47"] Sep 17 11:50:48.948315 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.948282 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-online-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:48.948475 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.948324 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-offline-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:48.948475 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.948357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:48.948475 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.948376 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc768a2-5297-4248-83b1-7fcb36ca01f3-feast-data\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:48.948475 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:48.948398 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjxlp\" (UniqueName: \"kubernetes.io/projected/bdc768a2-5297-4248-83b1-7fcb36ca01f3-kube-api-access-hjxlp\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.049134 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.049047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-online-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.049134 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.049104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-offline-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.049338 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.049136 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.049338 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.049165 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc768a2-5297-4248-83b1-7fcb36ca01f3-feast-data\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.049338 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:50:49.049267 2556 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found Sep 17 11:50:49.049338 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.049296 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjxlp\" (UniqueName: \"kubernetes.io/projected/bdc768a2-5297-4248-83b1-7fcb36ca01f3-kube-api-access-hjxlp\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.049338 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:50:49.049330 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls podName:bdc768a2-5297-4248-83b1-7fcb36ca01f3 nodeName:}" failed. No retries permitted until 2026-09-17 11:50:49.549310833 +0000 UTC m=+735.145147195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls") pod "feast-credit-scoring-7d57b876bf-p7t47" (UID: "bdc768a2-5297-4248-83b1-7fcb36ca01f3") : secret "feast-credit-scoring-registry-tls" not found Sep 17 11:50:49.050137 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.050112 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc768a2-5297-4248-83b1-7fcb36ca01f3-feast-data\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.055854 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.052851 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-offline-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.056566 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.056543 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-online-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.060434 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.060413 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjxlp\" (UniqueName: \"kubernetes.io/projected/bdc768a2-5297-4248-83b1-7fcb36ca01f3-kube-api-access-hjxlp\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.553336 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.553300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.556015 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.555990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls\") pod \"feast-credit-scoring-7d57b876bf-p7t47\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.706652 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.706620 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:50:49.987162 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:49.987138 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47"] Sep 17 11:50:49.988397 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:50:49.988373 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc768a2_5297_4248_83b1_7fcb36ca01f3.slice/crio-c1a9f8de79297af235c10aa5e2b9eb9d95135859dba6e965ec5c41918dd0b167 WatchSource:0}: Error finding container c1a9f8de79297af235c10aa5e2b9eb9d95135859dba6e965ec5c41918dd0b167: Status 404 returned error can't find the container with id c1a9f8de79297af235c10aa5e2b9eb9d95135859dba6e965ec5c41918dd0b167 Sep 17 11:50:50.701797 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:50.701755 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerStarted","Data":"f76b92a03517d7c40bd2ea34a66f93fc8ee9c4c68d02f93c4a1a343f2fd65eab"} Sep 17 11:50:50.702210 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:50.701826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerStarted","Data":"c1a9f8de79297af235c10aa5e2b9eb9d95135859dba6e965ec5c41918dd0b167"} Sep 17 11:50:51.707043 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:51.707007 2556 generic.go:356] "Generic (PLEG): container finished" podID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerID="f76b92a03517d7c40bd2ea34a66f93fc8ee9c4c68d02f93c4a1a343f2fd65eab" exitCode=0 Sep 17 11:50:51.707043 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:51.707045 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerDied","Data":"f76b92a03517d7c40bd2ea34a66f93fc8ee9c4c68d02f93c4a1a343f2fd65eab"} Sep 17 11:50:52.712964 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:52.712928 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerStarted","Data":"f6299e29fb20af09c39ab89e84641da72558eeacf00e9ce04d048a6f634dae49"} Sep 17 11:50:58.737811 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:58.737681 2556 generic.go:356] "Generic (PLEG): container finished" podID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerID="f6299e29fb20af09c39ab89e84641da72558eeacf00e9ce04d048a6f634dae49" exitCode=0 Sep 17 11:50:58.737811 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:58.737763 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerDied","Data":"f6299e29fb20af09c39ab89e84641da72558eeacf00e9ce04d048a6f634dae49"} Sep 17 11:50:59.745777 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:59.745739 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerStarted","Data":"5b398224cae87d3990332f177a758123416fe2c67ab0836370c076223a56f0f6"} Sep 17 11:50:59.746252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:59.745830 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerStarted","Data":"4050924b958bd5334e9ff4f1d53f60862aa74a78b830e34d8ab7bac37e0513a0"} Sep 17 11:50:59.746252 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:59.745851 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerStarted","Data":"5a37b69c841239c97db5c89e045954b8d335be10cb500e226d9356fd8ff5d555"} Sep 17 11:50:59.793342 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:50:59.793274 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podStartSLOduration=11.793253529 podStartE2EDuration="11.793253529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:50:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:50:59.792528544 +0000 UTC m=+745.388364926" watchObservedRunningTime="2026-09-17 11:50:59.793253529 +0000 UTC m=+745.389089911" Sep 17 11:51:01.707628 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:01.707590 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:01.708063 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:01.707699 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:01.708063 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:01.707742 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:01.709661 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:01.709628 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused" Sep 17 11:51:01.709791 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:01.709648 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused" Sep 17 11:51:01.709791 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:01.709703 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 11:51:04.707138 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:04.706983 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused" Sep 17 11:51:04.707138 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:04.707052 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused" Sep 17 11:51:04.707138 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:04.707099 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 11:51:07.707146 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:07.707091 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused" Sep 17 11:51:07.709042 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:07.709015 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:07.709538 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:07.709515 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:07.709891 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:07.709867 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:07.713630 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:07.713605 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:07.783271 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:07.783236 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:07.786593 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:07.786555 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:09.706836 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:09.706803 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:10.707975 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:10.707932 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused" Sep 17 11:51:13.708459 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:13.708428 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:51:13.709345 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:51:13.709318 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:52:16.668818 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:16.668773 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47"] Sep 17 11:52:16.669320 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:16.669037 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="registry" containerID="cri-o://5a37b69c841239c97db5c89e045954b8d335be10cb500e226d9356fd8ff5d555" gracePeriod=30 Sep 17 11:52:16.669320 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:16.669086 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" containerID="cri-o://4050924b958bd5334e9ff4f1d53f60862aa74a78b830e34d8ab7bac37e0513a0" gracePeriod=30 Sep 17 11:52:16.669320 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:16.669082 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="offline" containerID="cri-o://5b398224cae87d3990332f177a758123416fe2c67ab0836370c076223a56f0f6" gracePeriod=30 Sep 17 11:52:16.727567 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:16.727535 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qkzbt"] Sep 17 11:52:16.727794 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:16.727767 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-qkzbt" podUID="e1d486a0-9551-499f-88a3-5443c954ab73" containerName="redis" containerID="cri-o://968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378" gracePeriod=30 Sep 17 11:52:16.969170 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:16.969147 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qkzbt" Sep 17 11:52:17.017133 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.017103 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8v5c\" (UniqueName: \"kubernetes.io/projected/e1d486a0-9551-499f-88a3-5443c954ab73-kube-api-access-b8v5c\") pod \"e1d486a0-9551-499f-88a3-5443c954ab73\" (UID: \"e1d486a0-9551-499f-88a3-5443c954ab73\") " Sep 17 11:52:17.019287 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.019254 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1d486a0-9551-499f-88a3-5443c954ab73-kube-api-access-b8v5c" (OuterVolumeSpecName: "kube-api-access-b8v5c") pod "e1d486a0-9551-499f-88a3-5443c954ab73" (UID: "e1d486a0-9551-499f-88a3-5443c954ab73"). InnerVolumeSpecName "kube-api-access-b8v5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:52:17.033986 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.033958 2556 generic.go:356] "Generic (PLEG): container finished" podID="e1d486a0-9551-499f-88a3-5443c954ab73" containerID="968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378" exitCode=0 Sep 17 11:52:17.034120 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.034006 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-qkzbt" Sep 17 11:52:17.034120 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.034033 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qkzbt" event={"ID":"e1d486a0-9551-499f-88a3-5443c954ab73","Type":"ContainerDied","Data":"968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378"} Sep 17 11:52:17.034120 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.034078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-qkzbt" event={"ID":"e1d486a0-9551-499f-88a3-5443c954ab73","Type":"ContainerDied","Data":"a0eb1105e1bc2a35898539c5cc439372b64cd532fcdfb6d08fbcbe2afdd251b5"} Sep 17 11:52:17.034120 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.034097 2556 scope.go:117] "RemoveContainer" containerID="968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378" Sep 17 11:52:17.043358 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.043340 2556 scope.go:117] "RemoveContainer" containerID="968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378" Sep 17 11:52:17.043659 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:52:17.043641 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378\": container with ID starting with 968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378 not found: ID does not exist" containerID="968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378" Sep 17 11:52:17.043712 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.043669 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378"} err="failed to get container status \"968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378\": rpc error: code = NotFound desc = could not find container \"968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378\": container with ID starting with 968cb34e9987e7ec0667b0829fb3c0dbc421711b3d91826a269db437845d8378 not found: ID does not exist" Sep 17 11:52:17.061681 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.061655 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qkzbt"] Sep 17 11:52:17.069395 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.069373 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-qkzbt"] Sep 17 11:52:17.117584 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.117551 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8v5c\" (UniqueName: \"kubernetes.io/projected/e1d486a0-9551-499f-88a3-5443c954ab73-kube-api-access-b8v5c\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:52:17.783562 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:17.783525 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 11:52:18.040387 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:18.040298 2556 generic.go:356] "Generic (PLEG): container finished" podID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerID="4050924b958bd5334e9ff4f1d53f60862aa74a78b830e34d8ab7bac37e0513a0" exitCode=0 Sep 17 11:52:18.040535 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:18.040383 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerDied","Data":"4050924b958bd5334e9ff4f1d53f60862aa74a78b830e34d8ab7bac37e0513a0"} Sep 17 11:52:18.875301 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:18.875266 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1d486a0-9551-499f-88a3-5443c954ab73" path="/var/lib/kubelet/pods/e1d486a0-9551-499f-88a3-5443c954ab73/volumes" Sep 17 11:52:27.783422 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:27.783374 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 11:52:37.784166 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:37.784123 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused" Sep 17 11:52:37.784544 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:37.784269 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:52:47.142973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.142940 2556 generic.go:356] "Generic (PLEG): container finished" podID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerID="5b398224cae87d3990332f177a758123416fe2c67ab0836370c076223a56f0f6" exitCode=137 Sep 17 11:52:47.142973 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.142967 2556 generic.go:356] "Generic (PLEG): container finished" podID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerID="5a37b69c841239c97db5c89e045954b8d335be10cb500e226d9356fd8ff5d555" exitCode=137 Sep 17 11:52:47.143366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.142985 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerDied","Data":"5b398224cae87d3990332f177a758123416fe2c67ab0836370c076223a56f0f6"} Sep 17 11:52:47.143366 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.143049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerDied","Data":"5a37b69c841239c97db5c89e045954b8d335be10cb500e226d9356fd8ff5d555"} Sep 17 11:52:47.309079 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.309054 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:52:47.432970 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.432892 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-online-tls\") pod \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " Sep 17 11:52:47.432970 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.432924 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-offline-tls\") pod \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " Sep 17 11:52:47.432970 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.432947 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc768a2-5297-4248-83b1-7fcb36ca01f3-feast-data\") pod \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " Sep 17 11:52:47.433253 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.432985 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjxlp\" (UniqueName: \"kubernetes.io/projected/bdc768a2-5297-4248-83b1-7fcb36ca01f3-kube-api-access-hjxlp\") pod \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " Sep 17 11:52:47.433253 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.433022 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls\") pod \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\" (UID: \"bdc768a2-5297-4248-83b1-7fcb36ca01f3\") " Sep 17 11:52:47.435177 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.435141 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc768a2-5297-4248-83b1-7fcb36ca01f3-kube-api-access-hjxlp" (OuterVolumeSpecName: "kube-api-access-hjxlp") pod "bdc768a2-5297-4248-83b1-7fcb36ca01f3" (UID: "bdc768a2-5297-4248-83b1-7fcb36ca01f3"). InnerVolumeSpecName "kube-api-access-hjxlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:52:47.435309 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.435283 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bdc768a2-5297-4248-83b1-7fcb36ca01f3" (UID: "bdc768a2-5297-4248-83b1-7fcb36ca01f3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:52:47.435353 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.435306 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-online-tls" (OuterVolumeSpecName: "online-tls") pod "bdc768a2-5297-4248-83b1-7fcb36ca01f3" (UID: "bdc768a2-5297-4248-83b1-7fcb36ca01f3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:52:47.435428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.435415 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "bdc768a2-5297-4248-83b1-7fcb36ca01f3" (UID: "bdc768a2-5297-4248-83b1-7fcb36ca01f3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:52:47.441911 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.441886 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdc768a2-5297-4248-83b1-7fcb36ca01f3-feast-data" (OuterVolumeSpecName: "feast-data") pod "bdc768a2-5297-4248-83b1-7fcb36ca01f3" (UID: "bdc768a2-5297-4248-83b1-7fcb36ca01f3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 11:52:47.533926 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.533885 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-registry-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:52:47.533926 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.533921 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-online-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:52:47.533926 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.533929 2556 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bdc768a2-5297-4248-83b1-7fcb36ca01f3-offline-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:52:47.534089 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.533939 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bdc768a2-5297-4248-83b1-7fcb36ca01f3-feast-data\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:52:47.534089 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:47.533947 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjxlp\" (UniqueName: \"kubernetes.io/projected/bdc768a2-5297-4248-83b1-7fcb36ca01f3-kube-api-access-hjxlp\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:52:48.148330 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.148294 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" event={"ID":"bdc768a2-5297-4248-83b1-7fcb36ca01f3","Type":"ContainerDied","Data":"c1a9f8de79297af235c10aa5e2b9eb9d95135859dba6e965ec5c41918dd0b167"} Sep 17 11:52:48.148330 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.148333 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47" Sep 17 11:52:48.148950 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.148359 2556 scope.go:117] "RemoveContainer" containerID="5b398224cae87d3990332f177a758123416fe2c67ab0836370c076223a56f0f6" Sep 17 11:52:48.157525 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.157506 2556 scope.go:117] "RemoveContainer" containerID="4050924b958bd5334e9ff4f1d53f60862aa74a78b830e34d8ab7bac37e0513a0" Sep 17 11:52:48.164839 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.164823 2556 scope.go:117] "RemoveContainer" containerID="5a37b69c841239c97db5c89e045954b8d335be10cb500e226d9356fd8ff5d555" Sep 17 11:52:48.171577 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.171558 2556 scope.go:117] "RemoveContainer" containerID="f6299e29fb20af09c39ab89e84641da72558eeacf00e9ce04d048a6f634dae49" Sep 17 11:52:48.174264 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.174241 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47"] Sep 17 11:52:48.179310 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.179287 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-7d57b876bf-p7t47"] Sep 17 11:52:48.179632 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.179617 2556 scope.go:117] "RemoveContainer" containerID="f76b92a03517d7c40bd2ea34a66f93fc8ee9c4c68d02f93c4a1a343f2fd65eab" Sep 17 11:52:48.875169 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:52:48.875129 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" path="/var/lib/kubelet/pods/bdc768a2-5297-4248-83b1-7fcb36ca01f3/volumes" Sep 17 11:55:58.908766 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908729 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb"] Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908946 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908956 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908966 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="feast-apply" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908971 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="feast-apply" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908981 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="feast-init" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908986 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="feast-init" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908992 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="registry" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.908997 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="registry" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.909005 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="offline" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.909010 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="offline" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.909021 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1d486a0-9551-499f-88a3-5443c954ab73" containerName="redis" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.909027 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1d486a0-9551-499f-88a3-5443c954ab73" containerName="redis" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.909071 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1d486a0-9551-499f-88a3-5443c954ab73" containerName="redis" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.909078 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="registry" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.909083 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="online" Sep 17 11:55:58.909165 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.909089 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc768a2-5297-4248-83b1-7fcb36ca01f3" containerName="offline" Sep 17 11:55:58.911930 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.911911 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:58.916016 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.915994 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 17 11:55:58.916230 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.915995 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 17 11:55:58.916230 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.916048 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 17 11:55:58.916230 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.916095 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 17 11:55:58.916561 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.916541 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 17 11:55:58.916636 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.916578 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-ttddl\"" Sep 17 11:55:58.916636 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.916548 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 17 11:55:58.928259 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.928236 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb"] Sep 17 11:55:58.944787 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.944765 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5355c69a-2464-4d2b-b1a5-4129111e845c-feast-data\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:58.944886 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.944796 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q2rl\" (UniqueName: \"kubernetes.io/projected/5355c69a-2464-4d2b-b1a5-4129111e845c-kube-api-access-7q2rl\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:58.944886 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.944833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:58.944996 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:58.944895 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-online-tls\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.045888 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.045867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5355c69a-2464-4d2b-b1a5-4129111e845c-feast-data\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.045985 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.045898 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q2rl\" (UniqueName: \"kubernetes.io/projected/5355c69a-2464-4d2b-b1a5-4129111e845c-kube-api-access-7q2rl\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.045985 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.045930 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.045985 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.045953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-online-tls\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.046158 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:55:59.046054 2556 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found Sep 17 11:55:59.046212 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:55:59.046165 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls podName:5355c69a-2464-4d2b-b1a5-4129111e845c nodeName:}" failed. No retries permitted until 2026-09-17 11:55:59.546108483 +0000 UTC m=+1045.141944860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls") pod "feast-credit-scoring-67988bfdbf-hl7fb" (UID: "5355c69a-2464-4d2b-b1a5-4129111e845c") : secret "feast-credit-scoring-registry-tls" not found Sep 17 11:55:59.046289 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.046267 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5355c69a-2464-4d2b-b1a5-4129111e845c-feast-data\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.048762 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.048745 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-online-tls\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.055799 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.055779 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q2rl\" (UniqueName: \"kubernetes.io/projected/5355c69a-2464-4d2b-b1a5-4129111e845c-kube-api-access-7q2rl\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.550014 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.549977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.552585 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.552560 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls\") pod \"feast-credit-scoring-67988bfdbf-hl7fb\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:55:59.822328 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:55:59.822237 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:00.111849 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:00.111820 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb"] Sep 17 11:56:00.112236 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:56:00.111869 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5355c69a_2464_4d2b_b1a5_4129111e845c.slice/crio-1a8d6b10faa43d23272b0e833d1e7804ee2b296e56fdf3169b1e463a607e91b3 WatchSource:0}: Error finding container 1a8d6b10faa43d23272b0e833d1e7804ee2b296e56fdf3169b1e463a607e91b3: Status 404 returned error can't find the container with id 1a8d6b10faa43d23272b0e833d1e7804ee2b296e56fdf3169b1e463a607e91b3 Sep 17 11:56:00.790282 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:00.790248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerStarted","Data":"e264216057befcd1e3709dbbc5c65fdee2b43add6bb816ed9bf2ebb54239b949"} Sep 17 11:56:00.790446 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:00.790300 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerStarted","Data":"1a8d6b10faa43d23272b0e833d1e7804ee2b296e56fdf3169b1e463a607e91b3"} Sep 17 11:56:02.798667 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:02.798634 2556 generic.go:356] "Generic (PLEG): container finished" podID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerID="e264216057befcd1e3709dbbc5c65fdee2b43add6bb816ed9bf2ebb54239b949" exitCode=0 Sep 17 11:56:02.799074 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:02.798734 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerDied","Data":"e264216057befcd1e3709dbbc5c65fdee2b43add6bb816ed9bf2ebb54239b949"} Sep 17 11:56:03.804387 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:03.804351 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerStarted","Data":"5787e83f27d313cf6114680212228c8009a509db2cfa1b0b3665dda152ee4093"} Sep 17 11:56:10.831348 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:10.831313 2556 generic.go:356] "Generic (PLEG): container finished" podID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerID="5787e83f27d313cf6114680212228c8009a509db2cfa1b0b3665dda152ee4093" exitCode=0 Sep 17 11:56:10.831760 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:10.831391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerDied","Data":"5787e83f27d313cf6114680212228c8009a509db2cfa1b0b3665dda152ee4093"} Sep 17 11:56:11.838434 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:11.838392 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerStarted","Data":"04edb2823aa7f345c14d69bb57593cecbca791148756edd18579e1b4153736a3"} Sep 17 11:56:11.838811 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:11.838468 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerStarted","Data":"c0cf1c9c9480b59699d6538fd9a38dbff7a1dbaafa08289ace8d26e10d110872"} Sep 17 11:56:11.876336 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:11.876268 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podStartSLOduration=13.876247027 podStartE2EDuration="13.876247027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:55:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:56:11.875580826 +0000 UTC m=+1057.471417202" watchObservedRunningTime="2026-09-17 11:56:11.876247027 +0000 UTC m=+1057.472083412" Sep 17 11:56:14.822430 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:14.822392 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:14.822935 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:14.822480 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:14.823904 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:14.823875 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused" Sep 17 11:56:14.824023 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:14.823912 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 11:56:17.823327 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:17.823277 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused" Sep 17 11:56:17.829426 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:17.829398 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:17.829879 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:17.829852 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:17.832818 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:17.832793 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:19.822655 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:19.822603 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:20.822950 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:20.822892 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused" Sep 17 11:56:23.823525 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:23.823491 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:23.824265 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:23.824242 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:56:24.881805 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:24.881763 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f"] Sep 17 11:56:24.885707 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:24.885684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:24.888811 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:24.888794 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 17 11:56:24.888916 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:24.888827 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 17 11:56:24.889307 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:24.889280 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 17 11:56:24.889968 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:24.889953 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-76kxc\"" Sep 17 11:56:24.900349 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:24.900328 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f"] Sep 17 11:56:25.033288 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.033255 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-registry-tls\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.033288 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.033289 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmbh5\" (UniqueName: \"kubernetes.io/projected/ec0f888c-9482-4180-aa2e-0a5502567f58-kube-api-access-mmbh5\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.033497 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.033310 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-online-tls\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.033497 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.033400 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0f888c-9482-4180-aa2e-0a5502567f58-feast-data\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.134503 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.134437 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0f888c-9482-4180-aa2e-0a5502567f58-feast-data\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.134503 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.134478 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-registry-tls\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.134691 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.134500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmbh5\" (UniqueName: \"kubernetes.io/projected/ec0f888c-9482-4180-aa2e-0a5502567f58-kube-api-access-mmbh5\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.134691 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.134527 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-online-tls\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.134864 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.134845 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0f888c-9482-4180-aa2e-0a5502567f58-feast-data\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.137105 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.137084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-registry-tls\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.137178 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.137131 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-online-tls\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.144091 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.144067 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmbh5\" (UniqueName: \"kubernetes.io/projected/ec0f888c-9482-4180-aa2e-0a5502567f58-kube-api-access-mmbh5\") pod \"feast-driver-ranking-5cb68cbf74-56t2f\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.196849 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.196819 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:25.469304 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.469279 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f"] Sep 17 11:56:25.472485 ip-10-0-130-219 kubenswrapper[2556]: W0917 11:56:25.472455 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0f888c_9482_4180_aa2e_0a5502567f58.slice/crio-a40f075aee881c03fc7ff965b3cd032ce34d773f97c94f4fcf8b0825084d0fb5 WatchSource:0}: Error finding container a40f075aee881c03fc7ff965b3cd032ce34d773f97c94f4fcf8b0825084d0fb5: Status 404 returned error can't find the container with id a40f075aee881c03fc7ff965b3cd032ce34d773f97c94f4fcf8b0825084d0fb5 Sep 17 11:56:25.892267 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.892227 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerStarted","Data":"0bc0b4c3e6bc1f773860bfbbaba92e210087841a9099352af3ebff96b5d17b07"} Sep 17 11:56:25.892643 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:25.892283 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerStarted","Data":"a40f075aee881c03fc7ff965b3cd032ce34d773f97c94f4fcf8b0825084d0fb5"} Sep 17 11:56:30.910821 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:30.910784 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerID="0bc0b4c3e6bc1f773860bfbbaba92e210087841a9099352af3ebff96b5d17b07" exitCode=0 Sep 17 11:56:30.911209 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:30.910828 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerDied","Data":"0bc0b4c3e6bc1f773860bfbbaba92e210087841a9099352af3ebff96b5d17b07"} Sep 17 11:56:31.916445 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:31.916411 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerStarted","Data":"0d0ccc720cdb4e2990802fcff093dc67bcb8f1bc9df57db00d309657f9fc7f1d"} Sep 17 11:56:37.941768 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:37.941741 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerID="0d0ccc720cdb4e2990802fcff093dc67bcb8f1bc9df57db00d309657f9fc7f1d" exitCode=0 Sep 17 11:56:37.942068 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:37.941813 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerDied","Data":"0d0ccc720cdb4e2990802fcff093dc67bcb8f1bc9df57db00d309657f9fc7f1d"} Sep 17 11:56:37.945561 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:37.945544 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 17 11:56:38.948453 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:38.948414 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerStarted","Data":"4dab051d441ac955ac5ec98ba5d74d0ce9894f36ddd2f9c740b08e6f0fcf9cd2"} Sep 17 11:56:38.948975 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:38.948469 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerStarted","Data":"5f0516a2b05ae5677e896a4a0c00c6df712b5bed986610dc87cbf5a02d3c4983"} Sep 17 11:56:38.974428 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:38.974375 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podStartSLOduration=14.974354171 podStartE2EDuration="14.974354171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 11:56:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 11:56:38.972260789 +0000 UTC m=+1084.568097173" watchObservedRunningTime="2026-09-17 11:56:38.974354171 +0000 UTC m=+1084.570190555" Sep 17 11:56:40.197804 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:40.197761 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:40.198291 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:40.197842 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:40.199317 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:40.199287 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused" Sep 17 11:56:40.199415 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:40.199309 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 17 11:56:43.198021 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:43.197976 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused" Sep 17 11:56:43.198498 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:43.198055 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 17 11:56:45.197461 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:45.197426 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:45.197951 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:45.197493 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:46.197475 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:46.197422 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused" Sep 17 11:56:46.203521 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:46.203496 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:46.207904 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:46.207881 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:49.197856 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:49.197808 2556 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.22:6571: connect: connection refused" Sep 17 11:56:52.198526 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:52.198493 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:56:52.203947 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:56:52.203913 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:58:14.393233 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.393155 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9"] Sep 17 11:58:14.393703 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.393371 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" podUID="1bb2063d-23ef-4d99-8dd8-fb697263408c" containerName="manager" containerID="cri-o://d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755" gracePeriod=10 Sep 17 11:58:14.632767 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.632743 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:58:14.649342 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.649283 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp6k7\" (UniqueName: \"kubernetes.io/projected/1bb2063d-23ef-4d99-8dd8-fb697263408c-kube-api-access-mp6k7\") pod \"1bb2063d-23ef-4d99-8dd8-fb697263408c\" (UID: \"1bb2063d-23ef-4d99-8dd8-fb697263408c\") " Sep 17 11:58:14.651454 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.651431 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bb2063d-23ef-4d99-8dd8-fb697263408c-kube-api-access-mp6k7" (OuterVolumeSpecName: "kube-api-access-mp6k7") pod "1bb2063d-23ef-4d99-8dd8-fb697263408c" (UID: "1bb2063d-23ef-4d99-8dd8-fb697263408c"). InnerVolumeSpecName "kube-api-access-mp6k7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:58:14.750055 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.750026 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp6k7\" (UniqueName: \"kubernetes.io/projected/1bb2063d-23ef-4d99-8dd8-fb697263408c-kube-api-access-mp6k7\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:14.843827 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.843795 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb"] Sep 17 11:58:14.844038 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.844016 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="registry" containerID="cri-o://c0cf1c9c9480b59699d6538fd9a38dbff7a1dbaafa08289ace8d26e10d110872" gracePeriod=30 Sep 17 11:58:14.844156 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.844125 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="online" containerID="cri-o://04edb2823aa7f345c14d69bb57593cecbca791148756edd18579e1b4153736a3" gracePeriod=30 Sep 17 11:58:14.847483 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.847455 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f"] Sep 17 11:58:14.847771 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.847743 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" containerID="cri-o://4dab051d441ac955ac5ec98ba5d74d0ce9894f36ddd2f9c740b08e6f0fcf9cd2" gracePeriod=30 Sep 17 11:58:14.847877 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:14.847710 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="registry" containerID="cri-o://5f0516a2b05ae5677e896a4a0c00c6df712b5bed986610dc87cbf5a02d3c4983" gracePeriod=30 Sep 17 11:58:15.307017 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.306973 2556 generic.go:356] "Generic (PLEG): container finished" podID="1bb2063d-23ef-4d99-8dd8-fb697263408c" containerID="d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755" exitCode=0 Sep 17 11:58:15.307017 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.306994 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" event={"ID":"1bb2063d-23ef-4d99-8dd8-fb697263408c","Type":"ContainerDied","Data":"d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755"} Sep 17 11:58:15.307271 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.307047 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" Sep 17 11:58:15.307271 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.307065 2556 scope.go:117] "RemoveContainer" containerID="d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755" Sep 17 11:58:15.307271 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.307051 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9" event={"ID":"1bb2063d-23ef-4d99-8dd8-fb697263408c","Type":"ContainerDied","Data":"737cd99e50a87baaf0b642672f33cd2e5bd10d6b4b290817a61027a06ed79907"} Sep 17 11:58:15.316060 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.316039 2556 scope.go:117] "RemoveContainer" containerID="d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755" Sep 17 11:58:15.316369 ip-10-0-130-219 kubenswrapper[2556]: E0917 11:58:15.316348 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755\": container with ID starting with d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755 not found: ID does not exist" containerID="d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755" Sep 17 11:58:15.316472 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.316377 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755"} err="failed to get container status \"d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755\": rpc error: code = NotFound desc = could not find container \"d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755\": container with ID starting with d3f0801446f8398eacc3399e50373f77781858aef48aaa182b9dc9788ca5c755 not found: ID does not exist" Sep 17 11:58:15.339188 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.339147 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9"] Sep 17 11:58:15.343500 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:15.343461 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-6b97449968-5p2v9"] Sep 17 11:58:16.204920 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:16.204882 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 17 11:58:16.312526 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:16.312496 2556 generic.go:356] "Generic (PLEG): container finished" podID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerID="04edb2823aa7f345c14d69bb57593cecbca791148756edd18579e1b4153736a3" exitCode=0 Sep 17 11:58:16.312689 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:16.312567 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerDied","Data":"04edb2823aa7f345c14d69bb57593cecbca791148756edd18579e1b4153736a3"} Sep 17 11:58:16.315680 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:16.315658 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerID="4dab051d441ac955ac5ec98ba5d74d0ce9894f36ddd2f9c740b08e6f0fcf9cd2" exitCode=0 Sep 17 11:58:16.315808 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:16.315712 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerDied","Data":"4dab051d441ac955ac5ec98ba5d74d0ce9894f36ddd2f9c740b08e6f0fcf9cd2"} Sep 17 11:58:16.876046 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:16.876016 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bb2063d-23ef-4d99-8dd8-fb697263408c" path="/var/lib/kubelet/pods/1bb2063d-23ef-4d99-8dd8-fb697263408c/volumes" Sep 17 11:58:17.830467 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:17.830424 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 11:58:26.204139 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:26.204092 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 17 11:58:27.830103 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:27.830053 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 11:58:36.204570 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:36.204529 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused" Sep 17 11:58:36.205064 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:36.204651 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:58:37.830623 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:37.830580 2556 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused" Sep 17 11:58:37.831079 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:37.830751 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:58:45.421071 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.421039 2556 generic.go:356] "Generic (PLEG): container finished" podID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerID="5f0516a2b05ae5677e896a4a0c00c6df712b5bed986610dc87cbf5a02d3c4983" exitCode=137 Sep 17 11:58:45.421878 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.421167 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerDied","Data":"5f0516a2b05ae5677e896a4a0c00c6df712b5bed986610dc87cbf5a02d3c4983"} Sep 17 11:58:45.424074 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.423934 2556 generic.go:356] "Generic (PLEG): container finished" podID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerID="c0cf1c9c9480b59699d6538fd9a38dbff7a1dbaafa08289ace8d26e10d110872" exitCode=137 Sep 17 11:58:45.424074 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.424023 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerDied","Data":"c0cf1c9c9480b59699d6538fd9a38dbff7a1dbaafa08289ace8d26e10d110872"} Sep 17 11:58:45.507450 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.507427 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:58:45.510173 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.510155 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:58:45.557732 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.557689 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5355c69a-2464-4d2b-b1a5-4129111e845c-feast-data\") pod \"5355c69a-2464-4d2b-b1a5-4129111e845c\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " Sep 17 11:58:45.557876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.557743 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-online-tls\") pod \"ec0f888c-9482-4180-aa2e-0a5502567f58\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " Sep 17 11:58:45.557876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.557795 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-online-tls\") pod \"5355c69a-2464-4d2b-b1a5-4129111e845c\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " Sep 17 11:58:45.557876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.557840 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls\") pod \"5355c69a-2464-4d2b-b1a5-4129111e845c\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " Sep 17 11:58:45.557876 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.557862 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmbh5\" (UniqueName: \"kubernetes.io/projected/ec0f888c-9482-4180-aa2e-0a5502567f58-kube-api-access-mmbh5\") pod \"ec0f888c-9482-4180-aa2e-0a5502567f58\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " Sep 17 11:58:45.558049 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.557891 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-registry-tls\") pod \"ec0f888c-9482-4180-aa2e-0a5502567f58\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " Sep 17 11:58:45.558049 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.557917 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0f888c-9482-4180-aa2e-0a5502567f58-feast-data\") pod \"ec0f888c-9482-4180-aa2e-0a5502567f58\" (UID: \"ec0f888c-9482-4180-aa2e-0a5502567f58\") " Sep 17 11:58:45.558049 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.557942 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q2rl\" (UniqueName: \"kubernetes.io/projected/5355c69a-2464-4d2b-b1a5-4129111e845c-kube-api-access-7q2rl\") pod \"5355c69a-2464-4d2b-b1a5-4129111e845c\" (UID: \"5355c69a-2464-4d2b-b1a5-4129111e845c\") " Sep 17 11:58:45.559685 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.559642 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec0f888c-9482-4180-aa2e-0a5502567f58-feast-data" (OuterVolumeSpecName: "feast-data") pod "ec0f888c-9482-4180-aa2e-0a5502567f58" (UID: "ec0f888c-9482-4180-aa2e-0a5502567f58"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 11:58:45.565384 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.565331 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-online-tls" (OuterVolumeSpecName: "online-tls") pod "ec0f888c-9482-4180-aa2e-0a5502567f58" (UID: "ec0f888c-9482-4180-aa2e-0a5502567f58"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:58:45.565529 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.565358 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0f888c-9482-4180-aa2e-0a5502567f58-kube-api-access-mmbh5" (OuterVolumeSpecName: "kube-api-access-mmbh5") pod "ec0f888c-9482-4180-aa2e-0a5502567f58" (UID: "ec0f888c-9482-4180-aa2e-0a5502567f58"). InnerVolumeSpecName "kube-api-access-mmbh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:58:45.565529 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.565441 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5355c69a-2464-4d2b-b1a5-4129111e845c-kube-api-access-7q2rl" (OuterVolumeSpecName: "kube-api-access-7q2rl") pod "5355c69a-2464-4d2b-b1a5-4129111e845c" (UID: "5355c69a-2464-4d2b-b1a5-4129111e845c"). InnerVolumeSpecName "kube-api-access-7q2rl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 11:58:45.566839 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.566807 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-online-tls" (OuterVolumeSpecName: "online-tls") pod "5355c69a-2464-4d2b-b1a5-4129111e845c" (UID: "5355c69a-2464-4d2b-b1a5-4129111e845c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:58:45.566839 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.566826 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5355c69a-2464-4d2b-b1a5-4129111e845c" (UID: "5355c69a-2464-4d2b-b1a5-4129111e845c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:58:45.567073 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.567057 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ec0f888c-9482-4180-aa2e-0a5502567f58" (UID: "ec0f888c-9482-4180-aa2e-0a5502567f58"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 17 11:58:45.571371 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.571347 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5355c69a-2464-4d2b-b1a5-4129111e845c-feast-data" (OuterVolumeSpecName: "feast-data") pod "5355c69a-2464-4d2b-b1a5-4129111e845c" (UID: "5355c69a-2464-4d2b-b1a5-4129111e845c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 11:58:45.660614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.660523 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-online-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:45.660614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.660555 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5355c69a-2464-4d2b-b1a5-4129111e845c-registry-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:45.660614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.660565 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmbh5\" (UniqueName: \"kubernetes.io/projected/ec0f888c-9482-4180-aa2e-0a5502567f58-kube-api-access-mmbh5\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:45.660614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.660576 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-registry-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:45.660614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.660584 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ec0f888c-9482-4180-aa2e-0a5502567f58-feast-data\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:45.660614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.660592 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q2rl\" (UniqueName: \"kubernetes.io/projected/5355c69a-2464-4d2b-b1a5-4129111e845c-kube-api-access-7q2rl\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:45.660614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.660599 2556 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5355c69a-2464-4d2b-b1a5-4129111e845c-feast-data\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:45.660614 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:45.660606 2556 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ec0f888c-9482-4180-aa2e-0a5502567f58-online-tls\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 11:58:46.430368 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.430342 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" Sep 17 11:58:46.430838 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.430341 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f" event={"ID":"ec0f888c-9482-4180-aa2e-0a5502567f58","Type":"ContainerDied","Data":"a40f075aee881c03fc7ff965b3cd032ce34d773f97c94f4fcf8b0825084d0fb5"} Sep 17 11:58:46.430838 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.430500 2556 scope.go:117] "RemoveContainer" containerID="4dab051d441ac955ac5ec98ba5d74d0ce9894f36ddd2f9c740b08e6f0fcf9cd2" Sep 17 11:58:46.432925 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.432902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" event={"ID":"5355c69a-2464-4d2b-b1a5-4129111e845c","Type":"ContainerDied","Data":"1a8d6b10faa43d23272b0e833d1e7804ee2b296e56fdf3169b1e463a607e91b3"} Sep 17 11:58:46.433014 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.432945 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb" Sep 17 11:58:46.440396 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.440375 2556 scope.go:117] "RemoveContainer" containerID="5f0516a2b05ae5677e896a4a0c00c6df712b5bed986610dc87cbf5a02d3c4983" Sep 17 11:58:46.447908 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.447891 2556 scope.go:117] "RemoveContainer" containerID="0d0ccc720cdb4e2990802fcff093dc67bcb8f1bc9df57db00d309657f9fc7f1d" Sep 17 11:58:46.455069 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.455038 2556 scope.go:117] "RemoveContainer" containerID="0bc0b4c3e6bc1f773860bfbbaba92e210087841a9099352af3ebff96b5d17b07" Sep 17 11:58:46.455513 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.455493 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f"] Sep 17 11:58:46.460109 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.460087 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5cb68cbf74-56t2f"] Sep 17 11:58:46.462627 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.462611 2556 scope.go:117] "RemoveContainer" containerID="04edb2823aa7f345c14d69bb57593cecbca791148756edd18579e1b4153736a3" Sep 17 11:58:46.469369 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.469348 2556 scope.go:117] "RemoveContainer" containerID="c0cf1c9c9480b59699d6538fd9a38dbff7a1dbaafa08289ace8d26e10d110872" Sep 17 11:58:46.471991 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.471953 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb"] Sep 17 11:58:46.476206 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.476178 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-67988bfdbf-hl7fb"] Sep 17 11:58:46.476774 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.476748 2556 scope.go:117] "RemoveContainer" containerID="5787e83f27d313cf6114680212228c8009a509db2cfa1b0b3665dda152ee4093" Sep 17 11:58:46.483309 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.483284 2556 scope.go:117] "RemoveContainer" containerID="e264216057befcd1e3709dbbc5c65fdee2b43add6bb816ed9bf2ebb54239b949" Sep 17 11:58:46.875515 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.875482 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" path="/var/lib/kubelet/pods/5355c69a-2464-4d2b-b1a5-4129111e845c/volumes" Sep 17 11:58:46.876009 ip-10-0-130-219 kubenswrapper[2556]: I0917 11:58:46.875995 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" path="/var/lib/kubelet/pods/ec0f888c-9482-4180-aa2e-0a5502567f58/volumes" Sep 17 12:10:19.261866 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.261775 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vcv24/must-gather-bf5sk"] Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262004 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="online" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262014 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="online" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262024 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bb2063d-23ef-4d99-8dd8-fb697263408c" containerName="manager" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262029 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bb2063d-23ef-4d99-8dd8-fb697263408c" containerName="manager" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262036 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="registry" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262042 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="registry" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262048 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="feast-init" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262053 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="feast-init" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262062 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="feast-apply" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262068 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="feast-apply" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262076 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="feast-init" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262081 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="feast-init" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262087 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="feast-apply" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262092 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="feast-apply" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262098 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262104 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262112 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="registry" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262117 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="registry" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262153 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bb2063d-23ef-4d99-8dd8-fb697263408c" containerName="manager" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262161 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="registry" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262167 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="online" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262173 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5355c69a-2464-4d2b-b1a5-4129111e845c" containerName="online" Sep 17 12:10:19.262363 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.262179 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0f888c-9482-4180-aa2e-0a5502567f58" containerName="registry" Sep 17 12:10:19.264924 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.264908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:19.267572 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.267550 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vcv24\"/\"openshift-service-ca.crt\"" Sep 17 12:10:19.267672 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.267550 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vcv24\"/\"default-dockercfg-zl5bz\"" Sep 17 12:10:19.268743 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.268729 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vcv24\"/\"kube-root-ca.crt\"" Sep 17 12:10:19.273524 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.273498 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vcv24/must-gather-bf5sk"] Sep 17 12:10:19.382250 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.382217 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnnfn\" (UniqueName: \"kubernetes.io/projected/4a3cf9d7-623c-4055-9449-37d69bf333c4-kube-api-access-hnnfn\") pod \"must-gather-bf5sk\" (UID: \"4a3cf9d7-623c-4055-9449-37d69bf333c4\") " pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:19.382250 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.382252 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a3cf9d7-623c-4055-9449-37d69bf333c4-must-gather-output\") pod \"must-gather-bf5sk\" (UID: \"4a3cf9d7-623c-4055-9449-37d69bf333c4\") " pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:19.483306 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.483255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnnfn\" (UniqueName: \"kubernetes.io/projected/4a3cf9d7-623c-4055-9449-37d69bf333c4-kube-api-access-hnnfn\") pod \"must-gather-bf5sk\" (UID: \"4a3cf9d7-623c-4055-9449-37d69bf333c4\") " pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:19.483306 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.483308 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a3cf9d7-623c-4055-9449-37d69bf333c4-must-gather-output\") pod \"must-gather-bf5sk\" (UID: \"4a3cf9d7-623c-4055-9449-37d69bf333c4\") " pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:19.483604 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.483590 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a3cf9d7-623c-4055-9449-37d69bf333c4-must-gather-output\") pod \"must-gather-bf5sk\" (UID: \"4a3cf9d7-623c-4055-9449-37d69bf333c4\") " pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:19.491773 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.491741 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnnfn\" (UniqueName: \"kubernetes.io/projected/4a3cf9d7-623c-4055-9449-37d69bf333c4-kube-api-access-hnnfn\") pod \"must-gather-bf5sk\" (UID: \"4a3cf9d7-623c-4055-9449-37d69bf333c4\") " pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:19.574913 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.574820 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:19.848795 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.848768 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vcv24/must-gather-bf5sk"] Sep 17 12:10:19.851045 ip-10-0-130-219 kubenswrapper[2556]: W0917 12:10:19.851016 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a3cf9d7_623c_4055_9449_37d69bf333c4.slice/crio-ce2673afcbc6788b01b3ebe1ccdc865fc2f3e629efae18750723906312be4692 WatchSource:0}: Error finding container ce2673afcbc6788b01b3ebe1ccdc865fc2f3e629efae18750723906312be4692: Status 404 returned error can't find the container with id ce2673afcbc6788b01b3ebe1ccdc865fc2f3e629efae18750723906312be4692 Sep 17 12:10:19.852918 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:19.852901 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 17 12:10:20.714658 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:20.714536 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcv24/must-gather-bf5sk" event={"ID":"4a3cf9d7-623c-4055-9449-37d69bf333c4","Type":"ContainerStarted","Data":"ce2673afcbc6788b01b3ebe1ccdc865fc2f3e629efae18750723906312be4692"} Sep 17 12:10:26.738865 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:26.738822 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcv24/must-gather-bf5sk" event={"ID":"4a3cf9d7-623c-4055-9449-37d69bf333c4","Type":"ContainerStarted","Data":"41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5"} Sep 17 12:10:26.739387 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:26.738881 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcv24/must-gather-bf5sk" event={"ID":"4a3cf9d7-623c-4055-9449-37d69bf333c4","Type":"ContainerStarted","Data":"e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604"} Sep 17 12:10:26.755947 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:26.755893 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vcv24/must-gather-bf5sk" podStartSLOduration=1.56924738 podStartE2EDuration="7.755879269s" totalImagesPullingTime="6.186631889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 12:10:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:10:26.755311681 +0000 UTC m=+1912.351148064" watchObservedRunningTime="2026-09-17 12:10:26.755879269 +0000 UTC m=+1912.351715661" Sep 17 12:10:35.771733 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:35.771694 2556 generic.go:356] "Generic (PLEG): container finished" podID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerID="e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604" exitCode=0 Sep 17 12:10:35.772145 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:35.771771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vcv24/must-gather-bf5sk" event={"ID":"4a3cf9d7-623c-4055-9449-37d69bf333c4","Type":"ContainerDied","Data":"e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604"} Sep 17 12:10:35.772145 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:35.772064 2556 scope.go:117] "RemoveContainer" containerID="e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604" Sep 17 12:10:36.684681 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:36.684645 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vcv24_must-gather-bf5sk_4a3cf9d7-623c-4055-9449-37d69bf333c4/gather/0.log" Sep 17 12:10:40.903039 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:40.903010 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jjrgw_32e14d14-402a-433f-b533-2c283ff9ecbd/global-pull-secret-syncer/0.log" Sep 17 12:10:41.034851 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:41.034819 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-m59b7_47c11ef0-b8ae-48d8-9cd5-69f5d486f526/konnectivity-agent/0.log" Sep 17 12:10:41.109272 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:41.109238 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-219.ec2.internal_68e6fc64f6f6999a4a59ae15d2e063cd/haproxy/0.log" Sep 17 12:10:42.011459 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.011422 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-vcv24/must-gather-bf5sk"] Sep 17 12:10:42.011878 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.011596 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-vcv24/must-gather-bf5sk" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerName="copy" containerID="cri-o://41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5" gracePeriod=2 Sep 17 12:10:42.018644 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.018618 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-vcv24/must-gather-bf5sk"] Sep 17 12:10:42.020383 ip-10-0-130-219 kubenswrapper[2556]: E0917 12:10:42.020345 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4a3cf9d7-623c-4055-9449-37d69bf333c4\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-vcv24\"/\"must-gather-bf5sk\": pods \"must-gather-bf5sk\" not found" pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:42.234220 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.234198 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vcv24_must-gather-bf5sk_4a3cf9d7-623c-4055-9449-37d69bf333c4/copy/0.log" Sep 17 12:10:42.236865 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.236849 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:42.239305 ip-10-0-130-219 kubenswrapper[2556]: E0917 12:10:42.239280 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bf5sk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vcv24\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:42.258068 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.258043 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnnfn\" (UniqueName: \"kubernetes.io/projected/4a3cf9d7-623c-4055-9449-37d69bf333c4-kube-api-access-hnnfn\") pod \"4a3cf9d7-623c-4055-9449-37d69bf333c4\" (UID: \"4a3cf9d7-623c-4055-9449-37d69bf333c4\") " Sep 17 12:10:42.258168 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.258097 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a3cf9d7-623c-4055-9449-37d69bf333c4-must-gather-output\") pod \"4a3cf9d7-623c-4055-9449-37d69bf333c4\" (UID: \"4a3cf9d7-623c-4055-9449-37d69bf333c4\") " Sep 17 12:10:42.258429 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.258405 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a3cf9d7-623c-4055-9449-37d69bf333c4-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "4a3cf9d7-623c-4055-9449-37d69bf333c4" (UID: "4a3cf9d7-623c-4055-9449-37d69bf333c4"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 17 12:10:42.260325 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.260306 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a3cf9d7-623c-4055-9449-37d69bf333c4-kube-api-access-hnnfn" (OuterVolumeSpecName: "kube-api-access-hnnfn") pod "4a3cf9d7-623c-4055-9449-37d69bf333c4" (UID: "4a3cf9d7-623c-4055-9449-37d69bf333c4"). InnerVolumeSpecName "kube-api-access-hnnfn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 17 12:10:42.358698 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.358669 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnnfn\" (UniqueName: \"kubernetes.io/projected/4a3cf9d7-623c-4055-9449-37d69bf333c4-kube-api-access-hnnfn\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 12:10:42.358698 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.358693 2556 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/4a3cf9d7-623c-4055-9449-37d69bf333c4-must-gather-output\") on node \"ip-10-0-130-219.ec2.internal\" DevicePath \"\"" Sep 17 12:10:42.797605 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.797580 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vcv24_must-gather-bf5sk_4a3cf9d7-623c-4055-9449-37d69bf333c4/copy/0.log" Sep 17 12:10:42.797990 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.797967 2556 generic.go:356] "Generic (PLEG): container finished" podID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerID="41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5" exitCode=143 Sep 17 12:10:42.798076 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.798017 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:42.798076 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.798032 2556 scope.go:117] "RemoveContainer" containerID="41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5" Sep 17 12:10:42.801085 ip-10-0-130-219 kubenswrapper[2556]: E0917 12:10:42.801055 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bf5sk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vcv24\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:42.805452 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.805332 2556 scope.go:117] "RemoveContainer" containerID="e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604" Sep 17 12:10:42.808643 ip-10-0-130-219 kubenswrapper[2556]: E0917 12:10:42.808612 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bf5sk\" is forbidden: User \"system:node:ip-10-0-130-219.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vcv24\": no relationship found between node 'ip-10-0-130-219.ec2.internal' and this object" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" pod="openshift-must-gather-vcv24/must-gather-bf5sk" Sep 17 12:10:42.816623 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.816607 2556 scope.go:117] "RemoveContainer" containerID="41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5" Sep 17 12:10:42.816966 ip-10-0-130-219 kubenswrapper[2556]: E0917 12:10:42.816945 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5\": container with ID starting with 41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5 not found: ID does not exist" containerID="41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5" Sep 17 12:10:42.817040 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.816974 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5"} err="failed to get container status \"41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5\": rpc error: code = NotFound desc = could not find container \"41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5\": container with ID starting with 41cfc03e691320d4629e034ae46ceece8f5e8f2c3ba7f3cc04c446d956dbd9c5 not found: ID does not exist" Sep 17 12:10:42.817040 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.816992 2556 scope.go:117] "RemoveContainer" containerID="e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604" Sep 17 12:10:42.817219 ip-10-0-130-219 kubenswrapper[2556]: E0917 12:10:42.817204 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604\": container with ID starting with e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604 not found: ID does not exist" containerID="e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604" Sep 17 12:10:42.817261 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.817222 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604"} err="failed to get container status \"e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604\": rpc error: code = NotFound desc = could not find container \"e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604\": container with ID starting with e0f094e64fb4f78e02c7ee61601193c1199d3fafc409eec909c1fd36a6c19604 not found: ID does not exist" Sep 17 12:10:42.875512 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:42.875479 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" path="/var/lib/kubelet/pods/4a3cf9d7-623c-4055-9449-37d69bf333c4/volumes" Sep 17 12:10:45.117705 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:45.117675 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d7485b976-kx4pz_9ba739d4-443a-4760-85e0-74ce96510b69/metrics-server/0.log" Sep 17 12:10:45.255827 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:45.255798 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvjvw_aceb5d44-7cd3-4fd7-9ae5-2f0471cae541/node-exporter/0.log" Sep 17 12:10:45.280530 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:45.280506 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvjvw_aceb5d44-7cd3-4fd7-9ae5-2f0471cae541/kube-rbac-proxy/0.log" Sep 17 12:10:45.300661 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:45.300633 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gvjvw_aceb5d44-7cd3-4fd7-9ae5-2f0471cae541/init-textfile/0.log" Sep 17 12:10:45.677699 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:45.677669 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gsdt2_8d7f7d6e-4568-435b-8fba-6b509cb24a4a/prometheus-operator/0.log" Sep 17 12:10:45.699453 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:45.699428 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-gsdt2_8d7f7d6e-4568-435b-8fba-6b509cb24a4a/kube-rbac-proxy/0.log" Sep 17 12:10:47.087272 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:47.087246 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-4jhtj_92239a79-33e8-49fb-8e42-ed615400f0f6/networking-console-plugin/0.log" Sep 17 12:10:49.054780 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.054741 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v4fch_cccc0856-d27d-4dad-80fa-a116933e75ca/dns/0.log" Sep 17 12:10:49.075565 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.075538 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v4fch_cccc0856-d27d-4dad-80fa-a116933e75ca/kube-rbac-proxy/0.log" Sep 17 12:10:49.146453 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.146426 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2fr74_f4a86886-462f-4f14-991c-1480440b7d2f/dns-node-resolver/0.log" Sep 17 12:10:49.611711 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.611685 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bfnx_754a307f-73dd-4bcb-8c05-1aed646bd573/node-ca/0.log" Sep 17 12:10:49.644662 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.644637 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7"] Sep 17 12:10:49.644910 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.644897 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerName="copy" Sep 17 12:10:49.644954 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.644912 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerName="copy" Sep 17 12:10:49.644954 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.644927 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerName="gather" Sep 17 12:10:49.644954 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.644933 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerName="gather" Sep 17 12:10:49.645047 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.644977 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerName="copy" Sep 17 12:10:49.645047 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.644989 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a3cf9d7-623c-4055-9449-37d69bf333c4" containerName="gather" Sep 17 12:10:49.649760 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.649740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.652348 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.652329 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xmpg\"/\"kube-root-ca.crt\"" Sep 17 12:10:49.652348 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.652339 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8xmpg\"/\"default-dockercfg-vckhs\"" Sep 17 12:10:49.653317 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.653299 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8xmpg\"/\"openshift-service-ca.crt\"" Sep 17 12:10:49.657930 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.657908 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7"] Sep 17 12:10:49.703865 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.703837 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-podres\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.703997 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.703878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-proc\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.703997 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.703973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4n6h\" (UniqueName: \"kubernetes.io/projected/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-kube-api-access-d4n6h\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.704115 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.704012 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-lib-modules\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.704115 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.704051 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-sys\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.804556 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804529 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-lib-modules\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.804744 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804564 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-sys\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.804744 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804580 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-podres\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.804744 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804636 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-proc\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.804744 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804675 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-proc\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.804744 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-sys\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.804744 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804693 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-lib-modules\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.804744 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804698 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-podres\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.805086 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.804788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4n6h\" (UniqueName: \"kubernetes.io/projected/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-kube-api-access-d4n6h\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.813846 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.813817 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4n6h\" (UniqueName: \"kubernetes.io/projected/13311b98-7022-49b3-b06c-e9a0d3dd0c0e-kube-api-access-d4n6h\") pod \"perf-node-gather-daemonset-8xrm7\" (UID: \"13311b98-7022-49b3-b06c-e9a0d3dd0c0e\") " pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:49.959856 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:49.959788 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:50.226477 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:50.226406 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7"] Sep 17 12:10:50.229368 ip-10-0-130-219 kubenswrapper[2556]: W0917 12:10:50.229341 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod13311b98_7022_49b3_b06c_e9a0d3dd0c0e.slice/crio-8b5945f82989db3a1417aaf1561708d044cac7fab55cb5662a244bf07af2cce9 WatchSource:0}: Error finding container 8b5945f82989db3a1417aaf1561708d044cac7fab55cb5662a244bf07af2cce9: Status 404 returned error can't find the container with id 8b5945f82989db3a1417aaf1561708d044cac7fab55cb5662a244bf07af2cce9 Sep 17 12:10:50.675989 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:50.675960 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-587wt_e1f3938a-91dd-4473-b40a-55f2ca5f5cf4/serve-healthcheck-canary/0.log" Sep 17 12:10:50.827826 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:50.827790 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" event={"ID":"13311b98-7022-49b3-b06c-e9a0d3dd0c0e","Type":"ContainerStarted","Data":"b7a8f83435f665e7fd6a58860e3b2ad030180dc1fd21e90b8e7e0ee4469c0f96"} Sep 17 12:10:50.827996 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:50.827842 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" event={"ID":"13311b98-7022-49b3-b06c-e9a0d3dd0c0e","Type":"ContainerStarted","Data":"8b5945f82989db3a1417aaf1561708d044cac7fab55cb5662a244bf07af2cce9"} Sep 17 12:10:50.827996 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:50.827906 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:50.845399 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:50.845349 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" podStartSLOduration=1.845336456 podStartE2EDuration="1.845336456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 12:10:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 12:10:50.844057882 +0000 UTC m=+1936.439894275" watchObservedRunningTime="2026-09-17 12:10:50.845336456 +0000 UTC m=+1936.441172837" Sep 17 12:10:51.081532 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:51.081507 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krpbp_a1a1d44f-108e-48e0-9a94-553e4d1e512c/kube-rbac-proxy/0.log" Sep 17 12:10:51.100429 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:51.100404 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krpbp_a1a1d44f-108e-48e0-9a94-553e4d1e512c/exporter/0.log" Sep 17 12:10:51.120583 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:51.120561 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krpbp_a1a1d44f-108e-48e0-9a94-553e4d1e512c/extractor/0.log" Sep 17 12:10:56.079798 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.079771 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-96gd9_164f8149-052b-4c3f-a849-78ae7b6d04ef/kube-multus-additional-cni-plugins/0.log" Sep 17 12:10:56.101468 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.101445 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-96gd9_164f8149-052b-4c3f-a849-78ae7b6d04ef/egress-router-binary-copy/0.log" Sep 17 12:10:56.122146 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.122121 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-96gd9_164f8149-052b-4c3f-a849-78ae7b6d04ef/cni-plugins/0.log" Sep 17 12:10:56.140846 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.140824 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-96gd9_164f8149-052b-4c3f-a849-78ae7b6d04ef/bond-cni-plugin/0.log" Sep 17 12:10:56.160147 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.160113 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-96gd9_164f8149-052b-4c3f-a849-78ae7b6d04ef/routeoverride-cni/0.log" Sep 17 12:10:56.180073 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.180055 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-96gd9_164f8149-052b-4c3f-a849-78ae7b6d04ef/whereabouts-cni-bincopy/0.log" Sep 17 12:10:56.199841 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.199822 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-96gd9_164f8149-052b-4c3f-a849-78ae7b6d04ef/whereabouts-cni/0.log" Sep 17 12:10:56.599339 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.599312 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-vffnr_0b272b85-4330-455f-93c4-521f974e9d70/kube-multus/0.log" Sep 17 12:10:56.715084 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.715057 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-plzr7_a3cea07b-0f93-4d30-88db-fc3ff1783cbb/network-metrics-daemon/0.log" Sep 17 12:10:56.735702 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.735681 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-plzr7_a3cea07b-0f93-4d30-88db-fc3ff1783cbb/kube-rbac-proxy/0.log" Sep 17 12:10:56.842087 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:56.842063 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8xmpg/perf-node-gather-daemonset-8xrm7" Sep 17 12:10:57.359539 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:57.359515 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdhb_b2c0f818-8e58-49af-8633-08ae590fb1d4/ovn-controller/0.log" Sep 17 12:10:57.377912 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:57.377887 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdhb_b2c0f818-8e58-49af-8633-08ae590fb1d4/ovn-acl-logging/0.log" Sep 17 12:10:57.399430 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:57.399410 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdhb_b2c0f818-8e58-49af-8633-08ae590fb1d4/kube-rbac-proxy-node/0.log" Sep 17 12:10:57.419077 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:57.419054 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdhb_b2c0f818-8e58-49af-8633-08ae590fb1d4/kube-rbac-proxy-ovn-metrics/0.log" Sep 17 12:10:57.437645 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:57.437625 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdhb_b2c0f818-8e58-49af-8633-08ae590fb1d4/northd/0.log" Sep 17 12:10:57.476443 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:57.476417 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdhb_b2c0f818-8e58-49af-8633-08ae590fb1d4/nbdb/0.log" Sep 17 12:10:57.527232 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:57.527208 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdhb_b2c0f818-8e58-49af-8633-08ae590fb1d4/sbdb/0.log" Sep 17 12:10:57.564699 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:57.564672 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dtdhb_b2c0f818-8e58-49af-8633-08ae590fb1d4/ovnkube-controller/0.log" Sep 17 12:10:59.135518 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:10:59.135490 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-59gxn_d0bf80ee-7a43-4f75-998e-ef6be1068beb/network-check-target-container/0.log" Sep 17 12:11:00.050521 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:11:00.050491 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-6bnhg_c845f68c-3884-437d-ace1-924bbaca844b/iptables-alerter/0.log" Sep 17 12:11:00.696559 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:11:00.696531 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8dhvz_81e1ce82-a776-4367-a666-e7b4c3ec6cd6/tuned/0.log" Sep 17 12:11:03.485444 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:11:03.485415 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-568869fdc5-chlrg_acd61057-91f9-47dc-99b7-b8b9a1121762/service-ca-controller/0.log" Sep 17 12:11:03.951281 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:11:03.951249 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fpt8c_b4546aec-8f06-435c-84fd-11331fe3c621/csi-driver/0.log" Sep 17 12:11:03.993099 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:11:03.993068 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fpt8c_b4546aec-8f06-435c-84fd-11331fe3c621/csi-node-driver-registrar/0.log" Sep 17 12:11:04.030024 ip-10-0-130-219 kubenswrapper[2556]: I0917 12:11:04.029998 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-fpt8c_b4546aec-8f06-435c-84fd-11331fe3c621/csi-liveness-probe/0.log"