Sep 15 09:13:25.734493 ip-10-0-142-220 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 15 09:13:25.734503 ip-10-0-142-220 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 15 09:13:25.734510 ip-10-0-142-220 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 15 09:13:25.734731 ip-10-0-142-220 systemd[1]: Failed to start Kubernetes Kubelet. Sep 15 09:13:36.685883 ip-10-0-142-220 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Sep 15 09:13:36.685894 ip-10-0-142-220 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ea36b446bae543a3be2ca0186a2bc7fd -- Sep 15 09:15:25.369688 ip-10-0-142-220 systemd[1]: Starting Kubernetes Kubelet... Sep 15 09:15:25.715115 ip-10-0-142-220 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 09:15:25.715115 ip-10-0-142-220 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 15 09:15:25.715115 ip-10-0-142-220 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 09:15:25.715115 ip-10-0-142-220 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 15 09:15:25.715115 ip-10-0-142-220 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 15 09:15:25.716636 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.716550 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 15 09:15:25.720110 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720093 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720112 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720115 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720119 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720122 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720132 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720135 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720139 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720143 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720147 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720150 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720153 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720157 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:25.720154 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720160 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720163 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720166 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720169 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720172 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720175 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720179 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720182 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720184 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720187 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720190 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720193 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720195 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720198 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720201 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720203 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720206 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720208 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720213 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:25.720494 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720217 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720220 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720223 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720226 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720230 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720233 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720239 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720242 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720245 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720247 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720250 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720253 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720256 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720259 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720261 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720265 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720268 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720271 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720274 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720276 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:25.720946 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720279 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720282 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720285 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720288 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720290 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720293 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720296 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720298 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720301 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720304 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720306 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720309 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720312 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720314 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720316 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720319 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720322 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720324 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720327 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720330 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:25.721456 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720332 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720336 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720339 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720341 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720344 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720346 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720349 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720353 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720356 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720358 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720361 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720363 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720366 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720369 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720371 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720374 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720376 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720379 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720382 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:25.721957 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720384 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720387 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720389 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720392 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720395 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720398 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720413 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.720416 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721114 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721121 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721124 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721127 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721130 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721137 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721140 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721143 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721146 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721148 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721151 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721154 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:25.722436 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721158 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721161 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721165 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721168 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721171 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721173 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721176 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721179 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721181 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721184 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721188 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721192 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721195 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721198 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721201 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721205 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721208 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721211 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721214 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:25.722970 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721217 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721220 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721223 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721226 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721229 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721232 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721235 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721238 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721241 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721244 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721247 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721250 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721252 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721255 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721258 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721261 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721263 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721266 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721268 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721271 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:25.723448 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721274 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721276 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721279 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721281 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721285 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721288 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721290 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721293 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721295 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721298 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721300 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721303 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721306 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721310 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721312 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721315 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721318 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721320 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721323 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:25.723940 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721325 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721329 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721332 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721335 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721337 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721340 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721343 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721345 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721348 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721350 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721353 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721355 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721358 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721360 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721363 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721366 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721368 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721370 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721374 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721378 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:25.724413 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721381 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721384 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721386 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721389 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721392 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721395 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721399 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721419 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721422 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721884 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721890 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721894 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721897 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721906 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721909 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721912 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721915 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721918 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721921 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721924 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:25.724919 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721927 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721930 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721933 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721935 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721938 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721940 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721943 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721945 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721948 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721950 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721954 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721958 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721961 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721964 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721967 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721969 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721972 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721975 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721979 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:25.725431 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721982 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721984 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721987 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721990 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721992 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721995 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.721997 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722000 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722003 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722006 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722008 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722011 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722013 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722016 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722018 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722021 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722024 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722026 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722029 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722032 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:25.725914 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722035 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722037 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722040 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722042 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722045 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722047 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722052 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722056 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722060 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722063 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722066 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722069 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722072 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722075 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722078 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722080 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722083 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722086 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722088 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:25.726432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722091 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722097 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722100 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722102 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722105 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722108 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722110 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722114 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722116 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722119 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722122 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722124 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722127 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722129 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722131 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722134 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722137 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722139 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722142 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722144 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:25.726897 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722147 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722149 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722152 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722155 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722158 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722161 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722163 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722166 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722168 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722171 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722246 2562 flags.go:64] FLAG: --address="0.0.0.0" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722280 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722289 2562 flags.go:64] FLAG: --anonymous-auth="true" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722293 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722298 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722301 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722306 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722310 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722313 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722318 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722321 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 15 09:15:25.727427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722325 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722328 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722331 2562 flags.go:64] FLAG: --cgroup-root="" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722334 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722337 2562 flags.go:64] FLAG: --client-ca-file="" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722340 2562 flags.go:64] FLAG: --cloud-provider="external" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722343 2562 flags.go:64] FLAG: --cluster-dns="[]" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722348 2562 flags.go:64] FLAG: --cluster-domain="" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722351 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722355 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722358 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722361 2562 flags.go:64] FLAG: --container-log-max-files="5" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722365 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722369 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722375 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722379 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722382 2562 flags.go:64] FLAG: --contention-profiling="false" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722385 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722388 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722391 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722394 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722399 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722416 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722419 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722422 2562 flags.go:64] FLAG: --enable-load-reader="false" Sep 15 09:15:25.727940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722426 2562 flags.go:64] FLAG: --enable-server="true" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722429 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722434 2562 flags.go:64] FLAG: --event-burst="100" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722437 2562 flags.go:64] FLAG: --event-qps="50" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722440 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722443 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722447 2562 flags.go:64] FLAG: --eviction-hard="" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722451 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722454 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722457 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722460 2562 flags.go:64] FLAG: --eviction-soft="" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722463 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722466 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722469 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722472 2562 flags.go:64] FLAG: --experimental-mounter-path="" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722475 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722478 2562 flags.go:64] FLAG: --fail-swap-on="true" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722481 2562 flags.go:64] FLAG: --feature-gates="" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722485 2562 flags.go:64] FLAG: --file-check-frequency="20s" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722488 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722492 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722497 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722500 2562 flags.go:64] FLAG: --healthz-port="10248" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722503 2562 flags.go:64] FLAG: --help="false" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722507 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-142-220.ec2.internal" Sep 15 09:15:25.728567 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722510 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722513 2562 flags.go:64] FLAG: --http-check-frequency="20s" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722516 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722520 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722523 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722526 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722529 2562 flags.go:64] FLAG: --image-service-endpoint="" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722532 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722535 2562 flags.go:64] FLAG: --kube-api-burst="100" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722545 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722548 2562 flags.go:64] FLAG: --kube-api-qps="50" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722551 2562 flags.go:64] FLAG: --kube-reserved="" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722554 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722557 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722560 2562 flags.go:64] FLAG: --kubelet-cgroups="" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722563 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722566 2562 flags.go:64] FLAG: --lock-file="" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722569 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722572 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722575 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722582 2562 flags.go:64] FLAG: --log-json-split-stream="false" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722586 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722588 2562 flags.go:64] FLAG: --log-text-split-stream="false" Sep 15 09:15:25.729229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722591 2562 flags.go:64] FLAG: --logging-format="text" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722594 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722598 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722601 2562 flags.go:64] FLAG: --manifest-url="" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722604 2562 flags.go:64] FLAG: --manifest-url-header="" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722610 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722614 2562 flags.go:64] FLAG: --max-open-files="1000000" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722618 2562 flags.go:64] FLAG: --max-pods="110" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722621 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722624 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722627 2562 flags.go:64] FLAG: --memory-manager-policy="None" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722630 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722633 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722636 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722639 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722647 2562 flags.go:64] FLAG: --node-status-max-images="50" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722650 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722653 2562 flags.go:64] FLAG: --oom-score-adj="-999" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722656 2562 flags.go:64] FLAG: --pod-cidr="" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722665 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722670 2562 flags.go:64] FLAG: --pod-manifest-path="" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722673 2562 flags.go:64] FLAG: --pod-max-pids="-1" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722676 2562 flags.go:64] FLAG: --pods-per-core="0" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722679 2562 flags.go:64] FLAG: --port="10250" Sep 15 09:15:25.729838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722682 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722685 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09bdf4bc5fc80e2d2" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722689 2562 flags.go:64] FLAG: --qos-reserved="" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722692 2562 flags.go:64] FLAG: --read-only-port="10255" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722695 2562 flags.go:64] FLAG: --register-node="true" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722699 2562 flags.go:64] FLAG: --register-with-taints="" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722703 2562 flags.go:64] FLAG: --registry-burst="10" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722705 2562 flags.go:64] FLAG: --registry-qps="5" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722708 2562 flags.go:64] FLAG: --reserved-cpus="" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722711 2562 flags.go:64] FLAG: --reserved-memory="" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722715 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722718 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722722 2562 flags.go:64] FLAG: --rotate-certificates="false" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722725 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722729 2562 flags.go:64] FLAG: --runonce="false" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722732 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722735 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722738 2562 flags.go:64] FLAG: --seccomp-default="false" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722741 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722744 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722747 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722750 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722754 2562 flags.go:64] FLAG: --storage-driver-password="root" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722757 2562 flags.go:64] FLAG: --storage-driver-secure="false" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722760 2562 flags.go:64] FLAG: --storage-driver-table="stats" Sep 15 09:15:25.730520 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722762 2562 flags.go:64] FLAG: --storage-driver-user="root" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722765 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722769 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722778 2562 flags.go:64] FLAG: --system-cgroups="" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722781 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722787 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722789 2562 flags.go:64] FLAG: --tls-cert-file="" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722792 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722799 2562 flags.go:64] FLAG: --tls-min-version="" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722802 2562 flags.go:64] FLAG: --tls-private-key-file="" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722805 2562 flags.go:64] FLAG: --topology-manager-policy="none" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722808 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722813 2562 flags.go:64] FLAG: --topology-manager-scope="container" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722816 2562 flags.go:64] FLAG: --v="2" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722820 2562 flags.go:64] FLAG: --version="false" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722824 2562 flags.go:64] FLAG: --vmodule="" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722828 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.722832 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722962 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722966 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722968 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722972 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722975 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722978 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:25.731175 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722981 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722984 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722987 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722989 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722992 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.722996 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723000 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723002 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723005 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723008 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723011 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723013 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723016 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723019 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723022 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723024 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723027 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723029 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723032 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:25.731783 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723035 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723039 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723041 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723045 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723049 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723052 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723055 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723058 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723061 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723064 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723069 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723072 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723075 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723078 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723080 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723083 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723085 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723088 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723091 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:25.732244 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723093 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723096 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723099 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723101 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723104 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723107 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723109 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723115 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723118 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723120 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723123 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723127 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723130 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723133 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723137 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723140 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723143 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723145 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723148 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723150 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:25.732732 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723153 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723156 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723158 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723162 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723165 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723167 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723170 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723173 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723175 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723178 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723181 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723183 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723186 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723189 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723191 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723194 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723197 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723200 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723203 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:25.733220 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723205 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723208 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723211 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723214 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723216 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723219 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723222 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723226 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723229 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723231 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723234 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723237 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723239 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723242 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723244 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:25.733798 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.723247 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.723256 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.730564 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.730580 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.731285 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.731292 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731367 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731373 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731376 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731379 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731382 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731385 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731388 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731391 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:25.734184 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731394 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731397 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731400 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731420 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731423 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731426 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731429 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731432 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731435 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731438 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731441 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731444 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731447 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731450 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731452 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731455 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731457 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731460 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731463 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731465 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:25.734569 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731468 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731473 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731476 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731479 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731481 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731484 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731487 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731490 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731492 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731495 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731498 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731500 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731503 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731506 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731508 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731511 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731513 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731516 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731519 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731521 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:25.735099 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731524 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731527 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731530 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731533 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731535 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731538 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731541 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731544 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731546 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731549 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731552 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731554 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731557 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731561 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731566 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731568 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731571 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731574 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731577 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731580 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:25.735606 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731583 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731585 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731588 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731593 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731597 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731600 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731603 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731606 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731609 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731611 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731614 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731617 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731621 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731624 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731626 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731629 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731632 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731634 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731637 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:25.736100 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731640 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731643 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731645 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731648 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731651 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731654 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731657 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731662 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731667 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731670 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731674 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731678 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.731683 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731799 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 15 09:15:25.736576 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731804 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731807 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731810 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731814 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731816 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731819 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731822 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731825 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731828 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731831 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731833 2562 feature_gate.go:328] unrecognized feature gate: Example Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731836 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731839 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731841 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731844 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731847 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731850 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731855 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731858 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 15 09:15:25.736931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731860 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731863 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731866 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731868 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731871 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731874 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731877 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731880 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731884 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731888 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731891 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731893 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731896 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731899 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731902 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731904 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731907 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731909 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731912 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 15 09:15:25.737398 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731915 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731917 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731921 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731925 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731927 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731930 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731933 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731935 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731938 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731941 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731943 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731946 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731949 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731952 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731954 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731957 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731960 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731962 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731966 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 15 09:15:25.737924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731969 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731971 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731974 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731977 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731980 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731982 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731985 2562 feature_gate.go:328] unrecognized feature gate: Example2 Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731987 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731990 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731993 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731995 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.731998 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732000 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732003 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732005 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732008 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732011 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732013 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732016 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732018 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 15 09:15:25.738533 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732021 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732024 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732026 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732029 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732032 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732034 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732037 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732039 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732042 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732044 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732047 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732050 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732053 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732055 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732058 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732060 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732063 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732066 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732069 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732071 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 15 09:15:25.739028 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:25.732074 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 15 09:15:25.739686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.732079 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 15 09:15:25.739686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.732196 2562 server.go:962] "Client rotation is on, will bootstrap in background" Sep 15 09:15:25.739686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.734260 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 15 09:15:25.739686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.735096 2562 server.go:1019] "Starting client certificate rotation" Sep 15 09:15:25.739686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.735204 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 09:15:25.739686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.735896 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 15 09:15:25.739686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.738272 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 09:15:25.743443 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.743421 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 15 09:15:25.753997 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.753976 2562 log.go:25] "Validated CRI v1 runtime API" Sep 15 09:15:25.757577 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.757553 2562 log.go:25] "Validated CRI v1 image API" Sep 15 09:15:25.758483 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.758468 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 15 09:15:25.762790 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.762766 2562 fs.go:135] Filesystem UUIDs: map[23b795ca-2bca-4d0f-9813-6d9a09e00db5:/dev/nvme0n1p3 2d995d68-4d1e-4f7d-9005-53771cf360e6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 15 09:15:25.762884 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.762787 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 15 09:15:25.765068 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.765044 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 09:15:25.767985 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.767864 2562 manager.go:216] Machine: {Timestamp:2026-09-15 09:15:25.766659578 +0000 UTC m=+0.292314871 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100464 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ab10c4a9263d4adbf427c43ec5513 SystemUUID:ec2ab10c-4a92-63d4-adbf-427c43ec5513 BootID:ea36b446-bae5-43a3-be2c-a0186a2bc7fd Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c9:0e:28:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c9:0e:28:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:40:31:df:69:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 15 09:15:25.767985 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.767979 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 15 09:15:25.768165 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.768149 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 15 09:15:25.770971 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.770941 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 15 09:15:25.771115 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.770975 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 15 09:15:25.772247 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.772235 2562 topology_manager.go:138] "Creating topology manager with none policy" Sep 15 09:15:25.772280 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.772249 2562 container_manager_linux.go:309] "Creating device plugin manager" Sep 15 09:15:25.772280 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.772263 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 09:15:25.772882 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.772870 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 15 09:15:25.774007 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.773996 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 15 09:15:25.778559 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.778545 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 15 09:15:25.778688 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.778678 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 15 09:15:25.778723 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.778708 2562 kubelet.go:486] "Attempting to sync node with API server" Sep 15 09:15:25.778723 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.778719 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 15 09:15:25.778860 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.778739 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 15 09:15:25.778860 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.778748 2562 kubelet.go:398] "Adding apiserver pod source" Sep 15 09:15:25.778860 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.778758 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 15 09:15:25.779224 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.779210 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 09:15:25.779281 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.779234 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 15 09:15:25.782209 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.782190 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 15 09:15:25.784680 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.784664 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 15 09:15:25.784747 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.784695 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 15 09:15:25.786386 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786366 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 15 09:15:25.786386 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786384 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 15 09:15:25.786386 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786391 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 15 09:15:25.786386 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786396 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 15 09:15:25.786645 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786420 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 15 09:15:25.786645 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786429 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 15 09:15:25.786645 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786443 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 15 09:15:25.786645 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786448 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 15 09:15:25.786645 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786455 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 15 09:15:25.786645 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786460 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 15 09:15:25.786645 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786470 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 15 09:15:25.786645 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.786475 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 15 09:15:25.787779 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.787767 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 15 09:15:25.787779 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.787779 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 15 09:15:25.789417 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.789377 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x22vj" Sep 15 09:15:25.790217 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.790178 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 15 09:15:25.790470 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.790437 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 15 09:15:25.791085 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.791064 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 15 09:15:25.792494 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.792474 2562 server.go:1268] "Started kubelet" Sep 15 09:15:25.792587 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.792548 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 15 09:15:25.792669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.792619 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 15 09:15:25.792725 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.792695 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 15 09:15:25.793214 ip-10-0-142-220 systemd[1]: Started Kubernetes Kubelet. Sep 15 09:15:25.794112 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.794088 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x22vj" Sep 15 09:15:25.794513 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.794480 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 15 09:15:25.794744 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.794727 2562 server.go:310] "Adding debug handlers to kubelet server" Sep 15 09:15:25.797975 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.797953 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 15 09:15:25.801503 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.800684 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-220.ec2.internal.18d573c7124e0d62 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-220.ec2.internal,UID:ip-10-0-142-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-220.ec2.internal,},FirstTimestamp:2026-09-15 09:15:25.792431458 +0000 UTC m=+0.318086751,LastTimestamp:2026-09-15 09:15:25.792431458 +0000 UTC m=+0.318086751,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-220.ec2.internal,}" Sep 15 09:15:25.801877 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.801859 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 15 09:15:25.802421 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.802387 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 15 09:15:25.803643 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.803602 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:25.804156 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.804140 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 15 09:15:25.804400 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.804284 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 15 09:15:25.804400 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.804304 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 15 09:15:25.804856 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.804815 2562 reconstruct.go:97] "Volume reconstruction finished" Sep 15 09:15:25.804856 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.804858 2562 reconciler.go:29] "Reconciler: start to sync state" Sep 15 09:15:25.805087 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.805066 2562 factory.go:55] Registering systemd factory Sep 15 09:15:25.805087 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.805089 2562 factory.go:223] Registration of the systemd container factory successfully Sep 15 09:15:25.805377 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.805361 2562 factory.go:153] Registering CRI-O factory Sep 15 09:15:25.805452 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.805383 2562 factory.go:223] Registration of the crio container factory successfully Sep 15 09:15:25.805499 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.805458 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 15 09:15:25.805499 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.805485 2562 factory.go:103] Registering Raw factory Sep 15 09:15:25.805581 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.805504 2562 manager.go:1196] Started watching for new ooms in manager Sep 15 09:15:25.805943 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.805931 2562 manager.go:349] Starting recovery of all containers Sep 15 09:15:25.806062 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.806047 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:25.808709 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.808687 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-220.ec2.internal\" not found" node="ip-10-0-142-220.ec2.internal" Sep 15 09:15:25.818486 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.818464 2562 manager.go:354] Recovery completed Sep 15 09:15:25.825163 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.825144 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:25.830154 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.830119 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:25.830253 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.830172 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:25.830253 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.830188 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:25.831054 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.831035 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 15 09:15:25.831054 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.831052 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:25.831206 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.831052 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 15 09:15:25.831206 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.831109 2562 state_mem.go:36] "Initialized new in-memory state store" Sep 15 09:15:25.832068 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.831929 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:25.832176 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.832077 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:25.832176 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.832089 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:25.833363 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.833346 2562 policy_none.go:49] "None policy: Start" Sep 15 09:15:25.833363 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.833365 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 15 09:15:25.833476 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.833378 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 15 09:15:25.835476 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.835460 2562 policy_none.go:47] "Start" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.872149 2562 manager.go:337] "Starting Device Plugin manager" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.872197 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.872209 2562 server.go:87] "Starting device plugin registration server" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.872580 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.872591 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.872696 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.872800 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.872812 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.873399 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 15 09:15:25.881686 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.873469 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:25.898619 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.898585 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 15 09:15:25.899897 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.899874 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 15 09:15:25.900015 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.899941 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 15 09:15:25.900015 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.899972 2562 kubelet.go:2448] "Starting kubelet main sync loop" Sep 15 09:15:25.900115 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.900060 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 15 09:15:25.901902 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.901881 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:25.972984 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.972891 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:25.974585 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.974565 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:25.974682 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.974600 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:25.974682 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.974613 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:25.974682 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.974636 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-220.ec2.internal" Sep 15 09:15:25.982291 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:25.982267 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-220.ec2.internal" Sep 15 09:15:25.982359 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.982302 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-220.ec2.internal\": node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:25.994048 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:25.994017 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:26.001086 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.001062 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"] Sep 15 09:15:26.001165 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.001136 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:26.002181 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.002160 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:26.002290 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.002192 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:26.002290 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.002202 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:26.004617 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.004605 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:26.004748 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.004733 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.004788 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.004764 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:26.005583 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.005566 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:26.005583 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.005579 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:26.005703 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.005605 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:26.005703 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.005618 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:26.005703 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.005636 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:26.005703 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.005651 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:26.005877 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.005785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/236f8c4bf3566120b08622f32466ee89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"236f8c4bf3566120b08622f32466ee89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.005877 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.005820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236f8c4bf3566120b08622f32466ee89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"236f8c4bf3566120b08622f32466ee89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.007951 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.007932 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.008062 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.007962 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 15 09:15:26.009159 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.009144 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientMemory" Sep 15 09:15:26.009242 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.009170 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasNoDiskPressure" Sep 15 09:15:26.009242 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.009181 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeHasSufficientPID" Sep 15 09:15:26.032252 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.032225 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-220.ec2.internal\" not found" node="ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.036741 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.036725 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-220.ec2.internal\" not found" node="ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.094128 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.094098 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:26.105935 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.105913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/236f8c4bf3566120b08622f32466ee89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"236f8c4bf3566120b08622f32466ee89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.106055 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.105941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236f8c4bf3566120b08622f32466ee89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"236f8c4bf3566120b08622f32466ee89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.106055 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.105961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67f1d1cf0f48063d0874c8424f57bf27-config\") pod \"kube-apiserver-proxy-ip-10-0-142-220.ec2.internal\" (UID: \"67f1d1cf0f48063d0874c8424f57bf27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.106055 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.105999 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/236f8c4bf3566120b08622f32466ee89-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"236f8c4bf3566120b08622f32466ee89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.106055 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.106011 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/236f8c4bf3566120b08622f32466ee89-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal\" (UID: \"236f8c4bf3566120b08622f32466ee89\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.194883 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.194829 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:26.206116 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.206087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67f1d1cf0f48063d0874c8424f57bf27-config\") pod \"kube-apiserver-proxy-ip-10-0-142-220.ec2.internal\" (UID: \"67f1d1cf0f48063d0874c8424f57bf27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.206234 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.206150 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/67f1d1cf0f48063d0874c8424f57bf27-config\") pod \"kube-apiserver-proxy-ip-10-0-142-220.ec2.internal\" (UID: \"67f1d1cf0f48063d0874c8424f57bf27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.295597 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.295511 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:26.334987 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.334961 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.340380 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.340169 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.396048 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.396015 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:26.496601 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.496562 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:26.597159 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.597073 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-220.ec2.internal\" not found" Sep 15 09:15:26.605944 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.605923 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:26.703941 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.703916 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.714602 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.714582 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 09:15:26.717046 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.717032 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" Sep 15 09:15:26.727133 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.727100 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 15 09:15:26.735261 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.735231 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 15 09:15:26.735384 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.735367 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 09:15:26.735449 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.735378 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 09:15:26.735449 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.735380 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 15 09:15:26.779491 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.779459 2562 apiserver.go:52] "Watching apiserver" Sep 15 09:15:26.797495 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.797462 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 15 09:15:26.797984 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.797959 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp","openshift-multus/network-metrics-daemon-qc74b","openshift-network-diagnostics/network-check-target-wcfmg","openshift-network-operator/iptables-alerter-lwjz8","openshift-ovn-kubernetes/ovnkube-node-jshph","kube-system/global-pull-secret-syncer-4mtmw","kube-system/konnectivity-agent-7n7vx","openshift-cluster-node-tuning-operator/tuned-tp2wn","openshift-dns/node-resolver-ggrvg","openshift-image-registry/node-ca-pss4x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal","openshift-multus/multus-8w4cc","openshift-multus/multus-additional-cni-plugins-pwszq","kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal"] Sep 15 09:15:26.800291 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.800257 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 09:10:26 +0000 UTC" deadline="2028-05-25 01:50:38.123841134 +0000 UTC" Sep 15 09:15:26.800291 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.800290 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14824h35m11.323555483s" Sep 15 09:15:26.800619 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.800604 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:26.802549 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.802528 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 15 09:15:26.803124 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.802915 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.803124 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.803038 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 15 09:15:26.803124 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.803068 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fx479\"" Sep 15 09:15:26.803124 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.803081 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 15 09:15:26.807158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.805793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:26.807158 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.805909 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:26.807158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.806325 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 15 09:15:26.807158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.806747 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nmb6r\"" Sep 15 09:15:26.807158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.806756 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 15 09:15:26.807158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.806810 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 15 09:15:26.807158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.806925 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 15 09:15:26.807158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.807119 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 15 09:15:26.809614 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/559a77da-1159-4381-b211-757ea2d74191-konnectivity-ca\") pod \"konnectivity-agent-7n7vx\" (UID: \"559a77da-1159-4381-b211-757ea2d74191\") " pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:26.809729 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-system-cni-dir\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.809729 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cnibin\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.809729 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.809729 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.809947 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.809947 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/559a77da-1159-4381-b211-757ea2d74191-agent-certs\") pod \"konnectivity-agent-7n7vx\" (UID: \"559a77da-1159-4381-b211-757ea2d74191\") " pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:26.809947 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.809947 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t978c\" (UniqueName: \"kubernetes.io/projected/98e38b20-e6ff-49f4-b365-c4f96e003c3b-kube-api-access-t978c\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.809947 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.809824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:26.810182 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.810061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:26.812432 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.812065 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 15 09:15:26.812432 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.812110 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.812432 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.812233 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 15 09:15:26.812432 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.812238 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 15 09:15:26.812867 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.812849 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b29wd\"" Sep 15 09:15:26.814441 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.814421 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-42566\"" Sep 15 09:15:26.814533 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.814493 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 15 09:15:26.814592 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.814531 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 15 09:15:26.814592 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.814567 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:26.814688 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.814633 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:26.815626 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.815558 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 15 09:15:26.815626 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.815584 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 15 09:15:26.815626 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.815596 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 15 09:15:26.815626 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.815603 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 15 09:15:26.815862 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.815826 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 15 09:15:26.816968 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.816950 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:26.819121 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.819102 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 15 09:15:26.819213 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.819123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bllqg\"" Sep 15 09:15:26.819213 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.819108 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 15 09:15:26.819393 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.819378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:26.821550 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.821531 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 15 09:15:26.821550 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.821543 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 15 09:15:26.821840 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.821824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:26.821928 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.821896 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:26.821995 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.821976 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9m5b7\"" Sep 15 09:15:26.822075 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.821988 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 15 09:15:26.824308 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.824292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:26.826343 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.826327 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ccgrx\"" Sep 15 09:15:26.826527 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.826511 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 15 09:15:26.826600 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.826590 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 15 09:15:26.826656 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.826616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.826656 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.826626 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 15 09:15:26.828737 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.828718 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5c9d7\"" Sep 15 09:15:26.829013 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.828995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.829106 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.829013 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 15 09:15:26.829106 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.829031 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 15 09:15:26.831040 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.831022 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 15 09:15:26.831208 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.831194 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jg6rn\"" Sep 15 09:15:26.840793 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.840774 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9dmx" Sep 15 09:15:26.848314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.848271 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9dmx" Sep 15 09:15:26.905262 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.905114 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 15 09:15:26.910137 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p57l\" (UniqueName: \"kubernetes.io/projected/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-kube-api-access-6p57l\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:26.910195 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn4ws\" (UniqueName: \"kubernetes.io/projected/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-kube-api-access-kn4ws\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:26.910195 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-run-netns\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.910195 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t978c\" (UniqueName: \"kubernetes.io/projected/98e38b20-e6ff-49f4-b365-c4f96e003c3b-kube-api-access-t978c\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.910330 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:26.910330 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-host-slash\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:26.910330 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6wkv\" (UniqueName: \"kubernetes.io/projected/9ba662bb-c76a-48e6-b219-ecffac8b8be1-kube-api-access-q6wkv\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.910330 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cnibin\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.910330 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.910330 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.910330 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-system-cni-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-kubelet\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910338 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cnibin\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-daemon-config\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910449 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-tuned\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910504 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-etc-kubernetes\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-ovn\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-cni-netd\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910567 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-var-lib-kubelet\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-conf-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/559a77da-1159-4381-b211-757ea2d74191-konnectivity-ca\") pod \"konnectivity-agent-7n7vx\" (UID: \"559a77da-1159-4381-b211-757ea2d74191\") " pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:26.910669 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-system-cni-dir\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910744 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/98e38b20-e6ff-49f4-b365-c4f96e003c3b-system-cni-dir\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-kubernetes\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-run\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-sys\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6285a98-34d0-4250-aa72-72f27f0920f2-tmp-dir\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b29e866-e456-46e2-82e4-697950b477f7-serviceca\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-var-lib-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910913 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-node-log\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910927 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-lib-modules\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9krdq\" (UniqueName: \"kubernetes.io/projected/8b29e866-e456-46e2-82e4-697950b477f7-kube-api-access-9krdq\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910973 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.910988 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-kubelet\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-systemd-units\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-cni-bin\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.911188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysctl-d\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-cni-binary-copy\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911097 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/559a77da-1159-4381-b211-757ea2d74191-konnectivity-ca\") pod \"konnectivity-agent-7n7vx\" (UID: \"559a77da-1159-4381-b211-757ea2d74191\") " pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysconfig\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-socket-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-cni-bin\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-kubelet-config\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-iptables-alerter-script\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1daa4c6a-3edf-440b-bf85-07b75639d061-tmp\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-socket-dir-parent\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b29e866-e456-46e2-82e4-697950b477f7-host\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-dbus\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-registration-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:26.911657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-host\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52hfl\" (UniqueName: \"kubernetes.io/projected/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-kube-api-access-52hfl\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911461 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovnkube-script-lib\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911481 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-k8s-cni-cncf-io\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-cni-multus\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-multus-certs\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-log-socket\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911588 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovnkube-config\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysctl-conf\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-systemd\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-cnibin\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6285a98-34d0-4250-aa72-72f27f0920f2-hosts-file\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7zfk\" (UniqueName: \"kubernetes.io/projected/1daa4c6a-3edf-440b-bf85-07b75639d061-kube-api-access-b7zfk\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-cni-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911710 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-systemd\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-etc-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911769 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:26.912258 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911784 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/98e38b20-e6ff-49f4-b365-c4f96e003c3b-cni-binary-copy\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-sys-fs\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxj4p\" (UniqueName: \"kubernetes.io/projected/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-kube-api-access-bxj4p\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-slash\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-env-overrides\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/559a77da-1159-4381-b211-757ea2d74191-agent-certs\") pod \"konnectivity-agent-7n7vx\" (UID: \"559a77da-1159-4381-b211-757ea2d74191\") " pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg4sw\" (UniqueName: \"kubernetes.io/projected/a6285a98-34d0-4250-aa72-72f27f0920f2-kube-api-access-qg4sw\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-modprobe-d\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-netns\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-hostroot\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.911991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovn-node-metrics-cert\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.912063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.912079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-device-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:26.912945 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.912350 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 15 09:15:26.915704 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.915685 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/559a77da-1159-4381-b211-757ea2d74191-agent-certs\") pod \"konnectivity-agent-7n7vx\" (UID: \"559a77da-1159-4381-b211-757ea2d74191\") " pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:26.915800 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.915722 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:26.915800 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.915739 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:26.915800 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.915749 2562 projected.go:196] Error preparing data for projected volume kube-api-access-nb9tj for pod openshift-network-diagnostics/network-check-target-wcfmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:26.915903 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:26.915810 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj podName:828adf4b-1f31-4105-b988-07ae711071ef nodeName:}" failed. No retries permitted until 2026-09-15 09:15:27.41578687 +0000 UTC m=+1.941442150 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nb9tj" (UniqueName: "kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj") pod "network-check-target-wcfmg" (UID: "828adf4b-1f31-4105-b988-07ae711071ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:26.918007 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.917988 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t978c\" (UniqueName: \"kubernetes.io/projected/98e38b20-e6ff-49f4-b365-c4f96e003c3b-kube-api-access-t978c\") pod \"multus-additional-cni-plugins-pwszq\" (UID: \"98e38b20-e6ff-49f4-b365-c4f96e003c3b\") " pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:26.995147 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:26.995124 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 09:15:27.012892 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.012861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1daa4c6a-3edf-440b-bf85-07b75639d061-tmp\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.012892 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.012892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-socket-dir-parent\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.012915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b29e866-e456-46e2-82e4-697950b477f7-host\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.012932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-dbus\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.012948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-registration-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.012962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-host\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52hfl\" (UniqueName: \"kubernetes.io/projected/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-kube-api-access-52hfl\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013000 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-socket-dir-parent\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.012997 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8b29e866-e456-46e2-82e4-697950b477f7-host\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013031 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-dbus\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013040 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-registration-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovnkube-script-lib\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.013098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-k8s-cni-cncf-io\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-cni-multus\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013063 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-host\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-multus-certs\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-log-socket\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013166 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-cni-multus\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovnkube-config\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysctl-conf\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-systemd\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013155 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-k8s-cni-cncf-io\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-cnibin\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013253 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-multus-certs\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-log-socket\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6285a98-34d0-4250-aa72-72f27f0920f2-hosts-file\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7zfk\" (UniqueName: \"kubernetes.io/projected/1daa4c6a-3edf-440b-bf85-07b75639d061-kube-api-access-b7zfk\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013333 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-cnibin\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013334 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-systemd\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-cni-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.013694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013365 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysctl-conf\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-systemd\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013437 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-systemd\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-etc-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013449 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-cni-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-sys-fs\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxj4p\" (UniqueName: \"kubernetes.io/projected/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-kube-api-access-bxj4p\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013583 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-etc-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013597 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-slash\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013604 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-sys-fs\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013665 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-slash\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-env-overrides\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013675 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovnkube-script-lib\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.013708 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013726 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg4sw\" (UniqueName: \"kubernetes.io/projected/a6285a98-34d0-4250-aa72-72f27f0920f2-kube-api-access-qg4sw\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:27.014538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013772 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovnkube-config\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.013825 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret podName:eac3b9bb-8116-4fb5-ad98-ad2128fdfb77 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:27.5138044 +0000 UTC m=+2.039459680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret") pod "global-pull-secret-syncer-4mtmw" (UID: "eac3b9bb-8116-4fb5-ad98-ad2128fdfb77") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-modprobe-d\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.013860 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-netns\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.013913 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs podName:aa57e01c-ee26-4f68-a370-7e7e64a3d7f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:27.513898603 +0000 UTC m=+2.039553888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs") pod "network-metrics-daemon-qc74b" (UID: "aa57e01c-ee26-4f68-a370-7e7e64a3d7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013927 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-run-netns\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013930 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-hostroot\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013956 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-hostroot\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013956 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6285a98-34d0-4250-aa72-72f27f0920f2-hosts-file\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-modprobe-d\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.013983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovn-node-metrics-cert\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-device-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p57l\" (UniqueName: \"kubernetes.io/projected/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-kube-api-access-6p57l\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.015474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014093 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn4ws\" (UniqueName: \"kubernetes.io/projected/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-kube-api-access-kn4ws\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-run-netns\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-host-slash\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014182 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-run-netns\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014139 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-device-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6wkv\" (UniqueName: \"kubernetes.io/projected/9ba662bb-c76a-48e6-b219-ecffac8b8be1-kube-api-access-q6wkv\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014239 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-host-slash\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-system-cni-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014358 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-system-cni-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-kubelet\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-daemon-config\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014449 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-kubelet\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014594 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9ba662bb-c76a-48e6-b219-ecffac8b8be1-env-overrides\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-tuned\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-etc-kubernetes\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014652 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-run-ovn-kubernetes\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.016245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-ovn\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-cni-netd\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-var-lib-kubelet\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014724 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-etc-kubernetes\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-conf-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-kubernetes\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-run\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014802 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-conf-dir\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014805 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-var-lib-kubelet\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014770 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-cni-netd\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-sys\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6285a98-34d0-4250-aa72-72f27f0920f2-tmp-dir\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014854 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-kubernetes\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014853 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-run\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b29e866-e456-46e2-82e4-697950b477f7-serviceca\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014891 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-sys\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-var-lib-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-node-log\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-lib-modules\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9krdq\" (UniqueName: \"kubernetes.io/projected/8b29e866-e456-46e2-82e4-697950b477f7-kube-api-access-9krdq\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.014992 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-multus-daemon-config\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-kubelet\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015044 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-kubelet\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-systemd-units\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015081 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-systemd-units\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015086 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-cni-bin\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015120 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-cni-bin\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015137 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6285a98-34d0-4250-aa72-72f27f0920f2-tmp-dir\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015162 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-var-lib-openvswitch\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015177 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015196 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-node-log\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015275 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-lib-modules\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015251 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.017560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015334 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8b29e866-e456-46e2-82e4-697950b477f7-serviceca\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysctl-d\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-cni-binary-copy\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015433 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysconfig\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015455 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysctl-d\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-socket-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-cni-bin\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015502 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-sysconfig\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-kubelet-config\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015538 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-host-var-lib-cni-bin\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-kubelet-config\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015540 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-iptables-alerter-script\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-socket-dir\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015669 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9ba662bb-c76a-48e6-b219-ecffac8b8be1-run-ovn\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015769 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-cni-binary-copy\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015894 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1daa4c6a-3edf-440b-bf85-07b75639d061-tmp\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.015962 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-iptables-alerter-script\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.016732 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba662bb-c76a-48e6-b219-ecffac8b8be1-ovn-node-metrics-cert\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.018018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.016936 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1daa4c6a-3edf-440b-bf85-07b75639d061-etc-tuned\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.024576 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.024543 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg4sw\" (UniqueName: \"kubernetes.io/projected/a6285a98-34d0-4250-aa72-72f27f0920f2-kube-api-access-qg4sw\") pod \"node-resolver-ggrvg\" (UID: \"a6285a98-34d0-4250-aa72-72f27f0920f2\") " pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:27.024736 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.024673 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxj4p\" (UniqueName: \"kubernetes.io/projected/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-kube-api-access-bxj4p\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:27.024736 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.024721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52hfl\" (UniqueName: \"kubernetes.io/projected/c60f258a-b437-4b93-96a7-a3fa25c7fc8c-kube-api-access-52hfl\") pod \"multus-8w4cc\" (UID: \"c60f258a-b437-4b93-96a7-a3fa25c7fc8c\") " pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.024847 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.024771 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7zfk\" (UniqueName: \"kubernetes.io/projected/1daa4c6a-3edf-440b-bf85-07b75639d061-kube-api-access-b7zfk\") pod \"tuned-tp2wn\" (UID: \"1daa4c6a-3edf-440b-bf85-07b75639d061\") " pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.025392 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.025366 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9krdq\" (UniqueName: \"kubernetes.io/projected/8b29e866-e456-46e2-82e4-697950b477f7-kube-api-access-9krdq\") pod \"node-ca-pss4x\" (UID: \"8b29e866-e456-46e2-82e4-697950b477f7\") " pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:27.025722 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.025697 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p57l\" (UniqueName: \"kubernetes.io/projected/3590d371-d8f5-4ccf-a1c9-1ed45d072d00-kube-api-access-6p57l\") pod \"aws-ebs-csi-driver-node-n6bdp\" (UID: \"3590d371-d8f5-4ccf-a1c9-1ed45d072d00\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.025968 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.025951 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn4ws\" (UniqueName: \"kubernetes.io/projected/8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09-kube-api-access-kn4ws\") pod \"iptables-alerter-lwjz8\" (UID: \"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09\") " pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:27.026066 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.026049 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6wkv\" (UniqueName: \"kubernetes.io/projected/9ba662bb-c76a-48e6-b219-ecffac8b8be1-kube-api-access-q6wkv\") pod \"ovnkube-node-jshph\" (UID: \"9ba662bb-c76a-48e6-b219-ecffac8b8be1\") " pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.120357 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.120273 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:27.130083 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.130055 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod559a77da_1159_4381_b211_757ea2d74191.slice/crio-4270d06754d5b5a1786c927ed059bf27833b035c51c43eb953755dfe7554953e WatchSource:0}: Error finding container 4270d06754d5b5a1786c927ed059bf27833b035c51c43eb953755dfe7554953e: Status 404 returned error can't find the container with id 4270d06754d5b5a1786c927ed059bf27833b035c51c43eb953755dfe7554953e Sep 15 09:15:27.136100 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.136081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pwszq" Sep 15 09:15:27.144107 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.144085 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98e38b20_e6ff_49f4_b365_c4f96e003c3b.slice/crio-a18d1bc40034fdcb2ccc8a97d7865479c5831a54f245844191210268aa778127 WatchSource:0}: Error finding container a18d1bc40034fdcb2ccc8a97d7865479c5831a54f245844191210268aa778127: Status 404 returned error can't find the container with id a18d1bc40034fdcb2ccc8a97d7865479c5831a54f245844191210268aa778127 Sep 15 09:15:27.154604 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.154581 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lwjz8" Sep 15 09:15:27.162647 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.162624 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8877f1ed_ef9c_4e7d_92de_6cbbe64c9e09.slice/crio-0809b24f73f2b3d203c055845a9bb6711ae74164fa089a68b0a05f819c105805 WatchSource:0}: Error finding container 0809b24f73f2b3d203c055845a9bb6711ae74164fa089a68b0a05f819c105805: Status 404 returned error can't find the container with id 0809b24f73f2b3d203c055845a9bb6711ae74164fa089a68b0a05f819c105805 Sep 15 09:15:27.171794 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.171776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:27.179539 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.179516 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba662bb_c76a_48e6_b219_ecffac8b8be1.slice/crio-dc9f79ac8a01cb10d0099c80654f5da45ce4d326e1578bf42e3a86fca438e013 WatchSource:0}: Error finding container dc9f79ac8a01cb10d0099c80654f5da45ce4d326e1578bf42e3a86fca438e013: Status 404 returned error can't find the container with id dc9f79ac8a01cb10d0099c80654f5da45ce4d326e1578bf42e3a86fca438e013 Sep 15 09:15:27.189135 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.189113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ggrvg" Sep 15 09:15:27.197803 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.197780 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6285a98_34d0_4250_aa72_72f27f0920f2.slice/crio-1fcd04ea611727e50ce51e22741d98da014ba86b27b93d39b3171d68ce26ba1a WatchSource:0}: Error finding container 1fcd04ea611727e50ce51e22741d98da014ba86b27b93d39b3171d68ce26ba1a: Status 404 returned error can't find the container with id 1fcd04ea611727e50ce51e22741d98da014ba86b27b93d39b3171d68ce26ba1a Sep 15 09:15:27.203270 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.203251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" Sep 15 09:15:27.211304 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.211279 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3590d371_d8f5_4ccf_a1c9_1ed45d072d00.slice/crio-b83a58b79884775cbfc0fe5a71ca79a405f1012a52fb7df57165ef1d102bd72e WatchSource:0}: Error finding container b83a58b79884775cbfc0fe5a71ca79a405f1012a52fb7df57165ef1d102bd72e: Status 404 returned error can't find the container with id b83a58b79884775cbfc0fe5a71ca79a405f1012a52fb7df57165ef1d102bd72e Sep 15 09:15:27.225623 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.225599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pss4x" Sep 15 09:15:27.234369 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.234337 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b29e866_e456_46e2_82e4_697950b477f7.slice/crio-03058375a80e8c3d725634719f1a8799a88b4ed4b7f842e0c24f030ebc7f0d89 WatchSource:0}: Error finding container 03058375a80e8c3d725634719f1a8799a88b4ed4b7f842e0c24f030ebc7f0d89: Status 404 returned error can't find the container with id 03058375a80e8c3d725634719f1a8799a88b4ed4b7f842e0c24f030ebc7f0d89 Sep 15 09:15:27.242575 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.242556 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" Sep 15 09:15:27.247275 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.247252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8w4cc" Sep 15 09:15:27.252566 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.252540 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1daa4c6a_3edf_440b_bf85_07b75639d061.slice/crio-7661f99b536fec97fa9cfce05feca7237f3047f619eaac10c2c7399972fca833 WatchSource:0}: Error finding container 7661f99b536fec97fa9cfce05feca7237f3047f619eaac10c2c7399972fca833: Status 404 returned error can't find the container with id 7661f99b536fec97fa9cfce05feca7237f3047f619eaac10c2c7399972fca833 Sep 15 09:15:27.258046 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:15:27.258022 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60f258a_b437_4b93_96a7_a3fa25c7fc8c.slice/crio-9ec334d7cf576848f06b3d06deced44c4b1a419265f2fd7b57fc3c673ca9e9d3 WatchSource:0}: Error finding container 9ec334d7cf576848f06b3d06deced44c4b1a419265f2fd7b57fc3c673ca9e9d3: Status 404 returned error can't find the container with id 9ec334d7cf576848f06b3d06deced44c4b1a419265f2fd7b57fc3c673ca9e9d3 Sep 15 09:15:27.301995 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.301968 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:27.418570 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.418489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:27.418712 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.418605 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:27.418712 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.418622 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:27.418712 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.418631 2562 projected.go:196] Error preparing data for projected volume kube-api-access-nb9tj for pod openshift-network-diagnostics/network-check-target-wcfmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:27.418712 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.418678 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj podName:828adf4b-1f31-4105-b988-07ae711071ef nodeName:}" failed. No retries permitted until 2026-09-15 09:15:28.41866433 +0000 UTC m=+2.944319610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb9tj" (UniqueName: "kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj") pod "network-check-target-wcfmg" (UID: "828adf4b-1f31-4105-b988-07ae711071ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:27.518979 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.518944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:27.518979 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.518982 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:27.519182 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.519092 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:27.519182 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.519138 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs podName:aa57e01c-ee26-4f68-a370-7e7e64a3d7f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:28.51912553 +0000 UTC m=+3.044780811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs") pod "network-metrics-daemon-qc74b" (UID: "aa57e01c-ee26-4f68-a370-7e7e64a3d7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:27.519182 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.519093 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:27.519305 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:27.519219 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret podName:eac3b9bb-8116-4fb5-ad98-ad2128fdfb77 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:28.519204672 +0000 UTC m=+3.044859954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret") pod "global-pull-secret-syncer-4mtmw" (UID: "eac3b9bb-8116-4fb5-ad98-ad2128fdfb77") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:27.673308 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.673236 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:27.755539 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.753664 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:27.851328 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.851198 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:10:27 +0000 UTC" deadline="2028-05-19 17:29:13.813754811 +0000 UTC" Sep 15 09:15:27.851328 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.851262 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14696h13m45.962498262s" Sep 15 09:15:27.948251 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.948077 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" event={"ID":"236f8c4bf3566120b08622f32466ee89","Type":"ContainerStarted","Data":"817fe70e972abf3421090272678d2ebf6131948bd470d84697824240c703c70b"} Sep 15 09:15:27.975575 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.975511 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" event={"ID":"1daa4c6a-3edf-440b-bf85-07b75639d061","Type":"ContainerStarted","Data":"7661f99b536fec97fa9cfce05feca7237f3047f619eaac10c2c7399972fca833"} Sep 15 09:15:27.990684 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.990646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" event={"ID":"3590d371-d8f5-4ccf-a1c9-1ed45d072d00","Type":"ContainerStarted","Data":"b83a58b79884775cbfc0fe5a71ca79a405f1012a52fb7df57165ef1d102bd72e"} Sep 15 09:15:27.997789 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:27.997751 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ggrvg" event={"ID":"a6285a98-34d0-4250-aa72-72f27f0920f2","Type":"ContainerStarted","Data":"1fcd04ea611727e50ce51e22741d98da014ba86b27b93d39b3171d68ce26ba1a"} Sep 15 09:15:28.026484 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.026259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerStarted","Data":"a18d1bc40034fdcb2ccc8a97d7865479c5831a54f245844191210268aa778127"} Sep 15 09:15:28.035621 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.035581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8w4cc" event={"ID":"c60f258a-b437-4b93-96a7-a3fa25c7fc8c","Type":"ContainerStarted","Data":"9ec334d7cf576848f06b3d06deced44c4b1a419265f2fd7b57fc3c673ca9e9d3"} Sep 15 09:15:28.048002 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.047864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pss4x" event={"ID":"8b29e866-e456-46e2-82e4-697950b477f7","Type":"ContainerStarted","Data":"03058375a80e8c3d725634719f1a8799a88b4ed4b7f842e0c24f030ebc7f0d89"} Sep 15 09:15:28.055397 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.055354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"dc9f79ac8a01cb10d0099c80654f5da45ce4d326e1578bf42e3a86fca438e013"} Sep 15 09:15:28.084426 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.081280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lwjz8" event={"ID":"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09","Type":"ContainerStarted","Data":"0809b24f73f2b3d203c055845a9bb6711ae74164fa089a68b0a05f819c105805"} Sep 15 09:15:28.113685 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.113573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7n7vx" event={"ID":"559a77da-1159-4381-b211-757ea2d74191","Type":"ContainerStarted","Data":"4270d06754d5b5a1786c927ed059bf27833b035c51c43eb953755dfe7554953e"} Sep 15 09:15:28.133501 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.133460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" event={"ID":"67f1d1cf0f48063d0874c8424f57bf27","Type":"ContainerStarted","Data":"3b87753a9b7e4dc7bcf576ba1e1633f02e3bac617f75049f6cacac211a03a1da"} Sep 15 09:15:28.425814 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.425091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:28.425814 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.425281 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:28.425814 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.425306 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:28.425814 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.425320 2562 projected.go:196] Error preparing data for projected volume kube-api-access-nb9tj for pod openshift-network-diagnostics/network-check-target-wcfmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:28.425814 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.425386 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj podName:828adf4b-1f31-4105-b988-07ae711071ef nodeName:}" failed. No retries permitted until 2026-09-15 09:15:30.425365687 +0000 UTC m=+4.951020972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb9tj" (UniqueName: "kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj") pod "network-check-target-wcfmg" (UID: "828adf4b-1f31-4105-b988-07ae711071ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:28.527309 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.526445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:28.527309 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.526510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:28.527309 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.526680 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:28.527309 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.526749 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs podName:aa57e01c-ee26-4f68-a370-7e7e64a3d7f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:30.526728153 +0000 UTC m=+5.052383449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs") pod "network-metrics-daemon-qc74b" (UID: "aa57e01c-ee26-4f68-a370-7e7e64a3d7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:28.527309 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.527207 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:28.527309 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.527267 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret podName:eac3b9bb-8116-4fb5-ad98-ad2128fdfb77 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:30.52724804 +0000 UTC m=+5.052903342 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret") pod "global-pull-secret-syncer-4mtmw" (UID: "eac3b9bb-8116-4fb5-ad98-ad2128fdfb77") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:28.539508 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.539263 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 15 09:15:28.852324 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.852186 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:10:27 +0000 UTC" deadline="2028-05-19 23:03:02.982634632 +0000 UTC" Sep 15 09:15:28.852324 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.852257 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14701h47m34.130383201s" Sep 15 09:15:28.900909 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.900876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:28.901127 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.900991 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:28.901127 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.901078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:28.901250 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.901162 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:28.901250 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:28.901225 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:28.901365 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:28.901299 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:30.445134 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:30.444820 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:30.445134 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.445092 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:30.445134 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.445127 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:30.445784 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.445144 2562 projected.go:196] Error preparing data for projected volume kube-api-access-nb9tj for pod openshift-network-diagnostics/network-check-target-wcfmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:30.445784 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.445221 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj podName:828adf4b-1f31-4105-b988-07ae711071ef nodeName:}" failed. No retries permitted until 2026-09-15 09:15:34.445197206 +0000 UTC m=+8.970852509 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb9tj" (UniqueName: "kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj") pod "network-check-target-wcfmg" (UID: "828adf4b-1f31-4105-b988-07ae711071ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:30.547476 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:30.547409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:30.547661 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:30.547538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:30.547739 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.547679 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:30.547797 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.547747 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret podName:eac3b9bb-8116-4fb5-ad98-ad2128fdfb77 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:34.54772644 +0000 UTC m=+9.073381736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret") pod "global-pull-secret-syncer-4mtmw" (UID: "eac3b9bb-8116-4fb5-ad98-ad2128fdfb77") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:30.548208 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.548186 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:30.548300 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.548247 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs podName:aa57e01c-ee26-4f68-a370-7e7e64a3d7f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:34.548230566 +0000 UTC m=+9.073885871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs") pod "network-metrics-daemon-qc74b" (UID: "aa57e01c-ee26-4f68-a370-7e7e64a3d7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:30.900350 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:30.900257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:30.900558 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.900421 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:30.900870 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:30.900852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:30.900972 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.900953 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:30.901036 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:30.901005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:30.901092 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:30.901072 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:32.900697 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:32.900657 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:32.901163 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:32.900698 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:32.901163 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:32.900698 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:32.901163 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:32.900815 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:32.901321 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:32.901286 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:32.901395 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:32.901372 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:34.479713 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:34.479681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:34.480167 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.479837 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:34.480167 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.479859 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:34.480167 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.479868 2562 projected.go:196] Error preparing data for projected volume kube-api-access-nb9tj for pod openshift-network-diagnostics/network-check-target-wcfmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:34.480167 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.479919 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj podName:828adf4b-1f31-4105-b988-07ae711071ef nodeName:}" failed. No retries permitted until 2026-09-15 09:15:42.47990121 +0000 UTC m=+17.005556490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb9tj" (UniqueName: "kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj") pod "network-check-target-wcfmg" (UID: "828adf4b-1f31-4105-b988-07ae711071ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:34.580431 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:34.580375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:34.580622 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:34.580450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:34.580622 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.580537 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:34.580622 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.580582 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:34.580622 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.580608 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret podName:eac3b9bb-8116-4fb5-ad98-ad2128fdfb77 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:42.58059163 +0000 UTC m=+17.106246914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret") pod "global-pull-secret-syncer-4mtmw" (UID: "eac3b9bb-8116-4fb5-ad98-ad2128fdfb77") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:34.580835 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.580631 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs podName:aa57e01c-ee26-4f68-a370-7e7e64a3d7f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:42.580617784 +0000 UTC m=+17.106273069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs") pod "network-metrics-daemon-qc74b" (UID: "aa57e01c-ee26-4f68-a370-7e7e64a3d7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:34.901298 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:34.901210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:34.901298 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:34.901228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:34.901298 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:34.901231 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:34.901628 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.901345 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:34.901628 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.901433 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:34.901628 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:34.901490 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:36.901441 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:36.900600 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:36.901441 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:36.900742 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:36.901441 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:36.901177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:36.901441 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:36.901266 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:36.901441 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:36.901330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:36.901441 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:36.901391 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:38.900603 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:38.900569 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:38.900603 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:38.900591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:38.900988 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:38.900673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:38.900988 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:38.900692 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:38.900988 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:38.900758 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:38.900988 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:38.900837 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:40.901220 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:40.901178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:40.901660 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:40.901228 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:40.901660 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:40.901178 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:40.901660 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:40.901309 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:40.901660 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:40.901429 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:40.901660 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:40.901499 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:42.535618 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:42.535571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:42.536119 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.535769 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:42.536119 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.535799 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:42.536119 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.535813 2562 projected.go:196] Error preparing data for projected volume kube-api-access-nb9tj for pod openshift-network-diagnostics/network-check-target-wcfmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:42.536119 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.535866 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj podName:828adf4b-1f31-4105-b988-07ae711071ef nodeName:}" failed. No retries permitted until 2026-09-15 09:15:58.535847944 +0000 UTC m=+33.061503224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb9tj" (UniqueName: "kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj") pod "network-check-target-wcfmg" (UID: "828adf4b-1f31-4105-b988-07ae711071ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:42.636763 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:42.636680 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:42.636763 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:42.636726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:42.636968 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.636840 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:42.636968 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.636905 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret podName:eac3b9bb-8116-4fb5-ad98-ad2128fdfb77 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:58.636889757 +0000 UTC m=+33.162545042 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret") pod "global-pull-secret-syncer-4mtmw" (UID: "eac3b9bb-8116-4fb5-ad98-ad2128fdfb77") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:42.636968 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.636844 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:42.637088 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.637002 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs podName:aa57e01c-ee26-4f68-a370-7e7e64a3d7f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:15:58.636983128 +0000 UTC m=+33.162638420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs") pod "network-metrics-daemon-qc74b" (UID: "aa57e01c-ee26-4f68-a370-7e7e64a3d7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:42.901041 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:42.900958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:42.901041 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:42.900992 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:42.901041 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:42.901009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:42.901299 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.901088 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:42.901299 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.901227 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:42.901420 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:42.901313 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:44.901099 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:44.901055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:44.901573 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:44.901118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:44.901573 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:44.901055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:44.901573 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:44.901205 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:44.901573 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:44.901275 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:44.901573 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:44.901381 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:46.900757 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:46.900462 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:46.901597 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:46.900799 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:46.901597 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:46.900835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:46.901597 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:46.900896 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:46.901597 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:46.900938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:46.901597 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:46.900994 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:47.196235 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.196004 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8w4cc" event={"ID":"c60f258a-b437-4b93-96a7-a3fa25c7fc8c","Type":"ContainerStarted","Data":"ceab56f0cd48639b3c67a8f9e0e2c5c6a3dcda23353b2fea897e9bb7023bcf44"} Sep 15 09:15:47.199903 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.199873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pss4x" event={"ID":"8b29e866-e456-46e2-82e4-697950b477f7","Type":"ContainerStarted","Data":"1d74cb8d51e0290119cda373ed5c8bf4ccbcd54fe48bf257ecc8c1ae28b1d570"} Sep 15 09:15:47.202991 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.202930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:15:47.203293 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.203271 2562 generic.go:356] "Generic (PLEG): container finished" podID="9ba662bb-c76a-48e6-b219-ecffac8b8be1" containerID="26b7de508dad04cc7f3c29b1c79021419760c69564939242953c87f5b23cca61" exitCode=1 Sep 15 09:15:47.203373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.203348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"a189cb15aaec1afbda5f704af91643fb3c41db1021a17f3eab0aaed8524c3cf5"} Sep 15 09:15:47.203498 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.203481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"fb48fa64dfe09902a8a4633b9abaf4f79223c0f6635cdcaaf779191b172d79e0"} Sep 15 09:15:47.203584 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.203564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"35d548223357396f50907008ecd0261bfc1f68acf2c9cea3e9bd8c9d8341860c"} Sep 15 09:15:47.203628 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.203606 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"f86b274d9a19f25893030d52c0239b37e39f23a270a1a99555911b3e15fb66bc"} Sep 15 09:15:47.203678 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.203645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerDied","Data":"26b7de508dad04cc7f3c29b1c79021419760c69564939242953c87f5b23cca61"} Sep 15 09:15:47.203715 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.203689 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"df5ed735f3c468398544d2b0dc7f035e4a9486cca99369e69e3df9fbf5c376b6"} Sep 15 09:15:47.204936 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.204909 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7n7vx" event={"ID":"559a77da-1159-4381-b211-757ea2d74191","Type":"ContainerStarted","Data":"e5de8719b7f16e862a0bc13049bf36665b91a987037c75fda86543c514520f91"} Sep 15 09:15:47.206424 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.206388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" event={"ID":"67f1d1cf0f48063d0874c8424f57bf27","Type":"ContainerStarted","Data":"2b332726073685959cbd2cbbb361809da3002507a6e532ffda0ebe71908355f3"} Sep 15 09:15:47.207903 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.207882 2562 generic.go:356] "Generic (PLEG): container finished" podID="236f8c4bf3566120b08622f32466ee89" containerID="0365dea1f4ed53bec405e5a175dd453161ea8d18773c6570614a595e96581ed5" exitCode=0 Sep 15 09:15:47.207992 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.207931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" event={"ID":"236f8c4bf3566120b08622f32466ee89","Type":"ContainerDied","Data":"0365dea1f4ed53bec405e5a175dd453161ea8d18773c6570614a595e96581ed5"} Sep 15 09:15:47.209515 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.209491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" event={"ID":"1daa4c6a-3edf-440b-bf85-07b75639d061","Type":"ContainerStarted","Data":"638bc11546fd36df129024d91ac729270c89cb955da4605b5d26f17bb414ee6f"} Sep 15 09:15:47.210971 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.210951 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" event={"ID":"3590d371-d8f5-4ccf-a1c9-1ed45d072d00","Type":"ContainerStarted","Data":"7a5c7ff97a583aefa2b37e43d5bf8e5bb146f54d68cc4bc2346b1899925d2303"} Sep 15 09:15:47.212285 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.212255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ggrvg" event={"ID":"a6285a98-34d0-4250-aa72-72f27f0920f2","Type":"ContainerStarted","Data":"33ff780e3700d9438cb4b37e67e6c352262efc5a64293e425655c9cde072babe"} Sep 15 09:15:47.213711 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.213691 2562 generic.go:356] "Generic (PLEG): container finished" podID="98e38b20-e6ff-49f4-b365-c4f96e003c3b" containerID="022ed04a13388745bf06d9b90396d45ddbd61740b4129627858910c89066ff4b" exitCode=0 Sep 15 09:15:47.213775 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.213720 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerDied","Data":"022ed04a13388745bf06d9b90396d45ddbd61740b4129627858910c89066ff4b"} Sep 15 09:15:47.214431 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.214380 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8w4cc" podStartSLOduration=1.916100429 podStartE2EDuration="21.214368605s" totalImagesPullingTime="19.298268176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:47.214084571 +0000 UTC m=+21.739739873" watchObservedRunningTime="2026-09-15 09:15:47.214368605 +0000 UTC m=+21.740023906" Sep 15 09:15:47.228971 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.228930 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ggrvg" podStartSLOduration=6.1398610399999995 podStartE2EDuration="21.22891601s" totalImagesPullingTime="15.08905497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:47.228631998 +0000 UTC m=+21.754287303" watchObservedRunningTime="2026-09-15 09:15:47.22891601 +0000 UTC m=+21.754571312" Sep 15 09:15:47.243097 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.243054 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pss4x" podStartSLOduration=6.190067363 podStartE2EDuration="21.24303961s" totalImagesPullingTime="15.052972247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:47.242604834 +0000 UTC m=+21.768260136" watchObservedRunningTime="2026-09-15 09:15:47.24303961 +0000 UTC m=+21.768694911" Sep 15 09:15:47.278479 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.278400 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7n7vx" podStartSLOduration=2.081037697 podStartE2EDuration="21.278379007s" totalImagesPullingTime="19.19734131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:47.27770838 +0000 UTC m=+21.803363684" watchObservedRunningTime="2026-09-15 09:15:47.278379007 +0000 UTC m=+21.804034311" Sep 15 09:15:47.318991 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.318947 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tp2wn" podStartSLOduration=2.24279532 podStartE2EDuration="21.318931095s" totalImagesPullingTime="19.076135775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:47.318791572 +0000 UTC m=+21.844446867" watchObservedRunningTime="2026-09-15 09:15:47.318931095 +0000 UTC m=+21.844586396" Sep 15 09:15:47.331764 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.331704 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-220.ec2.internal" podStartSLOduration=20.331675222 podStartE2EDuration="20.331675222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:47.331460275 +0000 UTC m=+21.857115576" watchObservedRunningTime="2026-09-15 09:15:47.331675222 +0000 UTC m=+21.857330525" Sep 15 09:15:47.338433 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.338392 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:47.527808 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.527728 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:47.941120 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:47.941073 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 15 09:15:48.218992 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.218903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" event={"ID":"3590d371-d8f5-4ccf-a1c9-1ed45d072d00","Type":"ContainerStarted","Data":"ad9fee5481afd7324f642e067138a7a78b76ae43a8a7c2dd27b6750d2c1239b6"} Sep 15 09:15:48.220801 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.220721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lwjz8" event={"ID":"8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09","Type":"ContainerStarted","Data":"c1fee6e72d4d1f6aed11fec8fe845edd8bbc272d94e4fd8686598d588a912eb3"} Sep 15 09:15:48.222988 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.222958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" event={"ID":"236f8c4bf3566120b08622f32466ee89","Type":"ContainerStarted","Data":"cb9a8eca5e33a7e9ec5a5aaf00ceff094ecc83d7edbae4c47cd64605778e0274"} Sep 15 09:15:48.241883 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.241832 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lwjz8" podStartSLOduration=3.075605441 podStartE2EDuration="22.2418103s" totalImagesPullingTime="19.166204859s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:48.241809253 +0000 UTC m=+22.767464558" watchObservedRunningTime="2026-09-15 09:15:48.2418103 +0000 UTC m=+22.767465585" Sep 15 09:15:48.257927 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.257869 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-220.ec2.internal" podStartSLOduration=21.25784589 podStartE2EDuration="21.25784589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:48.257223311 +0000 UTC m=+22.782878612" watchObservedRunningTime="2026-09-15 09:15:48.25784589 +0000 UTC m=+22.783501193" Sep 15 09:15:48.875699 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.875654 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:48.887226 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.887118 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T09:15:47.94109145Z","UUID":"f9afd654-02cd-4c4c-9722-87991ddc3276","Handler":null,"Name":"","Endpoint":""} Sep 15 09:15:48.889032 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.888922 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 15 09:15:48.889032 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.888959 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 15 09:15:48.900959 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.900877 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:48.901155 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:48.901036 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:48.901621 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.901342 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:48.901621 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:48.901382 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:48.901621 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:48.901498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:48.901621 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:48.901591 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:49.228101 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:49.228062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" event={"ID":"3590d371-d8f5-4ccf-a1c9-1ed45d072d00","Type":"ContainerStarted","Data":"a86b019073bc7c3796030dd0cc4dde454ae1779801299e752951733a1b972d50"} Sep 15 09:15:49.248816 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:49.248767 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6bdp" podStartSLOduration=2.297781777 podStartE2EDuration="23.248750399s" totalImagesPullingTime="20.950968622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:49.248471473 +0000 UTC m=+23.774126778" watchObservedRunningTime="2026-09-15 09:15:49.248750399 +0000 UTC m=+23.774405683" Sep 15 09:15:49.819848 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:49.819796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:49.916253 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:49.916079 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:50.016541 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:50.016503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:50.235017 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:50.234990 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:15:50.235498 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:50.235460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"6f05ad5991d6b865d2e3811ad2e1ac9f67a30608fb8879b2c6cd64503664104c"} Sep 15 09:15:50.874921 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:50.874869 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:50.900568 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:50.900529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:50.900568 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:50.900555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:50.900568 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:50.900547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:50.900876 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:50.900682 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:50.900876 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:50.900730 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:50.900876 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:50.900828 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:50.946549 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:50.946517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:51.074602 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:51.074567 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:51.140282 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:51.140189 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:51.198076 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:51.198044 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:51.469960 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:51.469866 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:51.470565 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:51.470539 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:52.244044 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:52.244010 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:15:52.244478 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:52.244445 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"85c2b6c1cab0f97a273e717dded5177e2457f80b20619fcc9549290a1d87d3e9"} Sep 15 09:15:52.245049 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:52.245027 2562 scope.go:117] "RemoveContainer" containerID="26b7de508dad04cc7f3c29b1c79021419760c69564939242953c87f5b23cca61" Sep 15 09:15:52.245211 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:52.245195 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7n7vx" Sep 15 09:15:52.341094 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:52.341063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:52.900686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:52.900509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:52.901098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:52.900521 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:52.901098 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:52.900759 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:52.901098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:52.900525 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:52.901098 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:52.900831 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:52.901098 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:52.900912 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:53.250362 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.250286 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:15:53.250762 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.250737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" event={"ID":"9ba662bb-c76a-48e6-b219-ecffac8b8be1","Type":"ContainerStarted","Data":"bb74a33cfc59cb3cc25f68b4c7c07f04b3d74af9e5f1cd68374814814ed240a4"} Sep 15 09:15:53.250997 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.250908 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:53.250997 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.250955 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:53.250997 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.250993 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:53.252915 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.252886 2562 generic.go:356] "Generic (PLEG): container finished" podID="98e38b20-e6ff-49f4-b365-c4f96e003c3b" containerID="93e018a95c0d5d9bfecc3e1b5872dccccfbf5b97ce4c8104fd17ecf20cdb8557" exitCode=0 Sep 15 09:15:53.253122 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.252925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerDied","Data":"93e018a95c0d5d9bfecc3e1b5872dccccfbf5b97ce4c8104fd17ecf20cdb8557"} Sep 15 09:15:53.266835 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.266812 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:53.270862 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.270840 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:15:53.278776 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.278722 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" podStartSLOduration=8.105082857 podStartE2EDuration="27.278700172s" totalImagesPullingTime="19.173617315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:53.2770693 +0000 UTC m=+27.802724602" watchObservedRunningTime="2026-09-15 09:15:53.278700172 +0000 UTC m=+27.804355474" Sep 15 09:15:53.979085 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.979044 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4mtmw"] Sep 15 09:15:53.979891 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.979200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:53.979891 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:53.979302 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:53.980622 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.980592 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wcfmg"] Sep 15 09:15:53.980739 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.980705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:53.980824 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:53.980799 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:53.993201 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.993115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qc74b"] Sep 15 09:15:53.993337 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:53.993259 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:53.993421 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:53.993383 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:54.258481 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:54.258446 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerStarted","Data":"3bcf704b651d7aeceeb40fbae2b69edca9bb4b40c1312c5a1121c18fa30f4c76"} Sep 15 09:15:55.263370 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:55.263332 2562 generic.go:356] "Generic (PLEG): container finished" podID="98e38b20-e6ff-49f4-b365-c4f96e003c3b" containerID="3bcf704b651d7aeceeb40fbae2b69edca9bb4b40c1312c5a1121c18fa30f4c76" exitCode=0 Sep 15 09:15:55.263964 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:55.263440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerDied","Data":"3bcf704b651d7aeceeb40fbae2b69edca9bb4b40c1312c5a1121c18fa30f4c76"} Sep 15 09:15:55.902174 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:55.901981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:55.902294 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:55.902263 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:55.902294 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:55.902095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:55.902428 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:55.902050 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:55.902428 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:55.902352 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:55.902529 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:55.902442 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:56.268222 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:56.268191 2562 generic.go:356] "Generic (PLEG): container finished" podID="98e38b20-e6ff-49f4-b365-c4f96e003c3b" containerID="99c6d8aa50da53b659c83ce1fba95d6d1e511af486da262d69af8dfaf16458f9" exitCode=0 Sep 15 09:15:56.268710 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:56.268263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerDied","Data":"99c6d8aa50da53b659c83ce1fba95d6d1e511af486da262d69af8dfaf16458f9"} Sep 15 09:15:57.900527 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:57.900489 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:57.900527 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:57.900526 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:57.901055 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:57.900489 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:57.901055 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:57.900631 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wcfmg" podUID="828adf4b-1f31-4105-b988-07ae711071ef" Sep 15 09:15:57.901055 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:57.900737 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qc74b" podUID="aa57e01c-ee26-4f68-a370-7e7e64a3d7f5" Sep 15 09:15:57.901055 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:57.900885 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4mtmw" podUID="eac3b9bb-8116-4fb5-ad98-ad2128fdfb77" Sep 15 09:15:58.558813 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:58.558775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:58.559123 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:58.558935 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 15 09:15:58.559123 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:58.558955 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 15 09:15:58.559123 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:58.558968 2562 projected.go:196] Error preparing data for projected volume kube-api-access-nb9tj for pod openshift-network-diagnostics/network-check-target-wcfmg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:58.559123 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:58.559037 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj podName:828adf4b-1f31-4105-b988-07ae711071ef nodeName:}" failed. No retries permitted until 2026-09-15 09:16:30.559015248 +0000 UTC m=+65.084670548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nb9tj" (UniqueName: "kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj") pod "network-check-target-wcfmg" (UID: "828adf4b-1f31-4105-b988-07ae711071ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 15 09:15:58.659644 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:58.659607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:58.659831 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:58.659652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:58.659831 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:58.659757 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:58.659831 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:58.659789 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:58.659831 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:58.659827 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret podName:eac3b9bb-8116-4fb5-ad98-ad2128fdfb77 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:30.659809926 +0000 UTC m=+65.185465206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret") pod "global-pull-secret-syncer-4mtmw" (UID: "eac3b9bb-8116-4fb5-ad98-ad2128fdfb77") : object "kube-system"/"original-pull-secret" not registered Sep 15 09:15:58.660002 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:58.659843 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs podName:aa57e01c-ee26-4f68-a370-7e7e64a3d7f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:30.659835707 +0000 UTC m=+65.185490987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs") pod "network-metrics-daemon-qc74b" (UID: "aa57e01c-ee26-4f68-a370-7e7e64a3d7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 15 09:15:58.799189 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:58.799146 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:58.863976 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:58.863921 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:59.266109 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.266028 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-220.ec2.internal" event="NodeReady" Sep 15 09:15:59.266497 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.266153 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 15 09:15:59.309499 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.309463 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6xcht"] Sep 15 09:15:59.326387 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.326354 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6jcqs"] Sep 15 09:15:59.326578 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.326508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.329257 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.329230 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9fcs\"" Sep 15 09:15:59.329438 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.329276 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 15 09:15:59.329438 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.329230 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 15 09:15:59.348697 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.348664 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6xcht"] Sep 15 09:15:59.348864 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.348710 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6jcqs"] Sep 15 09:15:59.348864 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.348779 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6jcqs" Sep 15 09:15:59.351725 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.351704 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vp2jx\"" Sep 15 09:15:59.351854 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.351704 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 15 09:15:59.351854 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.351704 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 15 09:15:59.352000 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.351987 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 15 09:15:59.438301 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.438261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:59.464496 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.464465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c-cert\") pod \"ingress-canary-6jcqs\" (UID: \"c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c\") " pod="openshift-ingress-canary/ingress-canary-6jcqs" Sep 15 09:15:59.464496 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.464515 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.464744 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.464533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh2kj\" (UniqueName: \"kubernetes.io/projected/c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c-kube-api-access-kh2kj\") pod \"ingress-canary-6jcqs\" (UID: \"c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c\") " pod="openshift-ingress-canary/ingress-canary-6jcqs" Sep 15 09:15:59.464744 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.464646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0960245-d690-47dc-af38-1a79cbc5df43-tmp-dir\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.464744 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.464693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0960245-d690-47dc-af38-1a79cbc5df43-config-volume\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.464744 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.464713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d54c4\" (UniqueName: \"kubernetes.io/projected/c0960245-d690-47dc-af38-1a79cbc5df43-kube-api-access-d54c4\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.502552 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.502514 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:15:59.565638 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.565559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c-cert\") pod \"ingress-canary-6jcqs\" (UID: \"c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c\") " pod="openshift-ingress-canary/ingress-canary-6jcqs" Sep 15 09:15:59.565638 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.565609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.565638 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.565626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh2kj\" (UniqueName: \"kubernetes.io/projected/c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c-kube-api-access-kh2kj\") pod \"ingress-canary-6jcqs\" (UID: \"c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c\") " pod="openshift-ingress-canary/ingress-canary-6jcqs" Sep 15 09:15:59.565913 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:59.565739 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:15:59.565913 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:15:59.565806 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls podName:c0960245-d690-47dc-af38-1a79cbc5df43 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:00.065785621 +0000 UTC m=+34.591440901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls") pod "dns-default-6xcht" (UID: "c0960245-d690-47dc-af38-1a79cbc5df43") : secret "dns-default-metrics-tls" not found Sep 15 09:15:59.565913 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.565868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0960245-d690-47dc-af38-1a79cbc5df43-tmp-dir\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.566055 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.565924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0960245-d690-47dc-af38-1a79cbc5df43-config-volume\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.566055 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.565951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d54c4\" (UniqueName: \"kubernetes.io/projected/c0960245-d690-47dc-af38-1a79cbc5df43-kube-api-access-d54c4\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.566211 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.566192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0960245-d690-47dc-af38-1a79cbc5df43-tmp-dir\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.566473 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.566451 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0960245-d690-47dc-af38-1a79cbc5df43-config-volume\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.570655 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.570607 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c-cert\") pod \"ingress-canary-6jcqs\" (UID: \"c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c\") " pod="openshift-ingress-canary/ingress-canary-6jcqs" Sep 15 09:15:59.574592 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.574563 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d54c4\" (UniqueName: \"kubernetes.io/projected/c0960245-d690-47dc-af38-1a79cbc5df43-kube-api-access-d54c4\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:15:59.574730 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.574698 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh2kj\" (UniqueName: \"kubernetes.io/projected/c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c-kube-api-access-kh2kj\") pod \"ingress-canary-6jcqs\" (UID: \"c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c\") " pod="openshift-ingress-canary/ingress-canary-6jcqs" Sep 15 09:15:59.657417 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.657378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6jcqs" Sep 15 09:15:59.904127 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.904088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:15:59.904127 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.904102 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:15:59.904127 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.904102 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:15:59.909049 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.909019 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wk2jz\"" Sep 15 09:15:59.909197 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.909072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 09:15:59.909280 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.909238 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 09:15:59.909336 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.909313 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g6g5g\"" Sep 15 09:15:59.909557 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.909538 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 09:15:59.909662 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:15:59.909578 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 09:16:00.069537 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:00.069499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:16:00.069718 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:00.069653 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:16:00.069782 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:00.069737 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls podName:c0960245-d690-47dc-af38-1a79cbc5df43 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:01.06971382 +0000 UTC m=+35.595369218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls") pod "dns-default-6xcht" (UID: "c0960245-d690-47dc-af38-1a79cbc5df43") : secret "dns-default-metrics-tls" not found Sep 15 09:16:01.078195 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:01.078006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:16:01.078195 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:01.078195 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:16:01.078667 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:01.078271 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls podName:c0960245-d690-47dc-af38-1a79cbc5df43 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:03.078248254 +0000 UTC m=+37.603903534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls") pod "dns-default-6xcht" (UID: "c0960245-d690-47dc-af38-1a79cbc5df43") : secret "dns-default-metrics-tls" not found Sep 15 09:16:01.222460 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:01.219769 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6jcqs"] Sep 15 09:16:01.281266 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:01.281233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6jcqs" event={"ID":"c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c","Type":"ContainerStarted","Data":"7581cf532040d65c456bf23cc22b632200daf582c83cfdc3941e2f7bba2ba89c"} Sep 15 09:16:02.287125 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:02.287088 2562 generic.go:356] "Generic (PLEG): container finished" podID="98e38b20-e6ff-49f4-b365-c4f96e003c3b" containerID="aa9c44d777d6b24e6413f7079e6c1ba0d62398a9e908299eb2bba3668e5c34b1" exitCode=0 Sep 15 09:16:02.287848 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:02.287173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerDied","Data":"aa9c44d777d6b24e6413f7079e6c1ba0d62398a9e908299eb2bba3668e5c34b1"} Sep 15 09:16:03.092784 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:03.092750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:16:03.092971 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:03.092932 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:16:03.093035 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:03.093017 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls podName:c0960245-d690-47dc-af38-1a79cbc5df43 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:07.092994148 +0000 UTC m=+41.618649428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls") pod "dns-default-6xcht" (UID: "c0960245-d690-47dc-af38-1a79cbc5df43") : secret "dns-default-metrics-tls" not found Sep 15 09:16:03.205515 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:03.205477 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:03.266932 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:03.266882 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:03.292811 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:03.292778 2562 generic.go:356] "Generic (PLEG): container finished" podID="98e38b20-e6ff-49f4-b365-c4f96e003c3b" containerID="2fd03a4b34249fa1932daaae2c5bc564c7c4ce842530be224cc78ecfc549aaa4" exitCode=0 Sep 15 09:16:03.293273 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:03.292820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerDied","Data":"2fd03a4b34249fa1932daaae2c5bc564c7c4ce842530be224cc78ecfc549aaa4"} Sep 15 09:16:04.298485 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:04.298451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pwszq" event={"ID":"98e38b20-e6ff-49f4-b365-c4f96e003c3b","Type":"ContainerStarted","Data":"b4b6a26a28421d6fe7e601482f30b2b0e63834039fe74abc2f512f4e6d4998f4"} Sep 15 09:16:04.319367 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:04.319319 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pwszq" podStartSLOduration=7.674718658 podStartE2EDuration="38.319301889s" totalImagesPullingTime="30.644583231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:04.318998334 +0000 UTC m=+38.844653655" watchObservedRunningTime="2026-09-15 09:16:04.319301889 +0000 UTC m=+38.844957190" Sep 15 09:16:04.440000 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:04.439967 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:04.540746 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:04.540711 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:04.728275 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:04.728036 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:04.830786 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:04.830746 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:05.302378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:05.302334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6jcqs" event={"ID":"c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c","Type":"ContainerStarted","Data":"f23a97b0a568f8a2cb553c15a4a61bf5f04e3b6a69870c81282af47dffd37429"} Sep 15 09:16:05.318810 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:05.318760 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6jcqs" podStartSLOduration=3.119518979 podStartE2EDuration="6.318742485s" totalImagesPullingTime="3.199223506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:05.317812907 +0000 UTC m=+39.843468222" watchObservedRunningTime="2026-09-15 09:16:05.318742485 +0000 UTC m=+39.844397787" Sep 15 09:16:06.061042 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:06.061002 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:06.124158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:06.124127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:06.664019 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:06.663986 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:06.719992 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:06.719961 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:07.121475 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:07.121445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:16:07.121624 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:07.121558 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:16:07.121624 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:07.121610 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls podName:c0960245-d690-47dc-af38-1a79cbc5df43 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:15.121596522 +0000 UTC m=+49.647251802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls") pod "dns-default-6xcht" (UID: "c0960245-d690-47dc-af38-1a79cbc5df43") : secret "dns-default-metrics-tls" not found Sep 15 09:16:10.278462 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:10.278430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:10.332259 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:10.332222 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:15.176428 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:15.176371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:16:15.176898 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:15.176532 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:16:15.176898 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:15.176611 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls podName:c0960245-d690-47dc-af38-1a79cbc5df43 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:31.17659452 +0000 UTC m=+65.702249804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls") pod "dns-default-6xcht" (UID: "c0960245-d690-47dc-af38-1a79cbc5df43") : secret "dns-default-metrics-tls" not found Sep 15 09:16:25.273860 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:25.273830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jshph" Sep 15 09:16:25.446173 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:25.446132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:25.501138 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:25.501102 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:27.018488 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.018449 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn"] Sep 15 09:16:27.022743 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.022714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn" Sep 15 09:16:27.026525 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.026501 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s49v8\"" Sep 15 09:16:27.027465 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.027450 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 15 09:16:27.027565 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.027484 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 15 09:16:27.029915 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.029893 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn"] Sep 15 09:16:27.125149 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.125110 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7fcc97bcb6-mvzt9"] Sep 15 09:16:27.127099 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.127077 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.129836 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.129812 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 15 09:16:27.129941 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.129923 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-x4grs\"" Sep 15 09:16:27.130001 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.129923 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 15 09:16:27.130068 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.130052 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 15 09:16:27.130283 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.130268 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 15 09:16:27.130421 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.130388 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 15 09:16:27.130817 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.130804 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 15 09:16:27.142294 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.142273 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fcc97bcb6-mvzt9"] Sep 15 09:16:27.161690 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.161662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzbsz\" (UniqueName: \"kubernetes.io/projected/cecd620e-a78a-4637-9948-5ec04b4994d9-kube-api-access-vzbsz\") pod \"volume-data-source-validator-86695b7cc7-8vlvn\" (UID: \"cecd620e-a78a-4637-9948-5ec04b4994d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn" Sep 15 09:16:27.262670 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.262637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzbsz\" (UniqueName: \"kubernetes.io/projected/cecd620e-a78a-4637-9948-5ec04b4994d9-kube-api-access-vzbsz\") pod \"volume-data-source-validator-86695b7cc7-8vlvn\" (UID: \"cecd620e-a78a-4637-9948-5ec04b4994d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn" Sep 15 09:16:27.262869 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.262676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.262869 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.262724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-stats-auth\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.262869 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.262751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv8mz\" (UniqueName: \"kubernetes.io/projected/c5378404-461a-4a2b-ac48-5f6552115a14-kube-api-access-kv8mz\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.262869 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.262782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.263047 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.262868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-default-certificate\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.263844 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.263821 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:27.276695 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.276635 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzbsz\" (UniqueName: \"kubernetes.io/projected/cecd620e-a78a-4637-9948-5ec04b4994d9-kube-api-access-vzbsz\") pod \"volume-data-source-validator-86695b7cc7-8vlvn\" (UID: \"cecd620e-a78a-4637-9948-5ec04b4994d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn" Sep 15 09:16:27.332541 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.332494 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn" Sep 15 09:16:27.363572 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.363542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.363762 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.363603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-stats-auth\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.363762 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.363628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv8mz\" (UniqueName: \"kubernetes.io/projected/c5378404-461a-4a2b-ac48-5f6552115a14-kube-api-access-kv8mz\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.363762 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.363660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.363762 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.363690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-default-certificate\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.363762 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:27.363713 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:27.863689548 +0000 UTC m=+62.389344839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : configmap references non-existent config key: service-ca.crt Sep 15 09:16:27.364037 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:27.363770 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 09:16:27.364037 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:27.363813 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:27.863800171 +0000 UTC m=+62.389455468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : secret "router-metrics-certs-default" not found Sep 15 09:16:27.365008 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.364954 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:27.366387 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.366365 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-default-certificate\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.366508 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.366487 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-stats-auth\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.376341 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.376318 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv8mz\" (UniqueName: \"kubernetes.io/projected/c5378404-461a-4a2b-ac48-5f6552115a14-kube-api-access-kv8mz\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.599356 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.599276 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn"] Sep 15 09:16:27.602739 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:16:27.602714 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecd620e_a78a_4637_9948_5ec04b4994d9.slice/crio-71322ba2f7a3cd5c47b9ec4081177c1d866faefbb31a2cbf45ae58870fcd4b4d WatchSource:0}: Error finding container 71322ba2f7a3cd5c47b9ec4081177c1d866faefbb31a2cbf45ae58870fcd4b4d: Status 404 returned error can't find the container with id 71322ba2f7a3cd5c47b9ec4081177c1d866faefbb31a2cbf45ae58870fcd4b4d Sep 15 09:16:27.868681 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.868641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.868871 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.868721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:27.868871 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:27.868825 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:28.868806871 +0000 UTC m=+63.394462155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : configmap references non-existent config key: service-ca.crt Sep 15 09:16:27.868871 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:27.868833 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 09:16:27.868871 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:27.868868 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:28.868860756 +0000 UTC m=+63.394516035 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : secret "router-metrics-certs-default" not found Sep 15 09:16:27.952220 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:27.952184 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:28.013142 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:28.013113 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:28.063214 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:28.063166 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:28.363757 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:28.363717 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn" event={"ID":"cecd620e-a78a-4637-9948-5ec04b4994d9","Type":"ContainerStarted","Data":"71322ba2f7a3cd5c47b9ec4081177c1d866faefbb31a2cbf45ae58870fcd4b4d"} Sep 15 09:16:28.877795 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:28.877686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:28.877795 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:28.877773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:28.877997 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:28.877878 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:30.877856457 +0000 UTC m=+65.403511741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : configmap references non-existent config key: service-ca.crt Sep 15 09:16:28.877997 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:28.877917 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 09:16:28.877997 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:28.877972 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:30.877959833 +0000 UTC m=+65.403615145 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : secret "router-metrics-certs-default" not found Sep 15 09:16:29.367527 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:29.367494 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn" event={"ID":"cecd620e-a78a-4637-9948-5ec04b4994d9","Type":"ContainerStarted","Data":"c1b1a5f0cae3297c8fe98e5de611cb540a3a28b8af7e635dc0acd944f2811a16"} Sep 15 09:16:29.382629 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:29.382578 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8vlvn" podStartSLOduration=1.367554286 podStartE2EDuration="2.382561513s" totalImagesPullingTime="1.015007227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:29.381945919 +0000 UTC m=+63.907601221" watchObservedRunningTime="2026-09-15 09:16:29.382561513 +0000 UTC m=+63.908216815" Sep 15 09:16:29.474528 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:29.474484 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:29.525051 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:29.525014 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:30.591849 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.591802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:16:30.594518 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.594493 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 15 09:16:30.604565 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.604538 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 15 09:16:30.614807 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.614779 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb9tj\" (UniqueName: \"kubernetes.io/projected/828adf4b-1f31-4105-b988-07ae711071ef-kube-api-access-nb9tj\") pod \"network-check-target-wcfmg\" (UID: \"828adf4b-1f31-4105-b988-07ae711071ef\") " pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:16:30.692824 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.692788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:16:30.692824 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.692835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:16:30.695431 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.695349 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 15 09:16:30.695578 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.695535 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 15 09:16:30.703371 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:30.703349 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 15 09:16:30.703467 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:30.703452 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs podName:aa57e01c-ee26-4f68-a370-7e7e64a3d7f5 nodeName:}" failed. No retries permitted until 2026-09-15 09:17:34.703392479 +0000 UTC m=+129.229047759 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs") pod "network-metrics-daemon-qc74b" (UID: "aa57e01c-ee26-4f68-a370-7e7e64a3d7f5") : secret "metrics-daemon-secret" not found Sep 15 09:16:30.705826 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.705806 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/eac3b9bb-8116-4fb5-ad98-ad2128fdfb77-original-pull-secret\") pod \"global-pull-secret-syncer-4mtmw\" (UID: \"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77\") " pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:16:30.827662 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.827633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wk2jz\"" Sep 15 09:16:30.830659 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.830642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4mtmw" Sep 15 09:16:30.835798 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.835776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:16:30.894265 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.894236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:30.894357 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:30.894300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:30.894472 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:30.894450 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 09:16:30.894533 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:30.894464 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:34.89444429 +0000 UTC m=+69.420099570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : configmap references non-existent config key: service-ca.crt Sep 15 09:16:30.894596 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:30.894537 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:34.894520181 +0000 UTC m=+69.420175462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : secret "router-metrics-certs-default" not found Sep 15 09:16:31.129537 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.129504 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4mtmw"] Sep 15 09:16:31.132395 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:16:31.132370 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeac3b9bb_8116_4fb5_ad98_ad2128fdfb77.slice/crio-3abd39ed8792c0c7e29ee39b16124b718997c1b06862eb336d19a3cf31cc424d WatchSource:0}: Error finding container 3abd39ed8792c0c7e29ee39b16124b718997c1b06862eb336d19a3cf31cc424d: Status 404 returned error can't find the container with id 3abd39ed8792c0c7e29ee39b16124b718997c1b06862eb336d19a3cf31cc424d Sep 15 09:16:31.163601 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.163567 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wcfmg"] Sep 15 09:16:31.165792 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:16:31.165764 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod828adf4b_1f31_4105_b988_07ae711071ef.slice/crio-727b15ab9b3b820b4263f9428f204178fb3b8b50fe47c60a6d112308ac8cb2c2 WatchSource:0}: Error finding container 727b15ab9b3b820b4263f9428f204178fb3b8b50fe47c60a6d112308ac8cb2c2: Status 404 returned error can't find the container with id 727b15ab9b3b820b4263f9428f204178fb3b8b50fe47c60a6d112308ac8cb2c2 Sep 15 09:16:31.197145 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.197108 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:16:31.197306 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:31.197275 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 15 09:16:31.197360 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:31.197349 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls podName:c0960245-d690-47dc-af38-1a79cbc5df43 nodeName:}" failed. No retries permitted until 2026-09-15 09:17:03.197329736 +0000 UTC m=+97.722985034 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls") pod "dns-default-6xcht" (UID: "c0960245-d690-47dc-af38-1a79cbc5df43") : secret "dns-default-metrics-tls" not found Sep 15 09:16:31.216910 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.216874 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:31.281632 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.281591 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:31.373831 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.373793 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4mtmw" event={"ID":"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77","Type":"ContainerStarted","Data":"3abd39ed8792c0c7e29ee39b16124b718997c1b06862eb336d19a3cf31cc424d"} Sep 15 09:16:31.374940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.374918 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wcfmg" event={"ID":"828adf4b-1f31-4105-b988-07ae711071ef","Type":"ContainerStarted","Data":"727b15ab9b3b820b4263f9428f204178fb3b8b50fe47c60a6d112308ac8cb2c2"} Sep 15 09:16:31.625151 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.625115 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:31.690011 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.689965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:31.753447 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.753365 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:31.868927 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.868890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:31.970675 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.970593 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:31.981815 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:31.981777 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l87kp"] Sep 15 09:16:32.001850 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.001815 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb"] Sep 15 09:16:32.002154 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.002130 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.004709 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.004681 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 15 09:16:32.004995 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.004976 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7n7bt\"" Sep 15 09:16:32.005176 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.005162 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 15 09:16:32.005364 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.005350 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 15 09:16:32.005606 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.005588 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 15 09:16:32.019868 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.019836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l87kp"] Sep 15 09:16:32.019999 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.019894 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb"] Sep 15 09:16:32.019999 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.019986 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:32.025091 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.025066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 15 09:16:32.025234 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.025169 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 15 09:16:32.028090 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.028065 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4g46t\"" Sep 15 09:16:32.080229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.080186 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:32.103841 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.103804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b848470-f045-4acb-8bbe-afa14468cbbc-data-volume\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.104036 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.103852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.104036 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.103923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b848470-f045-4acb-8bbe-afa14468cbbc-crio-socket\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.104036 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.103979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.104036 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.104032 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqdx4\" (UniqueName: \"kubernetes.io/projected/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-api-access-pqdx4\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.204823 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.204781 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b848470-f045-4acb-8bbe-afa14468cbbc-data-volume\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.205019 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.204831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.205019 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.204875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b848470-f045-4acb-8bbe-afa14468cbbc-crio-socket\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.205019 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.204905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/79e34300-eb34-4e86-8c51-af0b349a38a2-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:32.205019 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.204941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.205019 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.204973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqdx4\" (UniqueName: \"kubernetes.io/projected/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-api-access-pqdx4\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.205019 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.205017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:32.205210 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.205145 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:32.205210 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.205162 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b848470-f045-4acb-8bbe-afa14468cbbc-data-volume\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.205210 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.205205 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:32.705186246 +0000 UTC m=+67.230841532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : configmap "kube-rbac-proxy" not found Sep 15 09:16:32.205321 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.205230 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2b848470-f045-4acb-8bbe-afa14468cbbc-crio-socket\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.205321 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.205283 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:32.205321 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.205316 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:32.705305548 +0000 UTC m=+67.230960841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:32.215490 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.215454 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqdx4\" (UniqueName: \"kubernetes.io/projected/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-api-access-pqdx4\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.305927 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.305837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:32.306083 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.305965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/79e34300-eb34-4e86-8c51-af0b349a38a2-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:32.306083 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.305998 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 09:16:32.306194 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.306085 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert podName:79e34300-eb34-4e86-8c51-af0b349a38a2 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:32.806063992 +0000 UTC m=+67.331719286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-p9mvb" (UID: "79e34300-eb34-4e86-8c51-af0b349a38a2") : secret "networking-console-plugin-cert" not found Sep 15 09:16:32.306653 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.306626 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/79e34300-eb34-4e86-8c51-af0b349a38a2-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:32.709152 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.709109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.709725 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.709186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:32.709725 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.709251 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:32.709725 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.709331 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:33.709309936 +0000 UTC m=+68.234965234 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : configmap "kube-rbac-proxy" not found Sep 15 09:16:32.709725 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.709376 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:32.709725 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.709460 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:33.709442043 +0000 UTC m=+68.235097330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:32.809851 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:32.809812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:32.810020 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.809980 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 09:16:32.810070 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:32.810064 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert podName:79e34300-eb34-4e86-8c51-af0b349a38a2 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:33.810044104 +0000 UTC m=+68.335699390 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-p9mvb" (UID: "79e34300-eb34-4e86-8c51-af0b349a38a2") : secret "networking-console-plugin-cert" not found Sep 15 09:16:33.468995 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.467928 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-xcq95"] Sep 15 09:16:33.472249 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.472223 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.474839 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.474811 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 15 09:16:33.475781 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.475745 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 15 09:16:33.475896 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.475750 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-fm4bt\"" Sep 15 09:16:33.475961 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.475905 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 15 09:16:33.476091 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.476075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 15 09:16:33.481102 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.481078 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-xcq95"] Sep 15 09:16:33.503734 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.503674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:33.515563 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.515531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fscv\" (UniqueName: \"kubernetes.io/projected/97c7651b-b9fe-455a-8871-4b49a6e75066-kube-api-access-2fscv\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.515760 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.515613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97c7651b-b9fe-455a-8871-4b49a6e75066-signing-cabundle\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.515760 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.515648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97c7651b-b9fe-455a-8871-4b49a6e75066-signing-key\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.560873 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.560835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:33.617458 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.617417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fscv\" (UniqueName: \"kubernetes.io/projected/97c7651b-b9fe-455a-8871-4b49a6e75066-kube-api-access-2fscv\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.617652 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.617534 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97c7651b-b9fe-455a-8871-4b49a6e75066-signing-cabundle\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.617652 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.617575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97c7651b-b9fe-455a-8871-4b49a6e75066-signing-key\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.619283 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.619248 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97c7651b-b9fe-455a-8871-4b49a6e75066-signing-cabundle\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.622625 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.622595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97c7651b-b9fe-455a-8871-4b49a6e75066-signing-key\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.631229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.631178 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fscv\" (UniqueName: \"kubernetes.io/projected/97c7651b-b9fe-455a-8871-4b49a6e75066-kube-api-access-2fscv\") pod \"service-ca-568869fdc5-xcq95\" (UID: \"97c7651b-b9fe-455a-8871-4b49a6e75066\") " pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.719119 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.719029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:33.719600 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.719179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:33.719600 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:33.719190 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:33.719600 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:33.719261 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:35.719242002 +0000 UTC m=+70.244897295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:33.719600 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:33.719273 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:33.719600 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:33.719339 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:35.719323515 +0000 UTC m=+70.244978797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : configmap "kube-rbac-proxy" not found Sep 15 09:16:33.784637 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.784597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-xcq95" Sep 15 09:16:33.820311 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:33.820268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:33.820483 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:33.820396 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 09:16:33.820483 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:33.820479 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert podName:79e34300-eb34-4e86-8c51-af0b349a38a2 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:35.820456595 +0000 UTC m=+70.346111898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-p9mvb" (UID: "79e34300-eb34-4e86-8c51-af0b349a38a2") : secret "networking-console-plugin-cert" not found Sep 15 09:16:34.414897 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:34.414857 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:34.751385 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:34.751301 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ggrvg_a6285a98-34d0-4250-aa72-72f27f0920f2/dns-node-resolver/0.log" Sep 15 09:16:34.931255 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:34.931215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:34.931449 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:34.931394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:34.931449 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:34.931428 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:42.931391353 +0000 UTC m=+77.457046650 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : configmap references non-existent config key: service-ca.crt Sep 15 09:16:34.931642 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:34.931514 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 09:16:34.931642 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:34.931564 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:42.931549074 +0000 UTC m=+77.457204371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : secret "router-metrics-certs-default" not found Sep 15 09:16:35.738399 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:35.738363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:35.738399 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:35.738437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:35.738628 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:35.738495 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:35.738628 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:35.738539 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:35.738628 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:35.738569 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:39.738550309 +0000 UTC m=+74.264205609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : configmap "kube-rbac-proxy" not found Sep 15 09:16:35.738628 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:35.738584 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:39.73857832 +0000 UTC m=+74.264233599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:35.839178 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:35.839137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:35.839603 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:35.839316 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 09:16:35.839603 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:35.839415 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert podName:79e34300-eb34-4e86-8c51-af0b349a38a2 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:39.839375612 +0000 UTC m=+74.365030911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-p9mvb" (UID: "79e34300-eb34-4e86-8c51-af0b349a38a2") : secret "networking-console-plugin-cert" not found Sep 15 09:16:35.949075 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:35.949048 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pss4x_8b29e866-e456-46e2-82e4-697950b477f7/node-ca/0.log" Sep 15 09:16:36.034159 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:36.034084 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-xcq95"] Sep 15 09:16:36.040728 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:16:36.040699 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c7651b_b9fe_455a_8871_4b49a6e75066.slice/crio-10773744bb93e099b8ad6f9c120338c7dec5262f4be8becb4bd6ccb9f07b8b7e WatchSource:0}: Error finding container 10773744bb93e099b8ad6f9c120338c7dec5262f4be8becb4bd6ccb9f07b8b7e: Status 404 returned error can't find the container with id 10773744bb93e099b8ad6f9c120338c7dec5262f4be8becb4bd6ccb9f07b8b7e Sep 15 09:16:36.391261 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:36.391226 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wcfmg" event={"ID":"828adf4b-1f31-4105-b988-07ae711071ef","Type":"ContainerStarted","Data":"6b9680afa54d8611c6e89189ccfc5b9f6f489e6a94ea9b4b8d4efc0c3b0f6fa7"} Sep 15 09:16:36.391503 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:36.391392 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:16:36.392673 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:36.392645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4mtmw" event={"ID":"eac3b9bb-8116-4fb5-ad98-ad2128fdfb77","Type":"ContainerStarted","Data":"1d8bcdb44c96b871a30afc3ea3147a651bd2afd1fb39125e50a2d63d878b93b7"} Sep 15 09:16:36.393765 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:36.393743 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-xcq95" event={"ID":"97c7651b-b9fe-455a-8871-4b49a6e75066","Type":"ContainerStarted","Data":"10773744bb93e099b8ad6f9c120338c7dec5262f4be8becb4bd6ccb9f07b8b7e"} Sep 15 09:16:36.406193 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:36.406140 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wcfmg" podStartSLOduration=65.802735382 podStartE2EDuration="1m10.406122236s" totalImagesPullingTime="4.603386854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:36.40609783 +0000 UTC m=+70.931753154" watchObservedRunningTime="2026-09-15 09:16:36.406122236 +0000 UTC m=+70.931777536" Sep 15 09:16:36.420637 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:36.420580 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4mtmw" podStartSLOduration=65.772763034 podStartE2EDuration="1m10.420566013s" totalImagesPullingTime="4.647802979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:36.420537379 +0000 UTC m=+70.946192681" watchObservedRunningTime="2026-09-15 09:16:36.420566013 +0000 UTC m=+70.946221324" Sep 15 09:16:36.547779 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:36.547744 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6jcqs_c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c/serve-healthcheck-canary/0.log" Sep 15 09:16:37.111104 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:37.111069 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:38.401581 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:38.401546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-xcq95" event={"ID":"97c7651b-b9fe-455a-8871-4b49a6e75066","Type":"ContainerStarted","Data":"8657de7b2f3b6576416810851deb66b0704e03960d45572a9bcb8efb9d51d46d"} Sep 15 09:16:38.420053 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:38.419990 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-xcq95" podStartSLOduration=3.539995093 podStartE2EDuration="5.419969508s" totalImagesPullingTime="1.879974415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:38.419191875 +0000 UTC m=+72.944847176" watchObservedRunningTime="2026-09-15 09:16:38.419969508 +0000 UTC m=+72.945624810" Sep 15 09:16:38.696342 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:38.696250 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:38.798290 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:38.798249 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:38.905644 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:38.905601 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:39.093864 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:39.093771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:39.195664 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:39.195629 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:39.257839 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:39.257805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:39.348202 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:39.348103 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:39.775564 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:39.775525 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:39.775971 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:39.775585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:39.775971 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:39.775660 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 15 09:16:39.775971 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:39.775701 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:39.775971 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:39.775732 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:47.775713039 +0000 UTC m=+82.301368330 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : configmap "kube-rbac-proxy" not found Sep 15 09:16:39.775971 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:39.775748 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:16:47.775742518 +0000 UTC m=+82.301397799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:39.876908 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:39.876864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:39.877094 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:39.877013 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 15 09:16:39.877094 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:39.877082 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert podName:79e34300-eb34-4e86-8c51-af0b349a38a2 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:47.877064638 +0000 UTC m=+82.402719920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-p9mvb" (UID: "79e34300-eb34-4e86-8c51-af0b349a38a2") : secret "networking-console-plugin-cert" not found Sep 15 09:16:40.147586 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:40.147555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:40.541774 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:40.541663 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:40.744767 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:40.744733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:41.153387 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:41.153349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:41.942153 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:41.942109 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:42.143795 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:42.143760 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:42.347681 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:42.347595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:42.485074 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:42.485023 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:42.584296 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:42.584251 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:42.775521 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:42.775486 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:43.003121 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:43.003081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:43.003302 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:43.003142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:43.003302 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:43.003254 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:59.003235277 +0000 UTC m=+93.528890556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : configmap references non-existent config key: service-ca.crt Sep 15 09:16:43.003302 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:43.003259 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 15 09:16:43.003302 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:43.003295 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs podName:c5378404-461a-4a2b-ac48-5f6552115a14 nodeName:}" failed. No retries permitted until 2026-09-15 09:16:59.003288208 +0000 UTC m=+93.528943489 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs") pod "router-default-7fcc97bcb6-mvzt9" (UID: "c5378404-461a-4a2b-ac48-5f6552115a14") : secret "router-metrics-certs-default" not found Sep 15 09:16:43.157638 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:43.157597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:43.746934 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:43.746899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:44.145732 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:44.145696 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:44.425475 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:44.425385 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:44.538160 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:44.538128 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:44.937961 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:44.937923 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:45.040525 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:45.040490 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:45.147232 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:45.147198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:45.567530 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:45.567498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:45.745555 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:45.745518 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:46.141422 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:46.141376 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:46.342852 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:46.342812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:46.741806 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:46.741776 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:47.542157 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:47.542124 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:47.842169 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:47.842072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:47.842169 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:47.842136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:47.842358 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:47.842287 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 15 09:16:47.842394 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:16:47.842374 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls podName:2b848470-f045-4acb-8bbe-afa14468cbbc nodeName:}" failed. No retries permitted until 2026-09-15 09:17:03.842353929 +0000 UTC m=+98.368009227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l87kp" (UID: "2b848470-f045-4acb-8bbe-afa14468cbbc") : secret "insights-runtime-extractor-tls" not found Sep 15 09:16:47.842824 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:47.842802 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2b848470-f045-4acb-8bbe-afa14468cbbc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:16:47.943222 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:47.943177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:47.946372 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:47.946342 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e34300-eb34-4e86-8c51-af0b349a38a2-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-p9mvb\" (UID: \"79e34300-eb34-4e86-8c51-af0b349a38a2\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:47.946805 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:47.946774 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:48.142067 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:48.142031 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:48.233006 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:48.232966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" Sep 15 09:16:48.344470 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:48.344435 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:48.503311 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:48.503231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb"] Sep 15 09:16:48.506580 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:16:48.506540 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e34300_eb34_4e86_8c51_af0b349a38a2.slice/crio-4fa5d83b87161d87d316d272e38824a7b8dbd953924809d77bdbed85147e6f8b WatchSource:0}: Error finding container 4fa5d83b87161d87d316d272e38824a7b8dbd953924809d77bdbed85147e6f8b: Status 404 returned error can't find the container with id 4fa5d83b87161d87d316d272e38824a7b8dbd953924809d77bdbed85147e6f8b Sep 15 09:16:48.742744 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:48.742703 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:49.143844 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:49.143805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:49.340084 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:49.340051 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:49.440095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:49.440013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" event={"ID":"79e34300-eb34-4e86-8c51-af0b349a38a2","Type":"ContainerStarted","Data":"4fa5d83b87161d87d316d272e38824a7b8dbd953924809d77bdbed85147e6f8b"} Sep 15 09:16:50.444836 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:50.444803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" event={"ID":"79e34300-eb34-4e86-8c51-af0b349a38a2","Type":"ContainerStarted","Data":"1817309ab6b5fb4c8995ba0dadb7fe28b80d73ca213157ba5024543e6b229aec"} Sep 15 09:16:50.463644 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:50.463577 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-p9mvb" podStartSLOduration=18.312844181 podStartE2EDuration="19.463559964s" totalImagesPullingTime="1.150715783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:50.463361786 +0000 UTC m=+84.989017087" watchObservedRunningTime="2026-09-15 09:16:50.463559964 +0000 UTC m=+84.989215265" Sep 15 09:16:53.834980 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.834944 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p"] Sep 15 09:16:53.843868 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.843830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:53.848739 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.848712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 15 09:16:53.848966 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.848945 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 15 09:16:53.849034 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.848987 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 15 09:16:53.849748 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.849727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 15 09:16:53.849870 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.849761 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 15 09:16:53.851399 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.851379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 15 09:16:53.851538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.851465 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 15 09:16:53.855572 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.855545 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p"] Sep 15 09:16:53.979637 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.979581 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:53.987541 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.987510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-hub\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:53.987672 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.987548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:53.987672 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.987581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6adc5c40-1e91-4357-abbe-dc2237106ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:53.987672 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.987640 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:53.987777 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.987725 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-ca\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:53.987777 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:53.987749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj72t\" (UniqueName: \"kubernetes.io/projected/6adc5c40-1e91-4357-abbe-dc2237106ae6-kube-api-access-pj72t\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.075913 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.075881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:54.088310 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.088225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-hub\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.088310 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.088263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.088310 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.088298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6adc5c40-1e91-4357-abbe-dc2237106ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.088631 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.088324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.088631 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.088385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-ca\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.088631 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.088435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj72t\" (UniqueName: \"kubernetes.io/projected/6adc5c40-1e91-4357-abbe-dc2237106ae6-kube-api-access-pj72t\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.089099 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.089073 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6adc5c40-1e91-4357-abbe-dc2237106ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.090961 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.090935 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.091077 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.091025 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-hub\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.091245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.091223 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-ca\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.091313 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.091297 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6adc5c40-1e91-4357-abbe-dc2237106ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.097754 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.097726 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj72t\" (UniqueName: \"kubernetes.io/projected/6adc5c40-1e91-4357-abbe-dc2237106ae6-kube-api-access-pj72t\") pod \"cluster-proxy-proxy-agent-7c84fd4d45-c6m5p\" (UID: \"6adc5c40-1e91-4357-abbe-dc2237106ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.163717 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.163679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" Sep 15 09:16:54.178031 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.177994 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:54.436199 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.436170 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p"] Sep 15 09:16:54.438362 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:16:54.438335 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6adc5c40_1e91_4357_abbe_dc2237106ae6.slice/crio-64ed51cc7c907f6e82febd47c2493cf16fcca5c8f3c2ba320b4e643e28a1b016 WatchSource:0}: Error finding container 64ed51cc7c907f6e82febd47c2493cf16fcca5c8f3c2ba320b4e643e28a1b016: Status 404 returned error can't find the container with id 64ed51cc7c907f6e82febd47c2493cf16fcca5c8f3c2ba320b4e643e28a1b016 Sep 15 09:16:54.458310 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:54.458281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" event={"ID":"6adc5c40-1e91-4357-abbe-dc2237106ae6","Type":"ContainerStarted","Data":"64ed51cc7c907f6e82febd47c2493cf16fcca5c8f3c2ba320b4e643e28a1b016"} Sep 15 09:16:58.474769 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:58.474722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" event={"ID":"6adc5c40-1e91-4357-abbe-dc2237106ae6","Type":"ContainerStarted","Data":"1f5ded86fe39d3fdbc7a63ec010e7f4e87ced79e51cb27c2c2938097495bcade"} Sep 15 09:16:58.475224 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:58.474778 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" event={"ID":"6adc5c40-1e91-4357-abbe-dc2237106ae6","Type":"ContainerStarted","Data":"63b95b0ab1ea687d34302a5ebfaa64e9a473d3046cdad3cb0083bfa376842f76"} Sep 15 09:16:58.475224 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:58.474791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" event={"ID":"6adc5c40-1e91-4357-abbe-dc2237106ae6","Type":"ContainerStarted","Data":"cedf877a41e936097943fb140e3e60b60cd1eceea10525ec51eb0ae2017967ef"} Sep 15 09:16:58.493440 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:58.493371 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c84fd4d45-c6m5p" podStartSLOduration=1.840391825 podStartE2EDuration="5.493353033s" totalImagesPullingTime="3.652961208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:58.492855729 +0000 UTC m=+93.018511031" watchObservedRunningTime="2026-09-15 09:16:58.493353033 +0000 UTC m=+93.019008369" Sep 15 09:16:58.818684 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:58.818600 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:58.869930 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:58.869892 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:16:59.031334 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:59.031280 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:59.031534 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:59.031388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:59.031968 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:59.031951 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5378404-461a-4a2b-ac48-5f6552115a14-service-ca-bundle\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:59.033723 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:59.033705 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5378404-461a-4a2b-ac48-5f6552115a14-metrics-certs\") pod \"router-default-7fcc97bcb6-mvzt9\" (UID: \"c5378404-461a-4a2b-ac48-5f6552115a14\") " pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:59.236011 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:59.235971 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:16:59.510779 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:16:59.510696 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fcc97bcb6-mvzt9"] Sep 15 09:16:59.513509 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:16:59.513477 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5378404_461a_4a2b_ac48_5f6552115a14.slice/crio-46e3cf1dd18252259267276afa172384241010b0e196c83ddc4b5c139a0c6fc4 WatchSource:0}: Error finding container 46e3cf1dd18252259267276afa172384241010b0e196c83ddc4b5c139a0c6fc4: Status 404 returned error can't find the container with id 46e3cf1dd18252259267276afa172384241010b0e196c83ddc4b5c139a0c6fc4 Sep 15 09:17:00.484247 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:00.484214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" event={"ID":"c5378404-461a-4a2b-ac48-5f6552115a14","Type":"ContainerStarted","Data":"91afa1a5ec8851224f2465710c5c3cf6dda669cc780725858e806b9cae2122ae"} Sep 15 09:17:00.484448 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:00.484261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" event={"ID":"c5378404-461a-4a2b-ac48-5f6552115a14","Type":"ContainerStarted","Data":"46e3cf1dd18252259267276afa172384241010b0e196c83ddc4b5c139a0c6fc4"} Sep 15 09:17:00.504284 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:00.504229 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" podStartSLOduration=33.50421073 podStartE2EDuration="33.50421073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:00.503097289 +0000 UTC m=+95.028752595" watchObservedRunningTime="2026-09-15 09:17:00.50421073 +0000 UTC m=+95.029866031" Sep 15 09:17:01.237099 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:01.237062 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:17:01.239773 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:01.239748 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:17:01.487777 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:01.487698 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:17:01.489019 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:01.488997 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7fcc97bcb6-mvzt9" Sep 15 09:17:01.878578 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:01.878536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:01.958362 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:01.958329 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:02.018689 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:02.018651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:02.228098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:02.228009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:03.265079 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:03.265035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:17:03.267345 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:03.267322 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0960245-d690-47dc-af38-1a79cbc5df43-metrics-tls\") pod \"dns-default-6xcht\" (UID: \"c0960245-d690-47dc-af38-1a79cbc5df43\") " pod="openshift-dns/dns-default-6xcht" Sep 15 09:17:03.538395 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:03.538366 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s9fcs\"" Sep 15 09:17:03.546483 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:03.546451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6xcht" Sep 15 09:17:03.818533 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:03.818452 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6xcht"] Sep 15 09:17:03.821311 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:17:03.821275 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0960245_d690_47dc_af38_1a79cbc5df43.slice/crio-7d7b77a57a80eb553fdd73b36dab2841dbdd69ab1e20ee5b37e6c3a103b40c65 WatchSource:0}: Error finding container 7d7b77a57a80eb553fdd73b36dab2841dbdd69ab1e20ee5b37e6c3a103b40c65: Status 404 returned error can't find the container with id 7d7b77a57a80eb553fdd73b36dab2841dbdd69ab1e20ee5b37e6c3a103b40c65 Sep 15 09:17:03.869527 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:03.869485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:17:03.871894 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:03.871875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2b848470-f045-4acb-8bbe-afa14468cbbc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l87kp\" (UID: \"2b848470-f045-4acb-8bbe-afa14468cbbc\") " pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:17:04.115385 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:04.115350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l87kp" Sep 15 09:17:04.388930 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:04.388725 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l87kp"] Sep 15 09:17:04.391459 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:17:04.391432 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b848470_f045_4acb_8bbe_afa14468cbbc.slice/crio-ac053325aa6b6b7e29d623eda8c226f2313f72acec2167a7adc283b7f1aa9744 WatchSource:0}: Error finding container ac053325aa6b6b7e29d623eda8c226f2313f72acec2167a7adc283b7f1aa9744: Status 404 returned error can't find the container with id ac053325aa6b6b7e29d623eda8c226f2313f72acec2167a7adc283b7f1aa9744 Sep 15 09:17:04.498350 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:04.498310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l87kp" event={"ID":"2b848470-f045-4acb-8bbe-afa14468cbbc","Type":"ContainerStarted","Data":"71c4b49a03df29c6b8f3a92107f8d449650ac59646d560ab7e4f2e2c98d87eb1"} Sep 15 09:17:04.498528 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:04.498378 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l87kp" event={"ID":"2b848470-f045-4acb-8bbe-afa14468cbbc","Type":"ContainerStarted","Data":"ac053325aa6b6b7e29d623eda8c226f2313f72acec2167a7adc283b7f1aa9744"} Sep 15 09:17:04.499604 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:04.499581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xcht" event={"ID":"c0960245-d690-47dc-af38-1a79cbc5df43","Type":"ContainerStarted","Data":"7d7b77a57a80eb553fdd73b36dab2841dbdd69ab1e20ee5b37e6c3a103b40c65"} Sep 15 09:17:04.987782 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:04.987738 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:05.066301 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:05.066257 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:05.505395 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:05.505361 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l87kp" event={"ID":"2b848470-f045-4acb-8bbe-afa14468cbbc","Type":"ContainerStarted","Data":"9e9c58bd5e4a151e63fe378b1d279974f33a45688e7810131c0c2ed7c31b6939"} Sep 15 09:17:06.422912 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:06.422866 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:06.511439 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:06.511377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xcht" event={"ID":"c0960245-d690-47dc-af38-1a79cbc5df43","Type":"ContainerStarted","Data":"31f1bd2b4f3959a99ca1208c29a8d89877b6391dca29d61a8e16c2d3008d790b"} Sep 15 09:17:06.511849 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:06.511497 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6xcht" event={"ID":"c0960245-d690-47dc-af38-1a79cbc5df43","Type":"ContainerStarted","Data":"9d5896a28ecbaff50fb703782f609f50504146dc074a83d07e74d255798b40b7"} Sep 15 09:17:06.511849 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:06.511523 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6xcht" Sep 15 09:17:06.529172 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:06.529116 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6xcht" podStartSLOduration=65.442457294 podStartE2EDuration="1m7.529094134s" totalImagesPullingTime="2.08663684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:06.527207479 +0000 UTC m=+101.052862782" watchObservedRunningTime="2026-09-15 09:17:06.529094134 +0000 UTC m=+101.054749438" Sep 15 09:17:07.399789 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:07.399755 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wcfmg" Sep 15 09:17:07.516597 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:07.516554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l87kp" event={"ID":"2b848470-f045-4acb-8bbe-afa14468cbbc","Type":"ContainerStarted","Data":"b5b9f434e3f6b1ac9eefdfc721282cf0fef45e2bfeae1bdebda8b48d1dfcd43d"} Sep 15 09:17:07.534678 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:07.534614 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l87kp" podStartSLOduration=34.157165456 podStartE2EDuration="36.534591513s" totalImagesPullingTime="2.377426057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:16:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:07.534001981 +0000 UTC m=+102.059657284" watchObservedRunningTime="2026-09-15 09:17:07.534591513 +0000 UTC m=+102.060246818" Sep 15 09:17:08.268589 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:08.268549 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:08.367455 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:08.367400 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:08.901375 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:08.901339 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:10.484179 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:10.484148 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:10.577761 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:10.577725 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:11.137674 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.137641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:11.348732 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.348697 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:11.418449 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.418332 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wvjvw"] Sep 15 09:17:11.448959 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.448918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.452727 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.452688 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tnhnm\"" Sep 15 09:17:11.452727 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.452722 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 15 09:17:11.453964 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.453944 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 15 09:17:11.454099 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.454014 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 15 09:17:11.454161 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.453944 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 15 09:17:11.454213 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.453944 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 15 09:17:11.457762 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.457744 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 15 09:17:11.465866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.465823 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:11.534137 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534098 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-textfile\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.534654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.534654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-sys\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.534654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534300 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-metrics-client-ca\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.534654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-tls\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.534654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.534654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-root\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.534654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534514 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn9tc\" (UniqueName: \"kubernetes.io/projected/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-kube-api-access-zn9tc\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.534654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.534542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-wtmp\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.554384 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.554348 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:11.635105 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn9tc\" (UniqueName: \"kubernetes.io/projected/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-kube-api-access-zn9tc\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635105 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-wtmp\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635139 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-textfile\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-sys\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635299 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-wtmp\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-metrics-client-ca\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635653 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635362 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-sys\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635653 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-tls\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635653 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635653 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635555 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-textfile\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635653 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-root\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635919 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635670 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-root\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635919 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635902 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.635919 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.635907 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-metrics-client-ca\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.637904 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.637878 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.638041 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.638010 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-node-exporter-tls\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.645795 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.645769 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn9tc\" (UniqueName: \"kubernetes.io/projected/cf1d66cb-32a6-4226-a5f3-06caa9f7dab0-kube-api-access-zn9tc\") pod \"node-exporter-wvjvw\" (UID: \"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0\") " pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.654793 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.654756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:11.760020 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.759935 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wvjvw" Sep 15 09:17:11.763633 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.763595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:11.802829 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:17:11.802788 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1d66cb_32a6_4226_a5f3_06caa9f7dab0.slice/crio-ebfdd75f2cf0605df3fc333696b5eef22b414ee92fb29488ccb2e6ebf173de67 WatchSource:0}: Error finding container ebfdd75f2cf0605df3fc333696b5eef22b414ee92fb29488ccb2e6ebf173de67: Status 404 returned error can't find the container with id ebfdd75f2cf0605df3fc333696b5eef22b414ee92fb29488ccb2e6ebf173de67 Sep 15 09:17:11.861078 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:11.861033 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:12.006292 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:12.006227 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:12.135049 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:12.135007 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:12.402624 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:12.402524 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:12.487537 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:12.487479 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:12.536271 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:12.536229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvjvw" event={"ID":"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0","Type":"ContainerStarted","Data":"ebfdd75f2cf0605df3fc333696b5eef22b414ee92fb29488ccb2e6ebf173de67"} Sep 15 09:17:12.566863 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:12.566830 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:12.792738 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:12.792617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:13.444549 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.444512 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86dd6f66df-jqndq"] Sep 15 09:17:13.447654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.447637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.450472 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.450441 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 15 09:17:13.450664 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.450556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 15 09:17:13.450664 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.450622 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 15 09:17:13.450664 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.450624 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 15 09:17:13.450664 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.450643 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-foc6efmj2i3hh\"" Sep 15 09:17:13.450907 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.450892 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 15 09:17:13.451389 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.451371 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-7mrgv\"" Sep 15 09:17:13.459729 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.459703 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86dd6f66df-jqndq"] Sep 15 09:17:13.541243 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.541212 2562 generic.go:356] "Generic (PLEG): container finished" podID="cf1d66cb-32a6-4226-a5f3-06caa9f7dab0" containerID="bcb40e46f1f518708cc347c7ff64edca543e6f7a5e93e08a977974b519166d3c" exitCode=0 Sep 15 09:17:13.541660 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.541255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvjvw" event={"ID":"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0","Type":"ContainerDied","Data":"bcb40e46f1f518708cc347c7ff64edca543e6f7a5e93e08a977974b519166d3c"} Sep 15 09:17:13.553089 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.553057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-tls\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.553213 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.553111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.553213 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.553155 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82lnf\" (UniqueName: \"kubernetes.io/projected/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-kube-api-access-82lnf\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.553319 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.553260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-metrics-client-ca\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.553319 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.553306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.553399 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.553349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.553399 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.553379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.553514 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.553421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-grpc-tls\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.571753 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.571715 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:13.654883 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.654851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-tls\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.655028 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.654890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.655028 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.654919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82lnf\" (UniqueName: \"kubernetes.io/projected/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-kube-api-access-82lnf\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.655147 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.655124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-metrics-client-ca\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.655872 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.655292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.655872 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.655365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.655872 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.655807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.655872 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.655844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-grpc-tls\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.656094 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.655875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-metrics-client-ca\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.658038 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.658013 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-tls\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.658169 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.658019 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.658228 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.658208 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.658581 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.658553 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.658714 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.658692 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.658782 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.658772 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-secret-grpc-tls\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.664003 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.663977 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82lnf\" (UniqueName: \"kubernetes.io/projected/febf2680-ffc1-4e18-a07a-7ed3f2af5c40-kube-api-access-82lnf\") pod \"thanos-querier-86dd6f66df-jqndq\" (UID: \"febf2680-ffc1-4e18-a07a-7ed3f2af5c40\") " pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.702924 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.702834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:13.757651 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.757611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:13.813756 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.813670 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:13.908762 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:13.908731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:14.037714 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.037504 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:14.037714 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.037705 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86dd6f66df-jqndq"] Sep 15 09:17:14.044481 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:17:14.044452 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfebf2680_ffc1_4e18_a07a_7ed3f2af5c40.slice/crio-9fa824a997a46ab8962f842b030bf5564e16202dac213774613e4e0a6843ef14 WatchSource:0}: Error finding container 9fa824a997a46ab8962f842b030bf5564e16202dac213774613e4e0a6843ef14: Status 404 returned error can't find the container with id 9fa824a997a46ab8962f842b030bf5564e16202dac213774613e4e0a6843ef14 Sep 15 09:17:14.134753 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.134723 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:14.232853 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.232821 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:14.376596 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.376561 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:14.478389 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.478350 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:14.548696 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.548661 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvjvw" event={"ID":"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0","Type":"ContainerStarted","Data":"9fb4fa2785c7bc8a40c69458fa29fe2a9f9e3809ba8ed9955040252a5aaa74f1"} Sep 15 09:17:14.549237 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.549204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvjvw" event={"ID":"cf1d66cb-32a6-4226-a5f3-06caa9f7dab0","Type":"ContainerStarted","Data":"df281e8e78825ab82207c5fe1d93899479dde685f50d71fda3c4d38119ed302d"} Sep 15 09:17:14.550222 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.550188 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" event={"ID":"febf2680-ffc1-4e18-a07a-7ed3f2af5c40","Type":"ContainerStarted","Data":"9fa824a997a46ab8962f842b030bf5564e16202dac213774613e4e0a6843ef14"} Sep 15 09:17:14.569311 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.569246 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wvjvw" podStartSLOduration=2.213300744 podStartE2EDuration="3.569222348s" totalImagesPullingTime="1.290038254s" totalInitContainerRuntime="65.88335ms" isStatefulPod=true podCreationTimestamp="2026-09-15 09:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:14.568277356 +0000 UTC m=+109.093932674" watchObservedRunningTime="2026-09-15 09:17:14.569222348 +0000 UTC m=+109.094877651" Sep 15 09:17:14.571589 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.571553 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:14.733136 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:14.733044 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:15.430388 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:15.430278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:15.636732 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:15.636680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:15.836865 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:15.836777 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:16.149110 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:16.149075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:16.249123 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:16.249085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:16.351604 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:16.351558 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:16.423089 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:16.422996 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:16.518939 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:16.518903 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6xcht" Sep 15 09:17:16.560754 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:16.560718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" event={"ID":"febf2680-ffc1-4e18-a07a-7ed3f2af5c40","Type":"ContainerStarted","Data":"3e9c8e79dd2bd9dcbce42aabbd8a4d815983d7ae4de868c53f724f89ecef2052"} Sep 15 09:17:16.560921 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:16.560791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" event={"ID":"febf2680-ffc1-4e18-a07a-7ed3f2af5c40","Type":"ContainerStarted","Data":"9d77105a589f06dabe5afef1b9cf57dc33de57aae12cc3fc602d43c09d92177c"} Sep 15 09:17:16.560921 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:16.560828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" event={"ID":"febf2680-ffc1-4e18-a07a-7ed3f2af5c40","Type":"ContainerStarted","Data":"701d2eb714de79a6cce1232c19a5dd6d62e4943994cc21fbf5604e70ea1e725e"} Sep 15 09:17:17.383540 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:17.383504 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:17.484126 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:17.484095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:17.567994 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:17.567959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" event={"ID":"febf2680-ffc1-4e18-a07a-7ed3f2af5c40","Type":"ContainerStarted","Data":"73a90bac9b61c26b3096af99e76a04e9abfe5c7cbd3fd2e27aa20d2fd3be45c0"} Sep 15 09:17:17.568188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:17.568056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" event={"ID":"febf2680-ffc1-4e18-a07a-7ed3f2af5c40","Type":"ContainerStarted","Data":"e7e63f5a73495a87b02f8698141e22d54303957b11c82ea649047f8c4cbef198"} Sep 15 09:17:17.568188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:17.568086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" event={"ID":"febf2680-ffc1-4e18-a07a-7ed3f2af5c40","Type":"ContainerStarted","Data":"bd5f61acbc0eb19a04fdfeb2613d0202db6bfc669b56083672750d403ce30144"} Sep 15 09:17:17.568188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:17.568116 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:17.595198 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:17.595139 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" podStartSLOduration=1.8745926979999998 podStartE2EDuration="4.595120805s" totalImagesPullingTime="2.720528107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:17.593217892 +0000 UTC m=+112.118873228" watchObservedRunningTime="2026-09-15 09:17:17.595120805 +0000 UTC m=+112.120776106" Sep 15 09:17:17.706733 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:17.706634 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:21.370042 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:21.370002 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:21.433622 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:21.433587 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:22.848065 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:22.848022 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:22.900288 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:22.900251 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:23.578385 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:23.578354 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86dd6f66df-jqndq" Sep 15 09:17:23.638589 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:23.638557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:23.739660 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:23.739628 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:25.247910 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:25.247872 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:25.299157 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:25.299116 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:25.634267 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:25.634232 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:25.687118 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:25.687086 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:28.648803 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:28.648759 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:28.802849 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:28.802818 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:28.903800 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:28.903714 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:31.110323 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:31.110276 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:31.211665 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:31.211629 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:32.454250 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:32.454215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:32.503909 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:32.503880 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:34.653715 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:34.653677 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:34.720957 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:34.720915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:17:34.723283 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:34.723255 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa57e01c-ee26-4f68-a370-7e7e64a3d7f5-metrics-certs\") pod \"network-metrics-daemon-qc74b\" (UID: \"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5\") " pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:17:34.735262 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:34.735226 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:35.020467 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:35.020364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-g6g5g\"" Sep 15 09:17:35.028518 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:35.028487 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qc74b" Sep 15 09:17:35.304470 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:35.304373 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qc74b"] Sep 15 09:17:35.307459 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:17:35.307430 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa57e01c_ee26_4f68_a370_7e7e64a3d7f5.slice/crio-32ae5e9c58a61e8d87fe5964ed1b1a95a7a3be7e43919fb5e3ec4560eda375f9 WatchSource:0}: Error finding container 32ae5e9c58a61e8d87fe5964ed1b1a95a7a3be7e43919fb5e3ec4560eda375f9: Status 404 returned error can't find the container with id 32ae5e9c58a61e8d87fe5964ed1b1a95a7a3be7e43919fb5e3ec4560eda375f9 Sep 15 09:17:35.636927 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:35.636888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qc74b" event={"ID":"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5","Type":"ContainerStarted","Data":"32ae5e9c58a61e8d87fe5964ed1b1a95a7a3be7e43919fb5e3ec4560eda375f9"} Sep 15 09:17:36.642530 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:36.642489 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qc74b" event={"ID":"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5","Type":"ContainerStarted","Data":"5c6e89ddf33ba67dfd82447e4ad133da8333c67344e6f081cfeda3bb48af036b"} Sep 15 09:17:36.643000 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:36.642547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qc74b" event={"ID":"aa57e01c-ee26-4f68-a370-7e7e64a3d7f5","Type":"ContainerStarted","Data":"e5c37771ee418febc585036a9b353e0fe5b0293a17c6a8f9d5fd1e091e101313"} Sep 15 09:17:36.660576 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:36.660523 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qc74b" podStartSLOduration=129.668409032 podStartE2EDuration="2m10.660504968s" totalImagesPullingTime="992.095936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:36.659175889 +0000 UTC m=+131.184831191" watchObservedRunningTime="2026-09-15 09:17:36.660504968 +0000 UTC m=+131.186160306" Sep 15 09:17:36.750988 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:36.750945 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:36.848910 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:36.848871 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:37.860372 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:37.860336 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:37.910964 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:37.910928 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:39.369978 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:39.369938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:39.471230 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:39.471164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:43.784834 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:43.784796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:43.885891 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:43.885856 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:43.943299 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:43.943260 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:44.703283 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:44.703245 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:44.804066 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:44.804029 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:58.802719 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:58.802679 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:17:58.861274 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:17:58.861250 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:27.588678 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:27.588590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:27.670532 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:27.670495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:39.523092 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:39.523058 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:39.582176 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:39.582133 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:41.698889 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:41.698852 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:41.748835 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:41.748793 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:43.813644 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:43.813605 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:43.914527 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:43.914495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:49.867153 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:49.867119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:53.110914 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:53.110882 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:53.211674 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:53.211647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:18:53.271813 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:18:53.271780 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:19:27.453366 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:19:27.453327 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:19:27.759138 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:19:27.759042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:20:25.815236 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:20:25.815203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:20:25.820792 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:20:25.820765 2562 kubelet.go:1648] "Image garbage collection succeeded" Sep 15 09:20:25.821858 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:20:25.821840 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:20:28.692176 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:20:28.692141 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:20:28.800248 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:20:28.800210 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:20:29.389158 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:20:29.389121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:20:33.048947 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:20:33.048911 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:21:05.621795 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:21:05.621754 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:21:07.154378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:21:07.154324 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:21:46.403008 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:21:46.402888 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:21:48.582423 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:21:48.582365 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:21:48.630332 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:21:48.630294 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:21:50.528677 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:21:50.528635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:21:50.577239 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:21:50.577206 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:21:59.043160 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:21:59.043117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:22:20.805897 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:22:20.805861 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:22:25.960047 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:22:25.960013 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:22:26.028608 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:22:26.028574 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:22:37.008902 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:22:37.008864 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:22:37.110004 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:22:37.109972 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:22:37.211998 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:22:37.211964 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:00.466085 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:00.466036 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:00.581425 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:00.581374 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:00.736237 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:00.736161 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:00.836646 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:00.836610 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:00.957089 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:00.957057 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:01.053455 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:01.053370 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:01.252535 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:01.252504 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:01.351665 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:01.351598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:23:23.346871 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:23:23.346837 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:24:25.303913 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:24:25.303829 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:24:25.404654 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:24:25.404575 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:24:25.744273 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:24:25.744246 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:24:25.829705 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:24:25.829621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:24:25.885862 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:24:25.885835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:24:25.988514 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:24:25.988482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:24:26.089098 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:24:26.089023 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:24:52.873687 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:24:52.873639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:25:02.782840 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:25:02.782802 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:25:25.840378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:25:25.840344 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:25:25.843889 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:25:25.843863 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:26:04.072189 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:04.072153 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:04.174095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:04.174062 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:04.272138 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:04.272097 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:04.319069 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:04.319041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:09.337933 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:09.337891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:46.691842 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:46.691801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:46.937664 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:46.937625 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:46.990077 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:46.990005 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:55.760313 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:55.760272 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:55.860510 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:55.860482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:26:55.911822 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:26:55.911789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:27:20.278960 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:20.278860 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:27:21.632353 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:21.632316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:27:21.684493 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:21.684458 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:27:22.376318 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.376281 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-pp4hr"] Sep 15 09:27:22.379253 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.379238 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-pp4hr" Sep 15 09:27:22.381856 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.381825 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 15 09:27:22.382816 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.382801 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 15 09:27:22.382888 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.382813 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 15 09:27:22.382930 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.382813 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-cronjob-dockercfg-6crms\"" Sep 15 09:27:22.386870 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.386850 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-pp4hr"] Sep 15 09:27:22.535356 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.535328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9ldx\" (UniqueName: \"kubernetes.io/projected/2c1f9ade-a171-4f33-b208-30dbfe45acc3-kube-api-access-f9ldx\") pod \"feast-test-apply-pp4hr\" (UID: \"2c1f9ade-a171-4f33-b208-30dbfe45acc3\") " pod="test-ns-feast/feast-test-apply-pp4hr" Sep 15 09:27:22.635815 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.635769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9ldx\" (UniqueName: \"kubernetes.io/projected/2c1f9ade-a171-4f33-b208-30dbfe45acc3-kube-api-access-f9ldx\") pod \"feast-test-apply-pp4hr\" (UID: \"2c1f9ade-a171-4f33-b208-30dbfe45acc3\") " pod="test-ns-feast/feast-test-apply-pp4hr" Sep 15 09:27:22.643284 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.643268 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9ldx\" (UniqueName: \"kubernetes.io/projected/2c1f9ade-a171-4f33-b208-30dbfe45acc3-kube-api-access-f9ldx\") pod \"feast-test-apply-pp4hr\" (UID: \"2c1f9ade-a171-4f33-b208-30dbfe45acc3\") " pod="test-ns-feast/feast-test-apply-pp4hr" Sep 15 09:27:22.688338 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.688317 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-pp4hr" Sep 15 09:27:22.953120 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.953063 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-pp4hr"] Sep 15 09:27:22.955924 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:27:22.955899 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c1f9ade_a171_4f33_b208_30dbfe45acc3.slice/crio-32a31b429b51b397d4da83a903ccaf62f3bc4fb0f220cba87a681c72b122b844 WatchSource:0}: Error finding container 32a31b429b51b397d4da83a903ccaf62f3bc4fb0f220cba87a681c72b122b844: Status 404 returned error can't find the container with id 32a31b429b51b397d4da83a903ccaf62f3bc4fb0f220cba87a681c72b122b844 Sep 15 09:27:22.957811 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:22.957796 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 09:27:23.694425 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:23.694348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pp4hr" event={"ID":"2c1f9ade-a171-4f33-b208-30dbfe45acc3","Type":"ContainerStarted","Data":"32a31b429b51b397d4da83a903ccaf62f3bc4fb0f220cba87a681c72b122b844"} Sep 15 09:27:27.148908 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:27.148881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 15 09:27:27.711852 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:27.711822 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pp4hr" event={"ID":"2c1f9ade-a171-4f33-b208-30dbfe45acc3","Type":"ContainerStarted","Data":"5f276a7d1557b01f9aad6d9c2cc04f70f682cca6a4ed415e3547b0db936bf3f6"} Sep 15 09:27:32.050069 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:32.050020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:27:33.735069 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:33.735042 2562 generic.go:356] "Generic (PLEG): container finished" podID="2c1f9ade-a171-4f33-b208-30dbfe45acc3" containerID="5f276a7d1557b01f9aad6d9c2cc04f70f682cca6a4ed415e3547b0db936bf3f6" exitCode=0 Sep 15 09:27:33.735357 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:33.735115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pp4hr" event={"ID":"2c1f9ade-a171-4f33-b208-30dbfe45acc3","Type":"ContainerDied","Data":"5f276a7d1557b01f9aad6d9c2cc04f70f682cca6a4ed415e3547b0db936bf3f6"} Sep 15 09:27:34.740638 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:34.740601 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pp4hr" event={"ID":"2c1f9ade-a171-4f33-b208-30dbfe45acc3","Type":"ContainerStarted","Data":"d8d266f96362cd71d43513d661539e79ea457a2a2411074a900b244195a80334"} Sep 15 09:27:34.769257 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:34.769213 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-pp4hr" podStartSLOduration=2.129945364 podStartE2EDuration="12.769197174s" totalImagesPullingTime="4.188554732s" totalInitContainerRuntime="6.450697078s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:34.767560148 +0000 UTC m=+729.293215450" watchObservedRunningTime="2026-09-15 09:27:34.769197174 +0000 UTC m=+729.294852477" Sep 15 09:27:43.773883 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:43.773847 2562 generic.go:356] "Generic (PLEG): container finished" podID="2c1f9ade-a171-4f33-b208-30dbfe45acc3" containerID="d8d266f96362cd71d43513d661539e79ea457a2a2411074a900b244195a80334" exitCode=0 Sep 15 09:27:43.774349 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:43.773920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pp4hr" event={"ID":"2c1f9ade-a171-4f33-b208-30dbfe45acc3","Type":"ContainerDied","Data":"d8d266f96362cd71d43513d661539e79ea457a2a2411074a900b244195a80334"} Sep 15 09:27:44.898808 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:44.898784 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-pp4hr" Sep 15 09:27:44.998201 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:44.998171 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9ldx\" (UniqueName: \"kubernetes.io/projected/2c1f9ade-a171-4f33-b208-30dbfe45acc3-kube-api-access-f9ldx\") pod \"2c1f9ade-a171-4f33-b208-30dbfe45acc3\" (UID: \"2c1f9ade-a171-4f33-b208-30dbfe45acc3\") " Sep 15 09:27:45.000289 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:45.000263 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1f9ade-a171-4f33-b208-30dbfe45acc3-kube-api-access-f9ldx" (OuterVolumeSpecName: "kube-api-access-f9ldx") pod "2c1f9ade-a171-4f33-b208-30dbfe45acc3" (UID: "2c1f9ade-a171-4f33-b208-30dbfe45acc3"). InnerVolumeSpecName "kube-api-access-f9ldx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:27:45.099389 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:45.099309 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9ldx\" (UniqueName: \"kubernetes.io/projected/2c1f9ade-a171-4f33-b208-30dbfe45acc3-kube-api-access-f9ldx\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:27:45.782661 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:45.782621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-pp4hr" event={"ID":"2c1f9ade-a171-4f33-b208-30dbfe45acc3","Type":"ContainerDied","Data":"32a31b429b51b397d4da83a903ccaf62f3bc4fb0f220cba87a681c72b122b844"} Sep 15 09:27:45.782661 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:45.782655 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-pp4hr" Sep 15 09:27:45.782912 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:45.782662 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32a31b429b51b397d4da83a903ccaf62f3bc4fb0f220cba87a681c72b122b844" Sep 15 09:27:45.936102 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:45.936073 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-pp4hr_2c1f9ade-a171-4f33-b208-30dbfe45acc3/feast-0/0.log" Sep 15 09:27:45.944001 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:27:45.943980 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-pp4hr_2c1f9ade-a171-4f33-b208-30dbfe45acc3/feast-1/0.log" Sep 15 09:28:18.533756 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:28:18.533720 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:28:23.514283 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:28:23.514249 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-pp4hr"] Sep 15 09:28:23.522390 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:28:23.522363 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-pp4hr"] Sep 15 09:28:23.591052 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:28:23.591016 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:28:23.905463 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:28:23.905395 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1f9ade-a171-4f33-b208-30dbfe45acc3" path="/var/lib/kubelet/pods/2c1f9ade-a171-4f33-b208-30dbfe45acc3/volumes" Sep 15 09:28:23.940369 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:28:23.940333 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:29:00.988203 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:29:00.988163 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:29:01.088487 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:29:01.088451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:29:01.363528 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:29:01.363500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:29:01.410970 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:29:01.410941 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:29:01.541437 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:29:01.541388 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:30:10.117349 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:30:10.117315 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:30:10.217631 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:30:10.217595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:30:25.862060 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:30:25.861981 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:30:25.864128 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:30:25.864105 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:31:13.441997 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:13.441950 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:15.016003 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:15.015968 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:19.067152 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:19.067120 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:24.498753 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:24.498713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:24.587696 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:24.587651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:24.649248 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:24.649212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:24.765931 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:24.765862 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:49.231870 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:49.231783 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:50.254694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:50.254651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:50.330612 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:50.330574 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:50.645572 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:50.645531 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:31:50.751509 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:31:50.751464 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:35.923315 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:35.923230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:37.807917 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:37.807886 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:38.117735 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:38.117700 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:38.363740 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:38.363699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:38.443929 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:38.443850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:40.937379 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:40.937342 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:43.243346 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:43.243305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:43.343992 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:43.343958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:48.808706 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:48.808673 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:48.907149 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:48.907117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:49.295911 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.295879 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:33:49.308757 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.308729 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b"] Sep 15 09:33:49.308971 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.308961 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1f9ade-a171-4f33-b208-30dbfe45acc3" containerName="feast-0" Sep 15 09:33:49.309013 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.308973 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1f9ade-a171-4f33-b208-30dbfe45acc3" containerName="feast-0" Sep 15 09:33:49.309013 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.308980 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1f9ade-a171-4f33-b208-30dbfe45acc3" containerName="feast-1" Sep 15 09:33:49.309013 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.308986 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1f9ade-a171-4f33-b208-30dbfe45acc3" containerName="feast-1" Sep 15 09:33:49.309101 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.309033 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c1f9ade-a171-4f33-b208-30dbfe45acc3" containerName="feast-1" Sep 15 09:33:49.311687 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.311672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:33:49.314915 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.314898 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 15 09:33:49.315501 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.315486 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 15 09:33:49.316254 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.316242 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-x96pm\"" Sep 15 09:33:49.332056 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.332032 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b"] Sep 15 09:33:49.387353 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.387327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md9x2\" (UniqueName: \"kubernetes.io/projected/4c583342-db9c-4a27-b6ca-7134bec8d83f-kube-api-access-md9x2\") pod \"feast-operator-controller-manager-689b877b4b-jz92b\" (UID: \"4c583342-db9c-4a27-b6ca-7134bec8d83f\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:33:49.488332 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.488310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md9x2\" (UniqueName: \"kubernetes.io/projected/4c583342-db9c-4a27-b6ca-7134bec8d83f-kube-api-access-md9x2\") pod \"feast-operator-controller-manager-689b877b4b-jz92b\" (UID: \"4c583342-db9c-4a27-b6ca-7134bec8d83f\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:33:49.497717 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.497696 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md9x2\" (UniqueName: \"kubernetes.io/projected/4c583342-db9c-4a27-b6ca-7134bec8d83f-kube-api-access-md9x2\") pod \"feast-operator-controller-manager-689b877b4b-jz92b\" (UID: \"4c583342-db9c-4a27-b6ca-7134bec8d83f\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:33:49.622319 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.621745 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:33:49.896185 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.896115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b"] Sep 15 09:33:49.899261 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:33:49.899229 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c583342_db9c_4a27_b6ca_7134bec8d83f.slice/crio-e2119e37d6adf869c544766cc678541fc4b9fa507b19dd7d952d9a8fe1be2be3 WatchSource:0}: Error finding container e2119e37d6adf869c544766cc678541fc4b9fa507b19dd7d952d9a8fe1be2be3: Status 404 returned error can't find the container with id e2119e37d6adf869c544766cc678541fc4b9fa507b19dd7d952d9a8fe1be2be3 Sep 15 09:33:49.901318 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:49.901297 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 15 09:33:50.060625 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:50.060592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" event={"ID":"4c583342-db9c-4a27-b6ca-7134bec8d83f","Type":"ContainerStarted","Data":"e2119e37d6adf869c544766cc678541fc4b9fa507b19dd7d952d9a8fe1be2be3"} Sep 15 09:33:53.072796 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:53.072759 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" event={"ID":"4c583342-db9c-4a27-b6ca-7134bec8d83f","Type":"ContainerStarted","Data":"b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5"} Sep 15 09:33:53.073159 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:53.072869 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:33:53.089154 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:33:53.089115 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" podStartSLOduration=1.458439168 podStartE2EDuration="4.089102776s" totalImagesPullingTime="2.630663608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:33:53.088441932 +0000 UTC m=+1107.614097230" watchObservedRunningTime="2026-09-15 09:33:53.089102776 +0000 UTC m=+1107.614758078" Sep 15 09:34:04.079040 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:04.079003 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:34:05.488798 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:05.488762 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:05.543473 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:05.543441 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:06.121752 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.121718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:06.223943 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.223905 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:06.227572 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.227544 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89"] Sep 15 09:34:06.231067 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.231051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.233719 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.233699 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 15 09:34:06.233920 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.233899 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 15 09:34:06.234059 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.234040 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 15 09:34:06.234282 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.234264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 15 09:34:06.234439 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.234425 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 15 09:34:06.234572 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.234556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-k4rqb\"" Sep 15 09:34:06.234665 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.234599 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 15 09:34:06.247362 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.247341 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89"] Sep 15 09:34:06.289683 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.289657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.289798 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.289696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.289798 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.289723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg9dl\" (UniqueName: \"kubernetes.io/projected/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-kube-api-access-jg9dl\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.289798 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.289754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.289959 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.289812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.289959 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.289842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.341708 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.341680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:06.390554 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.390502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.390554 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.390531 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.390680 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.390561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.390680 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.390590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.390680 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.390617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg9dl\" (UniqueName: \"kubernetes.io/projected/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-kube-api-access-jg9dl\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.390680 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.390645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.390859 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:34:06.390747 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 15 09:34:06.390859 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:34:06.390817 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls podName:647ab55e-bdf7-4c1e-a8ca-9f4314102b64 nodeName:}" failed. No retries permitted until 2026-09-15 09:34:06.890798946 +0000 UTC m=+1121.416454239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls") pod "feast-simple-feast-setup-57576b8fcf-lxz89" (UID: "647ab55e-bdf7-4c1e-a8ca-9f4314102b64") : secret "feast-simple-feast-setup-online-tls" not found Sep 15 09:34:06.391084 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.391058 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.393122 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.393095 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.393349 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.393335 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.393500 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.393483 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.399252 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.399229 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg9dl\" (UniqueName: \"kubernetes.io/projected/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-kube-api-access-jg9dl\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.893885 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.893855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:06.896086 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:06.896060 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-lxz89\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:07.017928 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:07.017896 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:07.118307 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:07.118274 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:07.142234 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:07.142206 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:07.417285 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:07.417262 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89"] Sep 15 09:34:07.418931 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:34:07.418904 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod647ab55e_bdf7_4c1e_a8ca_9f4314102b64.slice/crio-b6ecbe7443004e1575be4eed0ae8373fb399869660cb634d9d5c965b12df888c WatchSource:0}: Error finding container b6ecbe7443004e1575be4eed0ae8373fb399869660cb634d9d5c965b12df888c: Status 404 returned error can't find the container with id b6ecbe7443004e1575be4eed0ae8373fb399869660cb634d9d5c965b12df888c Sep 15 09:34:08.131607 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:08.131570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerStarted","Data":"b6ecbe7443004e1575be4eed0ae8373fb399869660cb634d9d5c965b12df888c"} Sep 15 09:34:18.040616 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:18.040572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:18.140876 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:18.140814 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:18.649240 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:18.649188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:34:20.184752 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:20.184716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerStarted","Data":"7b2401cc7d06055a9681f19c2957956f7fc293def5118437b078159d17969e30"} Sep 15 09:34:25.206502 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:25.206464 2562 generic.go:356] "Generic (PLEG): container finished" podID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerID="7b2401cc7d06055a9681f19c2957956f7fc293def5118437b078159d17969e30" exitCode=0 Sep 15 09:34:25.206974 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:25.206519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerDied","Data":"7b2401cc7d06055a9681f19c2957956f7fc293def5118437b078159d17969e30"} Sep 15 09:34:25.894015 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:25.893978 2562 scope.go:117] "RemoveContainer" containerID="d8d266f96362cd71d43513d661539e79ea457a2a2411074a900b244195a80334" Sep 15 09:34:25.902327 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:25.902302 2562 scope.go:117] "RemoveContainer" containerID="5f276a7d1557b01f9aad6d9c2cc04f70f682cca6a4ed415e3547b0db936bf3f6" Sep 15 09:34:26.211896 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:26.211817 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerStarted","Data":"3aed63af43f4da3467364ae6710904ec964531b02d7a90080891bffdb2969c46"} Sep 15 09:34:32.237994 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:32.237958 2562 generic.go:356] "Generic (PLEG): container finished" podID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerID="3aed63af43f4da3467364ae6710904ec964531b02d7a90080891bffdb2969c46" exitCode=0 Sep 15 09:34:32.238381 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:32.238013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerDied","Data":"3aed63af43f4da3467364ae6710904ec964531b02d7a90080891bffdb2969c46"} Sep 15 09:34:33.248018 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:33.247973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerStarted","Data":"fe4f338ccb75eabc2f324e4f0ba7e2cefba02002648fe5e2a414ad503ef1392b"} Sep 15 09:34:33.248532 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:33.248040 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerStarted","Data":"fa9c1cf9b1a545627f2ae202ab5777afd7c0a7f4e386631a7d2234398803e2a8"} Sep 15 09:34:33.248532 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:33.248061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerStarted","Data":"ba8f20204de492e3d48b8f079e28ca44a91cd448ba64a15d8b06e786ec0078b1"} Sep 15 09:34:33.248532 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:33.248078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerStarted","Data":"54e78c1a536cb61efcc4d8c8b5b3ba00f539b0a0ab77388519d85a0449371936"} Sep 15 09:34:33.274740 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:33.273720 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podStartSLOduration=15.123498546 podStartE2EDuration="27.273698132s" totalImagesPullingTime="12.150199586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:34:33.271909161 +0000 UTC m=+1147.797564475" watchObservedRunningTime="2026-09-15 09:34:33.273698132 +0000 UTC m=+1147.799353438" Sep 15 09:34:34.142995 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:34.142856 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:34.142995 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:34.142917 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:34.142995 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:34.142939 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:34.142995 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:34.142959 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:34.145235 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:34.145182 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused" Sep 15 09:34:34.145614 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:34.145515 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.17:8816: connect: connection refused" Sep 15 09:34:34.145614 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:34.145522 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused" Sep 15 09:34:34.145614 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:34.145591 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.17:6571: connect: connection refused" Sep 15 09:34:37.142749 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:37.142703 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:37.143297 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:37.143262 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused" Sep 15 09:34:37.143381 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:37.142990 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.17:6571: connect: connection refused" Sep 15 09:34:37.143479 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:37.142991 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused" Sep 15 09:34:37.143479 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:37.142991 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.17:8816: connect: connection refused" Sep 15 09:34:37.143660 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:37.143633 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:37.143660 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:37.143672 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:37.143866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:37.143692 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:40.143245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:40.143202 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.17:8816: connect: connection refused" Sep 15 09:34:40.143245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:40.143218 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused" Sep 15 09:34:40.143940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:40.143219 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused" Sep 15 09:34:40.143940 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:40.143705 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.17:6571: connect: connection refused" Sep 15 09:34:43.144257 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:43.144227 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:43.144651 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:43.144368 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:43.144710 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:43.144684 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:43.145190 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:43.145165 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:43.145279 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:43.145223 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:43.145279 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:43.145257 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:43.149617 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:43.149593 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:34:43.298541 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:34:43.298507 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:35:25.890270 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:25.890237 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:35:25.890913 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:25.890355 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:35:44.462443 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.457115 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89"] Sep 15 09:35:44.462443 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.457594 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="registry" containerID="cri-o://54e78c1a536cb61efcc4d8c8b5b3ba00f539b0a0ab77388519d85a0449371936" gracePeriod=30 Sep 15 09:35:44.462443 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.458033 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" containerID="cri-o://fe4f338ccb75eabc2f324e4f0ba7e2cefba02002648fe5e2a414ad503ef1392b" gracePeriod=30 Sep 15 09:35:44.462443 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.458121 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="offline" containerID="cri-o://fa9c1cf9b1a545627f2ae202ab5777afd7c0a7f4e386631a7d2234398803e2a8" gracePeriod=30 Sep 15 09:35:44.462443 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.458240 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" containerID="cri-o://ba8f20204de492e3d48b8f079e28ca44a91cd448ba64a15d8b06e786ec0078b1" gracePeriod=30 Sep 15 09:35:44.465078 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.465049 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:35:44.518519 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.518482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:35:44.733512 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.733397 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:35:44.833482 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.833440 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:35:44.878067 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.877790 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5"] Sep 15 09:35:44.882398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.882376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:44.884898 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.884875 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-lhbbv\"" Sep 15 09:35:44.899450 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.899379 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5"] Sep 15 09:35:44.940143 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.940108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2q5t\" (UniqueName: \"kubernetes.io/projected/76bb6ed9-97d5-4357-afb6-67ffeda26d92-kube-api-access-p2q5t\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:44.940784 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.940755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb6ed9-97d5-4357-afb6-67ffeda26d92-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:44.940950 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.940934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:44.941076 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.941062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:44.941180 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.941168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:44.941289 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:44.941276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.042942 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.042838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2q5t\" (UniqueName: \"kubernetes.io/projected/76bb6ed9-97d5-4357-afb6-67ffeda26d92-kube-api-access-p2q5t\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.043191 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.043173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb6ed9-97d5-4357-afb6-67ffeda26d92-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.043303 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.043291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.043578 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.043554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.043704 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.043692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.043815 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.043802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.043953 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.043643 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb6ed9-97d5-4357-afb6-67ffeda26d92-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.044049 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.043496 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 15 09:35:45.044187 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.044179 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls podName:76bb6ed9-97d5-4357-afb6-67ffeda26d92 nodeName:}" failed. No retries permitted until 2026-09-15 09:35:45.544154712 +0000 UTC m=+1220.069809999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls") pod "feast-simple-feast-setup-57576b8fcf-tv5d5" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92") : secret "feast-simple-feast-setup-online-tls" not found Sep 15 09:35:45.044512 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.043713 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 15 09:35:45.044665 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.044656 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls podName:76bb6ed9-97d5-4357-afb6-67ffeda26d92 nodeName:}" failed. No retries permitted until 2026-09-15 09:35:45.544639539 +0000 UTC m=+1220.070294824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-tv5d5" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92") : secret "feast-simple-feast-setup-registry-tls" not found Sep 15 09:35:45.044763 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.043767 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 15 09:35:45.044867 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.044859 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls podName:76bb6ed9-97d5-4357-afb6-67ffeda26d92 nodeName:}" failed. No retries permitted until 2026-09-15 09:35:45.544849184 +0000 UTC m=+1220.070504471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-tv5d5" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92") : secret "feast-simple-feast-setup-offline-tls" not found Sep 15 09:35:45.044957 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.043883 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 15 09:35:45.045059 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.045052 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls podName:76bb6ed9-97d5-4357-afb6-67ffeda26d92 nodeName:}" failed. No retries permitted until 2026-09-15 09:35:45.545040015 +0000 UTC m=+1220.070695309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-tv5d5" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92") : secret "feast-simple-feast-setup-ui-tls" not found Sep 15 09:35:45.053331 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.053305 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2q5t\" (UniqueName: \"kubernetes.io/projected/76bb6ed9-97d5-4357-afb6-67ffeda26d92-kube-api-access-p2q5t\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.129587 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.129522 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:35:45.232683 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.232651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:35:45.331602 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.331495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:35:45.523494 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.523464 2562 generic.go:356] "Generic (PLEG): container finished" podID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerID="fe4f338ccb75eabc2f324e4f0ba7e2cefba02002648fe5e2a414ad503ef1392b" exitCode=0 Sep 15 09:35:45.523494 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.523487 2562 generic.go:356] "Generic (PLEG): container finished" podID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerID="ba8f20204de492e3d48b8f079e28ca44a91cd448ba64a15d8b06e786ec0078b1" exitCode=0 Sep 15 09:35:45.523890 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.523544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerDied","Data":"fe4f338ccb75eabc2f324e4f0ba7e2cefba02002648fe5e2a414ad503ef1392b"} Sep 15 09:35:45.523890 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.523591 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerDied","Data":"ba8f20204de492e3d48b8f079e28ca44a91cd448ba64a15d8b06e786ec0078b1"} Sep 15 09:35:45.548200 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.548165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.548373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.548208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.548373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.548226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.548373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.548292 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.548555 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.548304 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Sep 15 09:35:45.548555 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:35:45.548456 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls podName:76bb6ed9-97d5-4357-afb6-67ffeda26d92 nodeName:}" failed. No retries permitted until 2026-09-15 09:35:46.548435809 +0000 UTC m=+1221.074091102 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-tv5d5" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92") : secret "feast-simple-feast-setup-offline-tls" not found Sep 15 09:35:45.550861 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.550837 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.550861 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.550852 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.551043 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.550975 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:45.636336 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:45.636294 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:35:46.557135 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:46.557091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:46.559580 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:46.559553 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-tv5d5\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:46.695739 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:46.695700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:35:46.970530 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:46.970499 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5"] Sep 15 09:35:46.972432 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:35:46.972389 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod76bb6ed9_97d5_4357_afb6_67ffeda26d92.slice/crio-79161ee2e619c8981771ca4208ddfea1ed55adbb4fce03afcc3a6cc086e00dbc WatchSource:0}: Error finding container 79161ee2e619c8981771ca4208ddfea1ed55adbb4fce03afcc3a6cc086e00dbc: Status 404 returned error can't find the container with id 79161ee2e619c8981771ca4208ddfea1ed55adbb4fce03afcc3a6cc086e00dbc Sep 15 09:35:47.534624 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:47.534587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerStarted","Data":"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f"} Sep 15 09:35:47.534821 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:47.534639 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerStarted","Data":"79161ee2e619c8981771ca4208ddfea1ed55adbb4fce03afcc3a6cc086e00dbc"} Sep 15 09:35:52.555653 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:52.555619 2562 generic.go:356] "Generic (PLEG): container finished" podID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerID="cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f" exitCode=0 Sep 15 09:35:52.556003 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:52.555676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerDied","Data":"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f"} Sep 15 09:35:53.145190 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:53.145139 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused" Sep 15 09:35:53.295856 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:53.295814 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused" Sep 15 09:35:53.562112 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:53.562016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerStarted","Data":"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3"} Sep 15 09:35:59.586103 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:59.586069 2562 generic.go:356] "Generic (PLEG): container finished" podID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerID="21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3" exitCode=0 Sep 15 09:35:59.586540 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:35:59.586141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerDied","Data":"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3"} Sep 15 09:36:00.596200 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:00.596148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerStarted","Data":"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71"} Sep 15 09:36:00.596699 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:00.596220 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerStarted","Data":"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01"} Sep 15 09:36:00.596699 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:00.596241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerStarted","Data":"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949"} Sep 15 09:36:00.596699 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:00.596259 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerStarted","Data":"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577"} Sep 15 09:36:00.631149 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:00.631074 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podStartSLOduration=16.631049286 podStartE2EDuration="16.631049286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:00.629927292 +0000 UTC m=+1235.155582597" watchObservedRunningTime="2026-09-15 09:36:00.631049286 +0000 UTC m=+1235.156704589" Sep 15 09:36:01.697002 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:01.696959 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:01.697497 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:01.697041 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:01.697497 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:01.697063 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:01.697497 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:01.697081 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:01.698766 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:01.698666 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Sep 15 09:36:01.698766 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:01.698694 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.18:8816: connect: connection refused" Sep 15 09:36:01.698766 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:01.698714 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.18:6571: connect: connection refused" Sep 15 09:36:01.699008 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:01.698761 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Sep 15 09:36:03.145821 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:03.145770 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused" Sep 15 09:36:03.296296 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:03.296245 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused" Sep 15 09:36:04.696491 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:04.696426 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.18:8816: connect: connection refused" Sep 15 09:36:04.696491 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:04.696472 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Sep 15 09:36:04.697061 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:04.696426 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.18:6571: connect: connection refused" Sep 15 09:36:04.697188 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:04.696463 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Sep 15 09:36:06.696849 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:06.696803 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:06.697319 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:06.696879 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:06.697319 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:06.696900 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:06.697319 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:06.696919 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:07.697508 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:07.697043 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Sep 15 09:36:07.697992 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:07.697529 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:07.698616 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:07.698589 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:07.698733 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:07.698720 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:07.769925 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:07.769894 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:08.638453 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:08.638420 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:08.641351 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:08.641325 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:10.696683 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:10.696654 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:11.648592 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:11.648564 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:36:13.145173 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:13.145120 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.17:8443: connect: connection refused" Sep 15 09:36:13.145712 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:13.145320 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:36:13.295823 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:13.295779 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" probeResult="failure" output="Get \"https://10.133.0.17:6567/health\": dial tcp 10.133.0.17:6567: connect: connection refused" Sep 15 09:36:13.296016 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:13.295911 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:36:14.662128 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:14.662095 2562 generic.go:356] "Generic (PLEG): container finished" podID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerID="fa9c1cf9b1a545627f2ae202ab5777afd7c0a7f4e386631a7d2234398803e2a8" exitCode=137 Sep 15 09:36:14.662128 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:14.662120 2562 generic.go:356] "Generic (PLEG): container finished" podID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerID="54e78c1a536cb61efcc4d8c8b5b3ba00f539b0a0ab77388519d85a0449371936" exitCode=137 Sep 15 09:36:14.662604 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:14.662162 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerDied","Data":"fa9c1cf9b1a545627f2ae202ab5777afd7c0a7f4e386631a7d2234398803e2a8"} Sep 15 09:36:14.662604 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:14.662210 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerDied","Data":"54e78c1a536cb61efcc4d8c8b5b3ba00f539b0a0ab77388519d85a0449371936"} Sep 15 09:36:15.107318 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.107292 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:36:15.210599 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.210561 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-offline-tls\") pod \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " Sep 15 09:36:15.210599 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.210608 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls\") pod \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " Sep 15 09:36:15.210857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.210660 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-feast-data\") pod \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " Sep 15 09:36:15.210857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.210683 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-registry-tls\") pod \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " Sep 15 09:36:15.210857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.210713 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-ui-tls\") pod \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " Sep 15 09:36:15.210857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.210747 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg9dl\" (UniqueName: \"kubernetes.io/projected/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-kube-api-access-jg9dl\") pod \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\" (UID: \"647ab55e-bdf7-4c1e-a8ca-9f4314102b64\") " Sep 15 09:36:15.211275 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.211239 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-feast-data" (OuterVolumeSpecName: "feast-data") pod "647ab55e-bdf7-4c1e-a8ca-9f4314102b64" (UID: "647ab55e-bdf7-4c1e-a8ca-9f4314102b64"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:36:15.213082 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.213036 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-kube-api-access-jg9dl" (OuterVolumeSpecName: "kube-api-access-jg9dl") pod "647ab55e-bdf7-4c1e-a8ca-9f4314102b64" (UID: "647ab55e-bdf7-4c1e-a8ca-9f4314102b64"). InnerVolumeSpecName "kube-api-access-jg9dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:36:15.213082 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.213065 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "647ab55e-bdf7-4c1e-a8ca-9f4314102b64" (UID: "647ab55e-bdf7-4c1e-a8ca-9f4314102b64"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:36:15.213293 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.213111 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "647ab55e-bdf7-4c1e-a8ca-9f4314102b64" (UID: "647ab55e-bdf7-4c1e-a8ca-9f4314102b64"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:36:15.213293 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.213172 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls" (OuterVolumeSpecName: "online-tls") pod "647ab55e-bdf7-4c1e-a8ca-9f4314102b64" (UID: "647ab55e-bdf7-4c1e-a8ca-9f4314102b64"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:36:15.213293 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.213184 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "647ab55e-bdf7-4c1e-a8ca-9f4314102b64" (UID: "647ab55e-bdf7-4c1e-a8ca-9f4314102b64"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:36:15.312289 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.312188 2562 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-ui-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:36:15.312289 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.312235 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg9dl\" (UniqueName: \"kubernetes.io/projected/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-kube-api-access-jg9dl\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:36:15.312289 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.312246 2562 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-offline-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:36:15.312289 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.312256 2562 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-online-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:36:15.312289 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.312264 2562 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-feast-data\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:36:15.312289 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.312271 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/647ab55e-bdf7-4c1e-a8ca-9f4314102b64-registry-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:36:15.669383 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.669357 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" Sep 15 09:36:15.669819 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.669356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89" event={"ID":"647ab55e-bdf7-4c1e-a8ca-9f4314102b64","Type":"ContainerDied","Data":"b6ecbe7443004e1575be4eed0ae8373fb399869660cb634d9d5c965b12df888c"} Sep 15 09:36:15.669819 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.669474 2562 scope.go:117] "RemoveContainer" containerID="fe4f338ccb75eabc2f324e4f0ba7e2cefba02002648fe5e2a414ad503ef1392b" Sep 15 09:36:15.677941 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.677885 2562 scope.go:117] "RemoveContainer" containerID="fa9c1cf9b1a545627f2ae202ab5777afd7c0a7f4e386631a7d2234398803e2a8" Sep 15 09:36:15.685919 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.685899 2562 scope.go:117] "RemoveContainer" containerID="ba8f20204de492e3d48b8f079e28ca44a91cd448ba64a15d8b06e786ec0078b1" Sep 15 09:36:15.692186 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.692164 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89"] Sep 15 09:36:15.694251 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.694202 2562 scope.go:117] "RemoveContainer" containerID="54e78c1a536cb61efcc4d8c8b5b3ba00f539b0a0ab77388519d85a0449371936" Sep 15 09:36:15.696137 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.696113 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-lxz89"] Sep 15 09:36:15.702194 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.702167 2562 scope.go:117] "RemoveContainer" containerID="3aed63af43f4da3467364ae6710904ec964531b02d7a90080891bffdb2969c46" Sep 15 09:36:15.709321 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.709302 2562 scope.go:117] "RemoveContainer" containerID="7b2401cc7d06055a9681f19c2957956f7fc293def5118437b078159d17969e30" Sep 15 09:36:15.905307 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:15.905275 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" path="/var/lib/kubelet/pods/647ab55e-bdf7-4c1e-a8ca-9f4314102b64/volumes" Sep 15 09:36:29.509466 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:36:29.509423 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:06.283233 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:06.283184 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:13.322832 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.322788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:13.423509 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.423469 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:13.774506 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.774469 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:13.863816 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.863770 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:13.868029 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868004 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c"] Sep 15 09:37:13.868310 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868298 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="feast-apply" Sep 15 09:37:13.868352 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868312 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="feast-apply" Sep 15 09:37:13.868352 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868319 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="registry" Sep 15 09:37:13.868352 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868325 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="registry" Sep 15 09:37:13.868352 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868335 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="offline" Sep 15 09:37:13.868352 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868340 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="offline" Sep 15 09:37:13.868352 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868346 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" Sep 15 09:37:13.868352 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868351 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" Sep 15 09:37:13.868569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868358 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="feast-init" Sep 15 09:37:13.868569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868363 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="feast-init" Sep 15 09:37:13.868569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868372 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" Sep 15 09:37:13.868569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868377 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" Sep 15 09:37:13.868569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868474 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="online" Sep 15 09:37:13.868569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868483 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="ui" Sep 15 09:37:13.868569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868490 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="offline" Sep 15 09:37:13.868569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.868497 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="647ab55e-bdf7-4c1e-a8ca-9f4314102b64" containerName="registry" Sep 15 09:37:13.871966 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.871946 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:13.874444 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.874422 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 15 09:37:13.874577 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.874536 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 15 09:37:13.874805 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.874786 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 15 09:37:13.874898 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.874842 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 15 09:37:13.874898 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.874871 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 15 09:37:13.875622 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.875604 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 15 09:37:13.875720 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.875606 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-d94xk\"" Sep 15 09:37:13.884318 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.884285 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c"] Sep 15 09:37:13.924982 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.924935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:13.942802 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.942754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slx7r\" (UniqueName: \"kubernetes.io/projected/4217cb98-895e-4d7d-a780-29cf03431766-kube-api-access-slx7r\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:13.942998 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.942828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4217cb98-895e-4d7d-a780-29cf03431766-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:13.942998 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.942879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:13.942998 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.942947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4217cb98-895e-4d7d-a780-29cf03431766-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:13.943230 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.943192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:13.943303 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:13.943275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.044006 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.043906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4217cb98-895e-4d7d-a780-29cf03431766-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.044006 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.043974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.044006 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.044001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.044245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.044024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slx7r\" (UniqueName: \"kubernetes.io/projected/4217cb98-895e-4d7d-a780-29cf03431766-kube-api-access-slx7r\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.044245 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.044051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4217cb98-895e-4d7d-a780-29cf03431766-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.044321 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:37:14.044248 2562 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 15 09:37:14.044374 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:37:14.044325 2562 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 15 09:37:14.044437 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:37:14.044329 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls podName:4217cb98-895e-4d7d-a780-29cf03431766 nodeName:}" failed. No retries permitted until 2026-09-15 09:37:14.544307218 +0000 UTC m=+1309.069962503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" (UID: "4217cb98-895e-4d7d-a780-29cf03431766") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 15 09:37:14.044437 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.044428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.044540 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.044470 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4217cb98-895e-4d7d-a780-29cf03431766-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.044540 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:37:14.044533 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls podName:4217cb98-895e-4d7d-a780-29cf03431766 nodeName:}" failed. No retries permitted until 2026-09-15 09:37:14.544493574 +0000 UTC m=+1309.070148872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" (UID: "4217cb98-895e-4d7d-a780-29cf03431766") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 15 09:37:14.044686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.044669 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4217cb98-895e-4d7d-a780-29cf03431766-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.046984 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.046946 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.055503 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.055479 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slx7r\" (UniqueName: \"kubernetes.io/projected/4217cb98-895e-4d7d-a780-29cf03431766-kube-api-access-slx7r\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.094306 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.094271 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:14.194310 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.194269 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:14.548840 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.548780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.548840 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.548844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.551338 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.551311 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.551504 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.551365 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-rpb5c\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:14.781156 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:14.781111 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:15.059034 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:15.059009 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c"] Sep 15 09:37:15.061199 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:37:15.061168 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4217cb98_895e_4d7d_a780_29cf03431766.slice/crio-061e8ebb5be526c66d20f18ab8e8b66ab3efbd7df2473f1e0ed5c6d6183f32e8 WatchSource:0}: Error finding container 061e8ebb5be526c66d20f18ab8e8b66ab3efbd7df2473f1e0ed5c6d6183f32e8: Status 404 returned error can't find the container with id 061e8ebb5be526c66d20f18ab8e8b66ab3efbd7df2473f1e0ed5c6d6183f32e8 Sep 15 09:37:15.904947 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:15.904915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerStarted","Data":"47708751ab640d9e4ebe73b743c41fde54ee088d8c2f77e1c7aab53a5715ee38"} Sep 15 09:37:15.905340 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:15.904956 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerStarted","Data":"061e8ebb5be526c66d20f18ab8e8b66ab3efbd7df2473f1e0ed5c6d6183f32e8"} Sep 15 09:37:20.921186 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:20.921149 2562 generic.go:356] "Generic (PLEG): container finished" podID="4217cb98-895e-4d7d-a780-29cf03431766" containerID="47708751ab640d9e4ebe73b743c41fde54ee088d8c2f77e1c7aab53a5715ee38" exitCode=0 Sep 15 09:37:20.921663 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:20.921225 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerDied","Data":"47708751ab640d9e4ebe73b743c41fde54ee088d8c2f77e1c7aab53a5715ee38"} Sep 15 09:37:21.926846 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:21.926805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerStarted","Data":"7a02e809aee8b3fffd54a99277575df28e4c7b1bd36bb86e46d96c76659daa9d"} Sep 15 09:37:40.999746 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:40.999716 2562 generic.go:356] "Generic (PLEG): container finished" podID="4217cb98-895e-4d7d-a780-29cf03431766" containerID="7a02e809aee8b3fffd54a99277575df28e4c7b1bd36bb86e46d96c76659daa9d" exitCode=0 Sep 15 09:37:41.000084 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:40.999755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerDied","Data":"7a02e809aee8b3fffd54a99277575df28e4c7b1bd36bb86e46d96c76659daa9d"} Sep 15 09:37:42.008127 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:42.008085 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerStarted","Data":"5f7a2e85736bb21a51981114a00a4b3e292be78b936ea0dc5e6d7e91df3c4ae2"} Sep 15 09:37:42.008608 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:42.008136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerStarted","Data":"bed94131b46059d8a91e14f8c189fcc8a928fed072194bbba4ed2d7ceef945f3"} Sep 15 09:37:42.008608 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:42.008153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerStarted","Data":"c7794bff0316dcf752b1d76202f7f8d5b237e17a7b6691118d0696c2e3e98e09"} Sep 15 09:37:42.031202 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:42.031129 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podStartSLOduration=29.03110513 podStartE2EDuration="29.03110513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:37:42.028679691 +0000 UTC m=+1336.554335017" watchObservedRunningTime="2026-09-15 09:37:42.03110513 +0000 UTC m=+1336.556760434" Sep 15 09:37:44.781461 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.781384 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:44.782024 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.782001 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:44.782161 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.782033 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:44.782161 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.782050 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:44.782161 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.782066 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:44.782161 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.782083 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:44.783634 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.783603 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused" Sep 15 09:37:44.783800 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.783626 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Sep 15 09:37:44.783911 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:44.783704 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 15 09:37:47.782054 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:47.782002 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.19:8816: connect: connection refused" Sep 15 09:37:47.782454 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:47.782085 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 15 09:37:47.782454 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:47.782002 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Sep 15 09:37:50.782079 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:50.782047 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:50.782657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:50.782633 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:50.782920 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:50.782906 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:51.056881 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:51.056802 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:51.785563 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:51.785518 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 15 09:37:52.693424 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:52.693379 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:37:54.398173 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:54.398142 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:37:55.002876 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:37:55.002842 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:38:56.275763 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.275730 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c"] Sep 15 09:38:56.276278 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.276135 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" containerID="cri-o://c7794bff0316dcf752b1d76202f7f8d5b237e17a7b6691118d0696c2e3e98e09" gracePeriod=30 Sep 15 09:38:56.276552 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.276377 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" containerID="cri-o://5f7a2e85736bb21a51981114a00a4b3e292be78b936ea0dc5e6d7e91df3c4ae2" gracePeriod=30 Sep 15 09:38:56.277002 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.276540 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="offline" containerID="cri-o://bed94131b46059d8a91e14f8c189fcc8a928fed072194bbba4ed2d7ceef945f3" gracePeriod=30 Sep 15 09:38:56.277168 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.277140 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:38:56.329866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.329833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:38:56.420397 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.420353 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5"] Sep 15 09:38:56.420594 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.420505 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:38:56.420697 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.420664 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="registry" containerID="cri-o://e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577" gracePeriod=30 Sep 15 09:38:56.420831 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.420785 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" containerID="cri-o://a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71" gracePeriod=30 Sep 15 09:38:56.420831 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.420794 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="offline" containerID="cri-o://6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01" gracePeriod=30 Sep 15 09:38:56.420964 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.420786 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" containerID="cri-o://e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949" gracePeriod=30 Sep 15 09:38:56.518441 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.518384 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:38:56.573252 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:56.573158 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:38:57.302095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:57.302067 2562 generic.go:356] "Generic (PLEG): container finished" podID="4217cb98-895e-4d7d-a780-29cf03431766" containerID="5f7a2e85736bb21a51981114a00a4b3e292be78b936ea0dc5e6d7e91df3c4ae2" exitCode=0 Sep 15 09:38:57.302095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:57.302091 2562 generic.go:356] "Generic (PLEG): container finished" podID="4217cb98-895e-4d7d-a780-29cf03431766" containerID="c7794bff0316dcf752b1d76202f7f8d5b237e17a7b6691118d0696c2e3e98e09" exitCode=0 Sep 15 09:38:57.302511 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:57.302136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerDied","Data":"5f7a2e85736bb21a51981114a00a4b3e292be78b936ea0dc5e6d7e91df3c4ae2"} Sep 15 09:38:57.302511 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:57.302178 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerDied","Data":"c7794bff0316dcf752b1d76202f7f8d5b237e17a7b6691118d0696c2e3e98e09"} Sep 15 09:38:57.305115 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:57.305095 2562 generic.go:356] "Generic (PLEG): container finished" podID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerID="a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71" exitCode=0 Sep 15 09:38:57.305115 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:57.305111 2562 generic.go:356] "Generic (PLEG): container finished" podID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerID="e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949" exitCode=0 Sep 15 09:38:57.305265 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:57.305169 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerDied","Data":"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71"} Sep 15 09:38:57.305265 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:57.305218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerDied","Data":"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949"} Sep 15 09:38:58.638531 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:38:58.638489 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Sep 15 09:39:01.056466 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:01.056429 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Sep 15 09:39:01.322195 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:01.322114 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:39:01.372885 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:01.372859 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:39:01.520378 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:01.520349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:39:01.648335 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:01.648299 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Sep 15 09:39:04.399084 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:04.399046 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 15 09:39:08.638615 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:08.638573 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Sep 15 09:39:11.056683 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:11.056641 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Sep 15 09:39:11.648423 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:11.648366 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Sep 15 09:39:14.399254 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:14.399213 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 15 09:39:18.639020 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:18.638927 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" probeResult="failure" output="Get \"https://10.133.0.18:6567/health\": dial tcp 10.133.0.18:6567: connect: connection refused" Sep 15 09:39:18.639474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:18.639066 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:39:21.057303 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:21.057268 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.19:8443: connect: connection refused" Sep 15 09:39:21.057768 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:21.057373 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:39:21.648794 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:21.648748 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.18:8443: connect: connection refused" Sep 15 09:39:21.648994 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:21.648883 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:39:24.399219 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:24.399162 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" probeResult="failure" output="Get \"https://10.133.0.19:6567/health\": dial tcp 10.133.0.19:6567: connect: connection refused" Sep 15 09:39:24.399714 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:24.399302 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:39:26.414474 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:26.414445 2562 generic.go:356] "Generic (PLEG): container finished" podID="4217cb98-895e-4d7d-a780-29cf03431766" containerID="bed94131b46059d8a91e14f8c189fcc8a928fed072194bbba4ed2d7ceef945f3" exitCode=137 Sep 15 09:39:26.414783 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:26.414520 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerDied","Data":"bed94131b46059d8a91e14f8c189fcc8a928fed072194bbba4ed2d7ceef945f3"} Sep 15 09:39:26.925463 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:26.925441 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:39:27.049834 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.049780 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:39:27.058142 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.058121 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-online-tls\") pod \"4217cb98-895e-4d7d-a780-29cf03431766\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " Sep 15 09:39:27.058255 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.058174 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slx7r\" (UniqueName: \"kubernetes.io/projected/4217cb98-895e-4d7d-a780-29cf03431766-kube-api-access-slx7r\") pod \"4217cb98-895e-4d7d-a780-29cf03431766\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " Sep 15 09:39:27.058255 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.058204 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4217cb98-895e-4d7d-a780-29cf03431766-feast-data\") pod \"4217cb98-895e-4d7d-a780-29cf03431766\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " Sep 15 09:39:27.058354 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.058266 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4217cb98-895e-4d7d-a780-29cf03431766-registry-tls\") pod \"4217cb98-895e-4d7d-a780-29cf03431766\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " Sep 15 09:39:27.058354 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.058293 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls\") pod \"4217cb98-895e-4d7d-a780-29cf03431766\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " Sep 15 09:39:27.058354 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.058319 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls\") pod \"4217cb98-895e-4d7d-a780-29cf03431766\" (UID: \"4217cb98-895e-4d7d-a780-29cf03431766\") " Sep 15 09:39:27.058660 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.058634 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4217cb98-895e-4d7d-a780-29cf03431766-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4217cb98-895e-4d7d-a780-29cf03431766" (UID: "4217cb98-895e-4d7d-a780-29cf03431766"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:39:27.058744 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.058717 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4217cb98-895e-4d7d-a780-29cf03431766-feast-data" (OuterVolumeSpecName: "feast-data") pod "4217cb98-895e-4d7d-a780-29cf03431766" (UID: "4217cb98-895e-4d7d-a780-29cf03431766"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:39:27.060269 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.060247 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4217cb98-895e-4d7d-a780-29cf03431766-kube-api-access-slx7r" (OuterVolumeSpecName: "kube-api-access-slx7r") pod "4217cb98-895e-4d7d-a780-29cf03431766" (UID: "4217cb98-895e-4d7d-a780-29cf03431766"). InnerVolumeSpecName "kube-api-access-slx7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:39:27.060334 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.060266 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-online-tls" (OuterVolumeSpecName: "online-tls") pod "4217cb98-895e-4d7d-a780-29cf03431766" (UID: "4217cb98-895e-4d7d-a780-29cf03431766"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:39:27.060728 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.060693 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "4217cb98-895e-4d7d-a780-29cf03431766" (UID: "4217cb98-895e-4d7d-a780-29cf03431766"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:39:27.060813 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.060706 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "4217cb98-895e-4d7d-a780-29cf03431766" (UID: "4217cb98-895e-4d7d-a780-29cf03431766"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:39:27.159194 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159170 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls\") pod \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " Sep 15 09:39:27.159305 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159212 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls\") pod \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " Sep 15 09:39:27.159305 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159237 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2q5t\" (UniqueName: \"kubernetes.io/projected/76bb6ed9-97d5-4357-afb6-67ffeda26d92-kube-api-access-p2q5t\") pod \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " Sep 15 09:39:27.159305 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159252 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls\") pod \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " Sep 15 09:39:27.159305 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159275 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls\") pod \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " Sep 15 09:39:27.159305 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159294 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb6ed9-97d5-4357-afb6-67ffeda26d92-feast-data\") pod \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\" (UID: \"76bb6ed9-97d5-4357-afb6-67ffeda26d92\") " Sep 15 09:39:27.159605 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159457 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/4217cb98-895e-4d7d-a780-29cf03431766-registry-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.159605 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159474 2562 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-ui-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.159605 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159489 2562 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-offline-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.159605 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159526 2562 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/4217cb98-895e-4d7d-a780-29cf03431766-online-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.159605 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159540 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slx7r\" (UniqueName: \"kubernetes.io/projected/4217cb98-895e-4d7d-a780-29cf03431766-kube-api-access-slx7r\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.159605 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159555 2562 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/4217cb98-895e-4d7d-a780-29cf03431766-feast-data\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.160008 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.159979 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76bb6ed9-97d5-4357-afb6-67ffeda26d92-feast-data" (OuterVolumeSpecName: "feast-data") pod "76bb6ed9-97d5-4357-afb6-67ffeda26d92" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:39:27.161233 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.161204 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls" (OuterVolumeSpecName: "online-tls") pod "76bb6ed9-97d5-4357-afb6-67ffeda26d92" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:39:27.161337 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.161231 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "76bb6ed9-97d5-4357-afb6-67ffeda26d92" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:39:27.161398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.161382 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "76bb6ed9-97d5-4357-afb6-67ffeda26d92" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:39:27.161624 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.161607 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76bb6ed9-97d5-4357-afb6-67ffeda26d92-kube-api-access-p2q5t" (OuterVolumeSpecName: "kube-api-access-p2q5t") pod "76bb6ed9-97d5-4357-afb6-67ffeda26d92" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92"). InnerVolumeSpecName "kube-api-access-p2q5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:39:27.161730 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.161696 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "76bb6ed9-97d5-4357-afb6-67ffeda26d92" (UID: "76bb6ed9-97d5-4357-afb6-67ffeda26d92"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:39:27.259981 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.259958 2562 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-offline-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.259981 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.259977 2562 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/76bb6ed9-97d5-4357-afb6-67ffeda26d92-feast-data\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.260102 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.259986 2562 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-online-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.260102 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.259994 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-registry-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.260102 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.260002 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2q5t\" (UniqueName: \"kubernetes.io/projected/76bb6ed9-97d5-4357-afb6-67ffeda26d92-kube-api-access-p2q5t\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.260102 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.260011 2562 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/76bb6ed9-97d5-4357-afb6-67ffeda26d92-ui-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:27.420721 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.420693 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" Sep 15 09:39:27.421085 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.420692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c" event={"ID":"4217cb98-895e-4d7d-a780-29cf03431766","Type":"ContainerDied","Data":"061e8ebb5be526c66d20f18ab8e8b66ab3efbd7df2473f1e0ed5c6d6183f32e8"} Sep 15 09:39:27.421085 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.420831 2562 scope.go:117] "RemoveContainer" containerID="5f7a2e85736bb21a51981114a00a4b3e292be78b936ea0dc5e6d7e91df3c4ae2" Sep 15 09:39:27.424235 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.424208 2562 generic.go:356] "Generic (PLEG): container finished" podID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerID="6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01" exitCode=137 Sep 15 09:39:27.424235 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.424233 2562 generic.go:356] "Generic (PLEG): container finished" podID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerID="e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577" exitCode=137 Sep 15 09:39:27.424425 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.424280 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" Sep 15 09:39:27.424425 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.424283 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerDied","Data":"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01"} Sep 15 09:39:27.424425 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.424334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerDied","Data":"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577"} Sep 15 09:39:27.424425 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.424356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5" event={"ID":"76bb6ed9-97d5-4357-afb6-67ffeda26d92","Type":"ContainerDied","Data":"79161ee2e619c8981771ca4208ddfea1ed55adbb4fce03afcc3a6cc086e00dbc"} Sep 15 09:39:27.433219 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.433198 2562 scope.go:117] "RemoveContainer" containerID="bed94131b46059d8a91e14f8c189fcc8a928fed072194bbba4ed2d7ceef945f3" Sep 15 09:39:27.441483 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.441468 2562 scope.go:117] "RemoveContainer" containerID="c7794bff0316dcf752b1d76202f7f8d5b237e17a7b6691118d0696c2e3e98e09" Sep 15 09:39:27.444769 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.444743 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c"] Sep 15 09:39:27.448735 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.448714 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-rpb5c"] Sep 15 09:39:27.449294 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.449277 2562 scope.go:117] "RemoveContainer" containerID="7a02e809aee8b3fffd54a99277575df28e4c7b1bd36bb86e46d96c76659daa9d" Sep 15 09:39:27.456394 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.456376 2562 scope.go:117] "RemoveContainer" containerID="47708751ab640d9e4ebe73b743c41fde54ee088d8c2f77e1c7aab53a5715ee38" Sep 15 09:39:27.461129 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.461100 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5"] Sep 15 09:39:27.464095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.464074 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-tv5d5"] Sep 15 09:39:27.464236 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.464227 2562 scope.go:117] "RemoveContainer" containerID="a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71" Sep 15 09:39:27.470959 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.470942 2562 scope.go:117] "RemoveContainer" containerID="6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01" Sep 15 09:39:27.477745 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.477722 2562 scope.go:117] "RemoveContainer" containerID="e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949" Sep 15 09:39:27.484596 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.484578 2562 scope.go:117] "RemoveContainer" containerID="e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577" Sep 15 09:39:27.491154 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.491136 2562 scope.go:117] "RemoveContainer" containerID="21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3" Sep 15 09:39:27.497547 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.497533 2562 scope.go:117] "RemoveContainer" containerID="cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f" Sep 15 09:39:27.503704 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.503683 2562 scope.go:117] "RemoveContainer" containerID="a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71" Sep 15 09:39:27.503985 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:39:27.503953 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71\": container with ID starting with a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71 not found: ID does not exist" containerID="a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71" Sep 15 09:39:27.504036 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.503992 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71"} err="failed to get container status \"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71\": rpc error: code = NotFound desc = could not find container \"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71\": container with ID starting with a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71 not found: ID does not exist" Sep 15 09:39:27.504036 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.504022 2562 scope.go:117] "RemoveContainer" containerID="6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01" Sep 15 09:39:27.504272 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:39:27.504249 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01\": container with ID starting with 6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01 not found: ID does not exist" containerID="6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01" Sep 15 09:39:27.504315 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.504278 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01"} err="failed to get container status \"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01\": rpc error: code = NotFound desc = could not find container \"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01\": container with ID starting with 6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01 not found: ID does not exist" Sep 15 09:39:27.504315 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.504293 2562 scope.go:117] "RemoveContainer" containerID="e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949" Sep 15 09:39:27.504589 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:39:27.504574 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949\": container with ID starting with e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949 not found: ID does not exist" containerID="e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949" Sep 15 09:39:27.504646 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.504593 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949"} err="failed to get container status \"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949\": rpc error: code = NotFound desc = could not find container \"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949\": container with ID starting with e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949 not found: ID does not exist" Sep 15 09:39:27.504646 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.504606 2562 scope.go:117] "RemoveContainer" containerID="e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577" Sep 15 09:39:27.504851 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:39:27.504834 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577\": container with ID starting with e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577 not found: ID does not exist" containerID="e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577" Sep 15 09:39:27.504912 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.504859 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577"} err="failed to get container status \"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577\": rpc error: code = NotFound desc = could not find container \"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577\": container with ID starting with e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577 not found: ID does not exist" Sep 15 09:39:27.504912 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.504880 2562 scope.go:117] "RemoveContainer" containerID="21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3" Sep 15 09:39:27.505138 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:39:27.505123 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3\": container with ID starting with 21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3 not found: ID does not exist" containerID="21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3" Sep 15 09:39:27.505182 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.505143 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3"} err="failed to get container status \"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3\": rpc error: code = NotFound desc = could not find container \"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3\": container with ID starting with 21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3 not found: ID does not exist" Sep 15 09:39:27.505182 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.505158 2562 scope.go:117] "RemoveContainer" containerID="cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f" Sep 15 09:39:27.505395 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:39:27.505380 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f\": container with ID starting with cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f not found: ID does not exist" containerID="cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f" Sep 15 09:39:27.505613 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.505428 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f"} err="failed to get container status \"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f\": rpc error: code = NotFound desc = could not find container \"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f\": container with ID starting with cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f not found: ID does not exist" Sep 15 09:39:27.505613 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.505454 2562 scope.go:117] "RemoveContainer" containerID="a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71" Sep 15 09:39:27.505720 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.505675 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71"} err="failed to get container status \"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71\": rpc error: code = NotFound desc = could not find container \"a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71\": container with ID starting with a3d09996bbed1d85ce463797eff6f2addacf8a3e97dd2eac24545fe4de306b71 not found: ID does not exist" Sep 15 09:39:27.505720 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.505689 2562 scope.go:117] "RemoveContainer" containerID="6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01" Sep 15 09:39:27.505904 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.505884 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01"} err="failed to get container status \"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01\": rpc error: code = NotFound desc = could not find container \"6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01\": container with ID starting with 6e4738ca5cb7825cad4c29ad1e4f132016dbcbd7d6c4eb378d2de30981c0fd01 not found: ID does not exist" Sep 15 09:39:27.505946 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.505905 2562 scope.go:117] "RemoveContainer" containerID="e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949" Sep 15 09:39:27.506140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.506124 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949"} err="failed to get container status \"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949\": rpc error: code = NotFound desc = could not find container \"e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949\": container with ID starting with e894c7993797d49da2f838547c82f49e30b409e3731eb254860c15fe3252f949 not found: ID does not exist" Sep 15 09:39:27.506140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.506140 2562 scope.go:117] "RemoveContainer" containerID="e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577" Sep 15 09:39:27.506349 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.506333 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577"} err="failed to get container status \"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577\": rpc error: code = NotFound desc = could not find container \"e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577\": container with ID starting with e4b013dad4d032109d734a2ed42171e636a79485910536702cd70f4dda4c1577 not found: ID does not exist" Sep 15 09:39:27.506390 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.506348 2562 scope.go:117] "RemoveContainer" containerID="21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3" Sep 15 09:39:27.506600 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.506584 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3"} err="failed to get container status \"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3\": rpc error: code = NotFound desc = could not find container \"21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3\": container with ID starting with 21cd9adc00fa61e365fb78cc6e8ba8cfc6cc3873186064ccd72749b4173955a3 not found: ID does not exist" Sep 15 09:39:27.506600 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.506599 2562 scope.go:117] "RemoveContainer" containerID="cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f" Sep 15 09:39:27.506787 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.506773 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f"} err="failed to get container status \"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f\": rpc error: code = NotFound desc = could not find container \"cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f\": container with ID starting with cf687fb2b0331049d5d04deb56054b29e7dacf282a28bc153f8c341a509f008f not found: ID does not exist" Sep 15 09:39:27.906301 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.906270 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4217cb98-895e-4d7d-a780-29cf03431766" path="/var/lib/kubelet/pods/4217cb98-895e-4d7d-a780-29cf03431766/volumes" Sep 15 09:39:27.906831 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:27.906815 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" path="/var/lib/kubelet/pods/76bb6ed9-97d5-4357-afb6-67ffeda26d92/volumes" Sep 15 09:39:39.209589 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:39.209482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:39:39.317456 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:39.317424 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:39:44.823556 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:44.823519 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:39:44.879968 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:44.879939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:39:44.948706 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:44.948680 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b"] Sep 15 09:39:44.948890 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:44.948872 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" podUID="4c583342-db9c-4a27-b6ca-7134bec8d83f" containerName="manager" containerID="cri-o://b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5" gracePeriod=10 Sep 15 09:39:45.181231 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.181208 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:39:45.279886 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.279854 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md9x2\" (UniqueName: \"kubernetes.io/projected/4c583342-db9c-4a27-b6ca-7134bec8d83f-kube-api-access-md9x2\") pod \"4c583342-db9c-4a27-b6ca-7134bec8d83f\" (UID: \"4c583342-db9c-4a27-b6ca-7134bec8d83f\") " Sep 15 09:39:45.281922 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.281889 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c583342-db9c-4a27-b6ca-7134bec8d83f-kube-api-access-md9x2" (OuterVolumeSpecName: "kube-api-access-md9x2") pod "4c583342-db9c-4a27-b6ca-7134bec8d83f" (UID: "4c583342-db9c-4a27-b6ca-7134bec8d83f"). InnerVolumeSpecName "kube-api-access-md9x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:39:45.380802 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.380764 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md9x2\" (UniqueName: \"kubernetes.io/projected/4c583342-db9c-4a27-b6ca-7134bec8d83f-kube-api-access-md9x2\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:39:45.494491 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.494454 2562 generic.go:356] "Generic (PLEG): container finished" podID="4c583342-db9c-4a27-b6ca-7134bec8d83f" containerID="b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5" exitCode=0 Sep 15 09:39:45.494610 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.494499 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" Sep 15 09:39:45.494610 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.494503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" event={"ID":"4c583342-db9c-4a27-b6ca-7134bec8d83f","Type":"ContainerDied","Data":"b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5"} Sep 15 09:39:45.494700 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.494634 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b" event={"ID":"4c583342-db9c-4a27-b6ca-7134bec8d83f","Type":"ContainerDied","Data":"e2119e37d6adf869c544766cc678541fc4b9fa507b19dd7d952d9a8fe1be2be3"} Sep 15 09:39:45.494700 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.494661 2562 scope.go:117] "RemoveContainer" containerID="b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5" Sep 15 09:39:45.502767 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.502750 2562 scope.go:117] "RemoveContainer" containerID="b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5" Sep 15 09:39:45.503047 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:39:45.503029 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5\": container with ID starting with b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5 not found: ID does not exist" containerID="b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5" Sep 15 09:39:45.503094 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.503055 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5"} err="failed to get container status \"b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5\": rpc error: code = NotFound desc = could not find container \"b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5\": container with ID starting with b708b4f3cbda8126ef1b923bacfc33ca4ec5029c277c75499dc08c014a9669a5 not found: ID does not exist" Sep 15 09:39:45.513427 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.513388 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b"] Sep 15 09:39:45.516896 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.516878 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-jz92b"] Sep 15 09:39:45.905208 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:45.905179 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c583342-db9c-4a27-b6ca-7134bec8d83f" path="/var/lib/kubelet/pods/4c583342-db9c-4a27-b6ca-7134bec8d83f/volumes" Sep 15 09:39:49.410351 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410302 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz"] Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410725 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410745 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410773 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="feast-apply" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410782 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="feast-apply" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410791 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="registry" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410801 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="registry" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410817 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410825 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410833 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410841 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410851 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="offline" Sep 15 09:39:49.410866 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410859 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="offline" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410874 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="feast-init" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410882 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="feast-init" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410891 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410899 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410909 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="offline" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410918 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="offline" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410928 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="feast-apply" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410937 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="feast-apply" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410950 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="feast-init" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410960 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="feast-init" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410971 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c583342-db9c-4a27-b6ca-7134bec8d83f" containerName="manager" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.410980 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c583342-db9c-4a27-b6ca-7134bec8d83f" containerName="manager" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.411049 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="offline" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.411060 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="offline" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.411069 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="ui" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.411080 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="online" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.411087 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="online" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.411095 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c583342-db9c-4a27-b6ca-7134bec8d83f" containerName="manager" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.411102 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4217cb98-895e-4d7d-a780-29cf03431766" containerName="ui" Sep 15 09:39:49.411398 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.411109 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bb6ed9-97d5-4357-afb6-67ffeda26d92" containerName="registry" Sep 15 09:39:49.415554 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.415528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" Sep 15 09:39:49.418079 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.418040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 15 09:39:49.418207 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.418079 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 15 09:39:49.419259 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.419156 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-x96pm\"" Sep 15 09:39:49.421057 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.421029 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz"] Sep 15 09:39:49.504270 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.504244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnt58\" (UniqueName: \"kubernetes.io/projected/cd5890d2-a77a-4972-9327-fa02da1812d4-kube-api-access-wnt58\") pod \"feast-operator-controller-manager-689b877b4b-2qltz\" (UID: \"cd5890d2-a77a-4972-9327-fa02da1812d4\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" Sep 15 09:39:49.605500 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.605475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnt58\" (UniqueName: \"kubernetes.io/projected/cd5890d2-a77a-4972-9327-fa02da1812d4-kube-api-access-wnt58\") pod \"feast-operator-controller-manager-689b877b4b-2qltz\" (UID: \"cd5890d2-a77a-4972-9327-fa02da1812d4\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" Sep 15 09:39:49.613422 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.613374 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnt58\" (UniqueName: \"kubernetes.io/projected/cd5890d2-a77a-4972-9327-fa02da1812d4-kube-api-access-wnt58\") pod \"feast-operator-controller-manager-689b877b4b-2qltz\" (UID: \"cd5890d2-a77a-4972-9327-fa02da1812d4\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" Sep 15 09:39:49.727170 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.727090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" Sep 15 09:39:49.996984 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:49.996962 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz"] Sep 15 09:39:49.999214 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:39:49.999188 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd5890d2_a77a_4972_9327_fa02da1812d4.slice/crio-42d52a8f65238868f0ada2b7937cc47f3326c370f54297c5f8509db891e94f51 WatchSource:0}: Error finding container 42d52a8f65238868f0ada2b7937cc47f3326c370f54297c5f8509db891e94f51: Status 404 returned error can't find the container with id 42d52a8f65238868f0ada2b7937cc47f3326c370f54297c5f8509db891e94f51 Sep 15 09:39:50.517076 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:50.517035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" event={"ID":"cd5890d2-a77a-4972-9327-fa02da1812d4","Type":"ContainerStarted","Data":"12ede0ce7f178c326fd2d37695b963c7a95cd201565c4bd36cdd2c62c3eca09c"} Sep 15 09:39:50.517476 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:50.517088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" event={"ID":"cd5890d2-a77a-4972-9327-fa02da1812d4","Type":"ContainerStarted","Data":"42d52a8f65238868f0ada2b7937cc47f3326c370f54297c5f8509db891e94f51"} Sep 15 09:39:50.517476 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:50.517178 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" Sep 15 09:39:50.532581 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:39:50.532536 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" podStartSLOduration=1.532522859 podStartE2EDuration="1.532522859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:39:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:39:50.531463657 +0000 UTC m=+1465.057118959" watchObservedRunningTime="2026-09-15 09:39:50.532522859 +0000 UTC m=+1465.058178168" Sep 15 09:40:01.523543 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:01.523517 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-2qltz" Sep 15 09:40:05.734829 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:05.734794 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:40:05.833973 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:05.833946 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:40:06.940953 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:06.940899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:40:07.028910 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.028875 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:40:07.029707 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.029681 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp"] Sep 15 09:40:07.033639 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.033617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.036271 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.036245 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 15 09:40:07.036271 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.036266 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 15 09:40:07.036470 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.036456 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 15 09:40:07.036555 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.036540 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 15 09:40:07.036647 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.036621 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 15 09:40:07.036732 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.036717 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tcl4m\"" Sep 15 09:40:07.036906 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.036890 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 15 09:40:07.046708 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.046684 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp"] Sep 15 09:40:07.119389 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.119363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.119512 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.119426 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.119512 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.119455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.119512 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.119478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtklb\" (UniqueName: \"kubernetes.io/projected/170d2e95-ac89-4ccc-82df-bfe395874c00-kube-api-access-qtklb\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.119676 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.119512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/170d2e95-ac89-4ccc-82df-bfe395874c00-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.119676 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.119545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.173758 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.173729 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:40:07.220743 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.220678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/170d2e95-ac89-4ccc-82df-bfe395874c00-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.220743 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.220723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.220898 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.220780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.220898 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.220821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.220898 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.220850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.220898 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:40:07.220872 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found Sep 15 09:40:07.221106 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.220875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtklb\" (UniqueName: \"kubernetes.io/projected/170d2e95-ac89-4ccc-82df-bfe395874c00-kube-api-access-qtklb\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.221106 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:40:07.221049 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 15 09:40:07.221201 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.221119 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/170d2e95-ac89-4ccc-82df-bfe395874c00-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.221201 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:40:07.221133 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls podName:170d2e95-ac89-4ccc-82df-bfe395874c00 nodeName:}" failed. No retries permitted until 2026-09-15 09:40:07.721111659 +0000 UTC m=+1482.246766938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-b45tp" (UID: "170d2e95-ac89-4ccc-82df-bfe395874c00") : secret "feast-simple-feast-setup-ui-tls" not found Sep 15 09:40:07.221366 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:40:07.221352 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls podName:170d2e95-ac89-4ccc-82df-bfe395874c00 nodeName:}" failed. No retries permitted until 2026-09-15 09:40:07.721333729 +0000 UTC m=+1482.246989025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-b45tp" (UID: "170d2e95-ac89-4ccc-82df-bfe395874c00") : secret "feast-simple-feast-setup-registry-tls" not found Sep 15 09:40:07.223429 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.223377 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.223631 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.223610 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.228798 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.228776 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtklb\" (UniqueName: \"kubernetes.io/projected/170d2e95-ac89-4ccc-82df-bfe395874c00-kube-api-access-qtklb\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.333727 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.333700 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:40:07.483591 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.483525 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:40:07.724821 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.724791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.724944 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.724835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.727196 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.727167 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.727359 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.727338 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-b45tp\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:07.945731 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:07.945701 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:08.219154 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:08.219127 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp"] Sep 15 09:40:08.220389 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:40:08.220366 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod170d2e95_ac89_4ccc_82df_bfe395874c00.slice/crio-eb216783165b0c119798072569a4fa921fd8485b423cb11e56f2923cf4ca9b76 WatchSource:0}: Error finding container eb216783165b0c119798072569a4fa921fd8485b423cb11e56f2923cf4ca9b76: Status 404 returned error can't find the container with id eb216783165b0c119798072569a4fa921fd8485b423cb11e56f2923cf4ca9b76 Sep 15 09:40:08.583121 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:08.583036 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerStarted","Data":"442a680925045b6e8d2729f8e8ed247503d6efbf8121f141443a6842cb6e7943"} Sep 15 09:40:08.583121 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:08.583090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerStarted","Data":"eb216783165b0c119798072569a4fa921fd8485b423cb11e56f2923cf4ca9b76"} Sep 15 09:40:13.602546 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:13.602512 2562 generic.go:356] "Generic (PLEG): container finished" podID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerID="442a680925045b6e8d2729f8e8ed247503d6efbf8121f141443a6842cb6e7943" exitCode=0 Sep 15 09:40:13.602910 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:13.602554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerDied","Data":"442a680925045b6e8d2729f8e8ed247503d6efbf8121f141443a6842cb6e7943"} Sep 15 09:40:14.609906 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:14.609870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerStarted","Data":"4ab2c41da2cb4c8d6e85df6becca0898d8e7496ffa2872d17fb95cc4a7f286b3"} Sep 15 09:40:19.633048 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:19.633021 2562 generic.go:356] "Generic (PLEG): container finished" podID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerID="4ab2c41da2cb4c8d6e85df6becca0898d8e7496ffa2872d17fb95cc4a7f286b3" exitCode=0 Sep 15 09:40:19.633381 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:19.633094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerDied","Data":"4ab2c41da2cb4c8d6e85df6becca0898d8e7496ffa2872d17fb95cc4a7f286b3"} Sep 15 09:40:20.643565 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:20.643510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerStarted","Data":"e46441e29482f593785f936db8276008c5272354c89660e6e09acbc8e5e3aa67"} Sep 15 09:40:20.644039 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:20.643573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerStarted","Data":"d13b4b72abf30faaac5f4fd0dc0a1cb674de77239d054af55d95f0462b7b66ee"} Sep 15 09:40:20.644039 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:20.643594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerStarted","Data":"4ac6b62d86606cd87a445378f62002ad3be88f024f43008f5561c61099881017"} Sep 15 09:40:20.644039 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:20.643612 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerStarted","Data":"6f36734d4b9ed44a5d2f43116eb994237fe6ccd606e696f2eb1e8062afbffe7d"} Sep 15 09:40:20.666553 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:20.666487 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podStartSLOduration=13.666459963 podStartE2EDuration="13.666459963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:40:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:40:20.665042498 +0000 UTC m=+1495.190697800" watchObservedRunningTime="2026-09-15 09:40:20.666459963 +0000 UTC m=+1495.192115291" Sep 15 09:40:22.946540 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:22.946497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:22.946990 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:22.946563 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:22.946990 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:22.946583 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:22.946990 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:22.946601 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:22.948641 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:22.948608 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 15 09:40:22.948871 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:22.948612 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused" Sep 15 09:40:22.948942 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:22.948658 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused" Sep 15 09:40:22.948942 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:22.948686 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 15 09:40:25.925930 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:25.925897 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:40:25.928517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:25.928495 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:40:25.946449 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:25.946396 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.21:6571: connect: connection refused" Sep 15 09:40:25.946674 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:25.946417 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.21:8816: connect: connection refused" Sep 15 09:40:25.946760 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:25.946426 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 15 09:40:25.946760 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:25.946491 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 15 09:40:27.946693 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:27.946656 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:27.947051 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:27.946706 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:27.947051 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:27.946722 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:27.947051 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:27.946732 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:28.947329 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:28.947294 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:28.947786 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:28.947391 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:28.947786 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:28.947697 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:28.948538 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:28.948515 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:28.948619 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:28.948585 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:28.948662 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:28.948619 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:28.952445 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:28.952428 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:40:29.690120 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:40:29.690085 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:41:32.429013 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.428982 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp"] Sep 15 09:41:32.433382 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.429204 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="registry" containerID="cri-o://6f36734d4b9ed44a5d2f43116eb994237fe6ccd606e696f2eb1e8062afbffe7d" gracePeriod=30 Sep 15 09:41:32.433382 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.429322 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" containerID="cri-o://e46441e29482f593785f936db8276008c5272354c89660e6e09acbc8e5e3aa67" gracePeriod=30 Sep 15 09:41:32.433382 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.429347 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" containerID="cri-o://4ac6b62d86606cd87a445378f62002ad3be88f024f43008f5561c61099881017" gracePeriod=30 Sep 15 09:41:32.433382 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.429346 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="offline" containerID="cri-o://d13b4b72abf30faaac5f4fd0dc0a1cb674de77239d054af55d95f0462b7b66ee" gracePeriod=30 Sep 15 09:41:32.787228 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.787106 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn"] Sep 15 09:41:32.791367 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.791339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.794818 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.794360 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-9zvn4\"" Sep 15 09:41:32.802298 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.802271 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn"] Sep 15 09:41:32.822017 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.821990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.822214 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.822198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.822339 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.822325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.822479 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.822463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a278b736-004c-44cd-a20b-3cd9bd9b08c0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.822652 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.822625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7l4p\" (UniqueName: \"kubernetes.io/projected/a278b736-004c-44cd-a20b-3cd9bd9b08c0-kube-api-access-m7l4p\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.822777 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.822764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.923630 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.923591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7l4p\" (UniqueName: \"kubernetes.io/projected/a278b736-004c-44cd-a20b-3cd9bd9b08c0-kube-api-access-m7l4p\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.923838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.923654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.923838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.923729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.923838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.923754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.923838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.923788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.923838 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.923810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a278b736-004c-44cd-a20b-3cd9bd9b08c0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.924452 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:41:32.924161 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 15 09:41:32.924452 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:41:32.924234 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls podName:a278b736-004c-44cd-a20b-3cd9bd9b08c0 nodeName:}" failed. No retries permitted until 2026-09-15 09:41:33.424213526 +0000 UTC m=+1567.949868810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls") pod "feast-simple-feast-setup-57576b8fcf-7mfmn" (UID: "a278b736-004c-44cd-a20b-3cd9bd9b08c0") : secret "feast-simple-feast-setup-online-tls" not found Sep 15 09:41:32.924452 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.924232 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a278b736-004c-44cd-a20b-3cd9bd9b08c0-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.924452 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:41:32.924448 2562 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 15 09:41:32.924752 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:41:32.924515 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls podName:a278b736-004c-44cd-a20b-3cd9bd9b08c0 nodeName:}" failed. No retries permitted until 2026-09-15 09:41:33.424496716 +0000 UTC m=+1567.950151996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-7mfmn" (UID: "a278b736-004c-44cd-a20b-3cd9bd9b08c0") : secret "feast-simple-feast-setup-ui-tls" not found Sep 15 09:41:32.926456 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.926426 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.926748 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.926730 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:32.932868 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:32.932835 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7l4p\" (UniqueName: \"kubernetes.io/projected/a278b736-004c-44cd-a20b-3cd9bd9b08c0-kube-api-access-m7l4p\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:33.428736 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.428697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:33.428918 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.428743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:33.431072 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.431044 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:33.431376 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.431117 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-7mfmn\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:33.570372 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.570341 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:41:33.710269 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.710197 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:33.921763 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.921734 2562 generic.go:356] "Generic (PLEG): container finished" podID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerID="e46441e29482f593785f936db8276008c5272354c89660e6e09acbc8e5e3aa67" exitCode=0 Sep 15 09:41:33.921763 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.921757 2562 generic.go:356] "Generic (PLEG): container finished" podID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerID="4ac6b62d86606cd87a445378f62002ad3be88f024f43008f5561c61099881017" exitCode=0 Sep 15 09:41:33.921925 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.921801 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerDied","Data":"e46441e29482f593785f936db8276008c5272354c89660e6e09acbc8e5e3aa67"} Sep 15 09:41:33.921925 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.921835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerDied","Data":"4ac6b62d86606cd87a445378f62002ad3be88f024f43008f5561c61099881017"} Sep 15 09:41:33.985956 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:33.985928 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn"] Sep 15 09:41:33.986605 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:41:33.986583 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda278b736_004c_44cd_a20b_3cd9bd9b08c0.slice/crio-b2f095c5283ee8d45a95019e50b772190af10d87891e4495cdd5d3ac7358d54e WatchSource:0}: Error finding container b2f095c5283ee8d45a95019e50b772190af10d87891e4495cdd5d3ac7358d54e: Status 404 returned error can't find the container with id b2f095c5283ee8d45a95019e50b772190af10d87891e4495cdd5d3ac7358d54e Sep 15 09:41:34.927835 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:34.927803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerStarted","Data":"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4"} Sep 15 09:41:34.927835 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:34.927842 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerStarted","Data":"b2f095c5283ee8d45a95019e50b772190af10d87891e4495cdd5d3ac7358d54e"} Sep 15 09:41:35.236503 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:35.236421 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:41:38.943783 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:38.943749 2562 generic.go:356] "Generic (PLEG): container finished" podID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerID="e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4" exitCode=0 Sep 15 09:41:38.944133 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:38.943790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerDied","Data":"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4"} Sep 15 09:41:38.948210 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:38.948173 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 15 09:41:39.687694 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:39.687643 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 15 09:41:39.949413 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:39.949324 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerStarted","Data":"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403"} Sep 15 09:41:44.969679 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:44.969647 2562 generic.go:356] "Generic (PLEG): container finished" podID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerID="388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403" exitCode=0 Sep 15 09:41:44.970021 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:44.969710 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerDied","Data":"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403"} Sep 15 09:41:45.979700 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:45.979655 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerStarted","Data":"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641"} Sep 15 09:41:45.980163 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:45.979717 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerStarted","Data":"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0"} Sep 15 09:41:45.980163 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:45.979738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerStarted","Data":"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc"} Sep 15 09:41:45.980163 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:45.979759 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerStarted","Data":"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d"} Sep 15 09:41:46.009433 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:46.005351 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podStartSLOduration=14.005325021 podStartE2EDuration="14.005325021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:41:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:41:46.002824264 +0000 UTC m=+1580.528479569" watchObservedRunningTime="2026-09-15 09:41:46.005325021 +0000 UTC m=+1580.530980324" Sep 15 09:41:48.711999 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.711011 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:48.711999 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.711076 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:48.711999 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.711098 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:48.711999 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.711115 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:48.713166 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.712960 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Sep 15 09:41:48.713166 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.713015 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 15 09:41:48.713166 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.712955 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 15 09:41:48.713166 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.713063 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 15 09:41:48.949218 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:48.949174 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 15 09:41:49.687784 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:49.687738 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 15 09:41:51.710719 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:51.710670 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused" Sep 15 09:41:51.711212 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:51.710670 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 15 09:41:51.711212 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:51.710684 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused" Sep 15 09:41:51.711212 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:51.710684 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 15 09:41:53.711260 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:53.711214 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:53.711260 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:53.711274 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:53.711841 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:53.711286 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:53.711841 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:53.711298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:54.711803 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:54.711708 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:54.712197 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:54.712012 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:54.712197 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:54.712098 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:54.717032 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:54.717010 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:55.023266 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:55.023181 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:55.023446 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:55.023377 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:55.023525 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:55.023468 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:55.026002 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:55.025977 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:41:58.948560 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:58.948510 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.21:8443: connect: connection refused" Sep 15 09:41:58.949017 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:58.948645 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:41:59.688009 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:59.687962 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" probeResult="failure" output="Get \"https://10.133.0.21:6567/health\": dial tcp 10.133.0.21:6567: connect: connection refused" Sep 15 09:41:59.688164 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:41:59.688131 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:42:03.056522 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.056491 2562 generic.go:356] "Generic (PLEG): container finished" podID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerID="d13b4b72abf30faaac5f4fd0dc0a1cb674de77239d054af55d95f0462b7b66ee" exitCode=137 Sep 15 09:42:03.056522 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.056515 2562 generic.go:356] "Generic (PLEG): container finished" podID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerID="6f36734d4b9ed44a5d2f43116eb994237fe6ccd606e696f2eb1e8062afbffe7d" exitCode=137 Sep 15 09:42:03.056977 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.056558 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerDied","Data":"d13b4b72abf30faaac5f4fd0dc0a1cb674de77239d054af55d95f0462b7b66ee"} Sep 15 09:42:03.056977 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.056602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerDied","Data":"6f36734d4b9ed44a5d2f43116eb994237fe6ccd606e696f2eb1e8062afbffe7d"} Sep 15 09:42:03.082755 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.082733 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:42:03.172604 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.172571 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtklb\" (UniqueName: \"kubernetes.io/projected/170d2e95-ac89-4ccc-82df-bfe395874c00-kube-api-access-qtklb\") pod \"170d2e95-ac89-4ccc-82df-bfe395874c00\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " Sep 15 09:42:03.172792 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.172628 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls\") pod \"170d2e95-ac89-4ccc-82df-bfe395874c00\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " Sep 15 09:42:03.172792 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.172652 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/170d2e95-ac89-4ccc-82df-bfe395874c00-feast-data\") pod \"170d2e95-ac89-4ccc-82df-bfe395874c00\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " Sep 15 09:42:03.172792 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.172687 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-online-tls\") pod \"170d2e95-ac89-4ccc-82df-bfe395874c00\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " Sep 15 09:42:03.172792 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.172709 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls\") pod \"170d2e95-ac89-4ccc-82df-bfe395874c00\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " Sep 15 09:42:03.172792 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.172741 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-offline-tls\") pod \"170d2e95-ac89-4ccc-82df-bfe395874c00\" (UID: \"170d2e95-ac89-4ccc-82df-bfe395874c00\") " Sep 15 09:42:03.173380 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.173333 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/170d2e95-ac89-4ccc-82df-bfe395874c00-feast-data" (OuterVolumeSpecName: "feast-data") pod "170d2e95-ac89-4ccc-82df-bfe395874c00" (UID: "170d2e95-ac89-4ccc-82df-bfe395874c00"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:42:03.173559 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.173540 2562 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/170d2e95-ac89-4ccc-82df-bfe395874c00-feast-data\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:42:03.175127 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.175091 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "170d2e95-ac89-4ccc-82df-bfe395874c00" (UID: "170d2e95-ac89-4ccc-82df-bfe395874c00"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:42:03.175314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.175284 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "170d2e95-ac89-4ccc-82df-bfe395874c00" (UID: "170d2e95-ac89-4ccc-82df-bfe395874c00"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:42:03.175429 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.175293 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170d2e95-ac89-4ccc-82df-bfe395874c00-kube-api-access-qtklb" (OuterVolumeSpecName: "kube-api-access-qtklb") pod "170d2e95-ac89-4ccc-82df-bfe395874c00" (UID: "170d2e95-ac89-4ccc-82df-bfe395874c00"). InnerVolumeSpecName "kube-api-access-qtklb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:42:03.175429 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.175328 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "170d2e95-ac89-4ccc-82df-bfe395874c00" (UID: "170d2e95-ac89-4ccc-82df-bfe395874c00"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:42:03.175429 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.175343 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-online-tls" (OuterVolumeSpecName: "online-tls") pod "170d2e95-ac89-4ccc-82df-bfe395874c00" (UID: "170d2e95-ac89-4ccc-82df-bfe395874c00"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:42:03.274208 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.274133 2562 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-online-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:42:03.274208 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.274160 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-registry-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:42:03.274208 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.274168 2562 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-offline-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:42:03.274208 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.274177 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtklb\" (UniqueName: \"kubernetes.io/projected/170d2e95-ac89-4ccc-82df-bfe395874c00-kube-api-access-qtklb\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:42:03.274208 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:03.274187 2562 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/170d2e95-ac89-4ccc-82df-bfe395874c00-ui-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:42:04.066061 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.066028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" event={"ID":"170d2e95-ac89-4ccc-82df-bfe395874c00","Type":"ContainerDied","Data":"eb216783165b0c119798072569a4fa921fd8485b423cb11e56f2923cf4ca9b76"} Sep 15 09:42:04.066061 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.066052 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp" Sep 15 09:42:04.066557 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.066082 2562 scope.go:117] "RemoveContainer" containerID="e46441e29482f593785f936db8276008c5272354c89660e6e09acbc8e5e3aa67" Sep 15 09:42:04.074070 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.074048 2562 scope.go:117] "RemoveContainer" containerID="d13b4b72abf30faaac5f4fd0dc0a1cb674de77239d054af55d95f0462b7b66ee" Sep 15 09:42:04.081182 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.081167 2562 scope.go:117] "RemoveContainer" containerID="4ac6b62d86606cd87a445378f62002ad3be88f024f43008f5561c61099881017" Sep 15 09:42:04.084910 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.084886 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp"] Sep 15 09:42:04.087790 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.087767 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-b45tp"] Sep 15 09:42:04.088728 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.088710 2562 scope.go:117] "RemoveContainer" containerID="6f36734d4b9ed44a5d2f43116eb994237fe6ccd606e696f2eb1e8062afbffe7d" Sep 15 09:42:04.095428 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.095394 2562 scope.go:117] "RemoveContainer" containerID="4ab2c41da2cb4c8d6e85df6becca0898d8e7496ffa2872d17fb95cc4a7f286b3" Sep 15 09:42:04.102335 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:04.102319 2562 scope.go:117] "RemoveContainer" containerID="442a680925045b6e8d2729f8e8ed247503d6efbf8121f141443a6842cb6e7943" Sep 15 09:42:05.905031 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:05.904998 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" path="/var/lib/kubelet/pods/170d2e95-ac89-4ccc-82df-bfe395874c00/volumes" Sep 15 09:42:22.749818 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:22.749733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:42:56.955235 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:56.955179 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:42:57.003756 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.003717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:42:57.285911 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.285809 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:42:57.369510 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.369475 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:42:57.372938 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.372912 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df"] Sep 15 09:42:57.373176 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373165 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="offline" Sep 15 09:42:57.373217 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373178 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="offline" Sep 15 09:42:57.373217 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373189 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="registry" Sep 15 09:42:57.373217 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373195 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="registry" Sep 15 09:42:57.373217 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373204 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" Sep 15 09:42:57.373217 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373209 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373219 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="feast-apply" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373225 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="feast-apply" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373233 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373239 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373247 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="feast-init" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373252 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="feast-init" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373299 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="offline" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373306 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="registry" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373313 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="online" Sep 15 09:42:57.373373 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.373319 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="170d2e95-ac89-4ccc-82df-bfe395874c00" containerName="ui" Sep 15 09:42:57.376419 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.376382 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.379161 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.379137 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 15 09:42:57.379441 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.379400 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 15 09:42:57.379563 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.379398 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-5gtgq\"" Sep 15 09:42:57.379563 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.379454 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 15 09:42:57.379887 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.379865 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 15 09:42:57.379887 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.379883 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 15 09:42:57.380059 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.379869 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 15 09:42:57.387627 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.387603 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df"] Sep 15 09:42:57.465579 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.465539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b6e976-50cd-4166-a0c2-915be651551f-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.465767 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.465597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.465767 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.465682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/34b6e976-50cd-4166-a0c2-915be651551f-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.465767 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.465709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.465767 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.465748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzsp\" (UniqueName: \"kubernetes.io/projected/34b6e976-50cd-4166-a0c2-915be651551f-kube-api-access-zwzsp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.465914 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.465807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.567210 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.567117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/34b6e976-50cd-4166-a0c2-915be651551f-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.567210 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.567164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.567210 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.567206 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzsp\" (UniqueName: \"kubernetes.io/projected/34b6e976-50cd-4166-a0c2-915be651551f-kube-api-access-zwzsp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.567511 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.567236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.567511 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.567275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b6e976-50cd-4166-a0c2-915be651551f-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.567511 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.567309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.567511 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:42:57.567353 2562 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Sep 15 09:42:57.567511 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:42:57.567455 2562 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 15 09:42:57.567772 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:42:57.567556 2562 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 15 09:42:57.567772 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:42:57.567459 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls podName:34b6e976-50cd-4166-a0c2-915be651551f nodeName:}" failed. No retries permitted until 2026-09-15 09:42:58.067438492 +0000 UTC m=+1652.593093777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-nt7df" (UID: "34b6e976-50cd-4166-a0c2-915be651551f") : secret "feast-simple-feast-remote-setup-online-tls" not found Sep 15 09:42:57.567772 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:42:57.567606 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls podName:34b6e976-50cd-4166-a0c2-915be651551f nodeName:}" failed. No retries permitted until 2026-09-15 09:42:58.067590743 +0000 UTC m=+1652.593246029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-nt7df" (UID: "34b6e976-50cd-4166-a0c2-915be651551f") : secret "feast-simple-feast-remote-setup-ui-tls" not found Sep 15 09:42:57.567772 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:42:57.567620 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls podName:34b6e976-50cd-4166-a0c2-915be651551f nodeName:}" failed. No retries permitted until 2026-09-15 09:42:58.06761178 +0000 UTC m=+1652.593267066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-nt7df" (UID: "34b6e976-50cd-4166-a0c2-915be651551f") : secret "feast-simple-feast-remote-setup-offline-tls" not found Sep 15 09:42:57.567992 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.567825 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b6e976-50cd-4166-a0c2-915be651551f-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.567992 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.567925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/34b6e976-50cd-4166-a0c2-915be651551f-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.577625 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.577603 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzsp\" (UniqueName: \"kubernetes.io/projected/34b6e976-50cd-4166-a0c2-915be651551f-kube-api-access-zwzsp\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:57.691293 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.691263 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:42:57.847199 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.847127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:42:57.949946 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:57.949916 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:42:58.070715 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:58.070677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:58.071073 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:58.070735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:58.071073 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:58.070798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:58.073251 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:58.073221 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:58.073358 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:58.073286 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:58.073358 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:58.073286 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-nt7df\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:58.285781 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:58.285747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:42:58.561039 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:58.561014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df"] Sep 15 09:42:58.562382 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:42:58.562358 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34b6e976_50cd_4166_a0c2_915be651551f.slice/crio-262e168e5cee4f1b20db5a97d10a9c1e794d9a0972b574195114a5b3a857a63a WatchSource:0}: Error finding container 262e168e5cee4f1b20db5a97d10a9c1e794d9a0972b574195114a5b3a857a63a: Status 404 returned error can't find the container with id 262e168e5cee4f1b20db5a97d10a9c1e794d9a0972b574195114a5b3a857a63a Sep 15 09:42:59.267521 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:59.267486 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerStarted","Data":"a3ee5df7d535ab082ba3c422bf28ef5ea99abcdaf95325287033346f15aacb1c"} Sep 15 09:42:59.267926 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:42:59.267532 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerStarted","Data":"262e168e5cee4f1b20db5a97d10a9c1e794d9a0972b574195114a5b3a857a63a"} Sep 15 09:43:04.288029 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:04.287995 2562 generic.go:356] "Generic (PLEG): container finished" podID="34b6e976-50cd-4166-a0c2-915be651551f" containerID="a3ee5df7d535ab082ba3c422bf28ef5ea99abcdaf95325287033346f15aacb1c" exitCode=0 Sep 15 09:43:04.288029 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:04.288030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerDied","Data":"a3ee5df7d535ab082ba3c422bf28ef5ea99abcdaf95325287033346f15aacb1c"} Sep 15 09:43:05.299140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:05.299092 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerStarted","Data":"acbb21b73dab92c3724ab9355b565eeaee84f2f4cd68a6a64f7f20889b027b2e"} Sep 15 09:43:25.371879 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:25.371843 2562 generic.go:356] "Generic (PLEG): container finished" podID="34b6e976-50cd-4166-a0c2-915be651551f" containerID="acbb21b73dab92c3724ab9355b565eeaee84f2f4cd68a6a64f7f20889b027b2e" exitCode=0 Sep 15 09:43:25.372356 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:25.371910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerDied","Data":"acbb21b73dab92c3724ab9355b565eeaee84f2f4cd68a6a64f7f20889b027b2e"} Sep 15 09:43:26.379163 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:26.379125 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerStarted","Data":"da3b4d9be96bcf6f5182aab99a360cb9e463849c8c2633ec6cd9f8d79f99e5c1"} Sep 15 09:43:26.379640 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:26.379185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerStarted","Data":"ee4a9ef9bf97b28934f6659fe0a5e2ae74e0d6a51c88f1917e3fab1370f96b09"} Sep 15 09:43:26.379640 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:26.379208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerStarted","Data":"fe178004b1ef5e6660c92271a6ecc164cdf908fe912af5bc5643bf51eb4e7503"} Sep 15 09:43:26.404588 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:26.404539 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podStartSLOduration=29.404521419 podStartE2EDuration="29.404521419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:43:26.402015854 +0000 UTC m=+1680.927671156" watchObservedRunningTime="2026-09-15 09:43:26.404521419 +0000 UTC m=+1680.930176720" Sep 15 09:43:28.286368 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.286321 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:28.286857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.286516 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:28.286857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.286569 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:28.286857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.286587 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:28.286857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.286604 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:28.286857 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.286618 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:28.288186 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.288145 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused" Sep 15 09:43:28.288186 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.288165 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 15 09:43:28.288351 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:28.288211 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 15 09:43:31.286507 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:31.286459 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 15 09:43:31.286999 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:31.286551 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 15 09:43:31.286999 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:31.286459 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused" Sep 15 09:43:34.287129 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:34.287102 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:34.287682 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:34.287654 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:34.287982 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:34.287960 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:34.416959 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:34.416930 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:35.290556 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:35.290513 2562 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Sep 15 09:43:37.937219 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:37.937189 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:43:38.590179 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:43:38.590146 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:44:10.804037 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:10.803989 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:44:39.638235 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.638194 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df"] Sep 15 09:44:39.638718 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.638604 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" containerID="cri-o://fe178004b1ef5e6660c92271a6ecc164cdf908fe912af5bc5643bf51eb4e7503" gracePeriod=30 Sep 15 09:44:39.638718 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.638656 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" containerID="cri-o://da3b4d9be96bcf6f5182aab99a360cb9e463849c8c2633ec6cd9f8d79f99e5c1" gracePeriod=30 Sep 15 09:44:39.638846 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.638698 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="offline" containerID="cri-o://ee4a9ef9bf97b28934f6659fe0a5e2ae74e0d6a51c88f1917e3fab1370f96b09" gracePeriod=30 Sep 15 09:44:39.640963 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.640839 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:44:39.693793 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.693747 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:44:39.781790 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.781756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:44:39.782610 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.782572 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn"] Sep 15 09:44:39.782873 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.782848 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="registry" containerID="cri-o://1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d" gracePeriod=30 Sep 15 09:44:39.782941 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.782867 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" containerID="cri-o://6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641" gracePeriod=30 Sep 15 09:44:39.783000 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.782870 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="offline" containerID="cri-o://0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0" gracePeriod=30 Sep 15 09:44:39.783000 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.782951 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" containerID="cri-o://e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc" gracePeriod=30 Sep 15 09:44:39.881831 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.881797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:44:39.938443 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:39.938346 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:44:40.678491 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:40.678467 2562 generic.go:356] "Generic (PLEG): container finished" podID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerID="6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641" exitCode=0 Sep 15 09:44:40.678491 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:40.678490 2562 generic.go:356] "Generic (PLEG): container finished" podID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerID="e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc" exitCode=0 Sep 15 09:44:40.678845 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:40.678548 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerDied","Data":"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641"} Sep 15 09:44:40.678845 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:40.678609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerDied","Data":"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc"} Sep 15 09:44:40.681153 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:40.681126 2562 generic.go:356] "Generic (PLEG): container finished" podID="34b6e976-50cd-4166-a0c2-915be651551f" containerID="da3b4d9be96bcf6f5182aab99a360cb9e463849c8c2633ec6cd9f8d79f99e5c1" exitCode=0 Sep 15 09:44:40.681153 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:40.681145 2562 generic.go:356] "Generic (PLEG): container finished" podID="34b6e976-50cd-4166-a0c2-915be651551f" containerID="fe178004b1ef5e6660c92271a6ecc164cdf908fe912af5bc5643bf51eb4e7503" exitCode=0 Sep 15 09:44:40.681271 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:40.681186 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerDied","Data":"da3b4d9be96bcf6f5182aab99a360cb9e463849c8c2633ec6cd9f8d79f99e5c1"} Sep 15 09:44:40.681271 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:40.681211 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerDied","Data":"fe178004b1ef5e6660c92271a6ecc164cdf908fe912af5bc5643bf51eb4e7503"} Sep 15 09:44:44.417335 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:44.417287 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 15 09:44:44.950126 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:44.950080 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:44:45.023184 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:45.023129 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 15 09:44:45.023352 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:45.023185 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 15 09:44:47.938214 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:47.938181 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 15 09:44:49.996351 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:49.996303 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:44:54.417035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:54.417004 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 15 09:44:55.023080 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:55.023042 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 15 09:44:55.023234 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:55.023072 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 15 09:44:57.937802 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:44:57.937763 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 15 09:45:04.416366 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:04.416326 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused" Sep 15 09:45:04.416788 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:04.416468 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:45:05.023082 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:05.023043 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused" Sep 15 09:45:05.023082 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:05.023055 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused" Sep 15 09:45:05.023310 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:05.023164 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:45:05.023310 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:05.023228 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:45:07.938181 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:07.938145 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused" Sep 15 09:45:07.938659 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:07.938263 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:45:09.788035 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:09.788004 2562 generic.go:356] "Generic (PLEG): container finished" podID="34b6e976-50cd-4166-a0c2-915be651551f" containerID="ee4a9ef9bf97b28934f6659fe0a5e2ae74e0d6a51c88f1917e3fab1370f96b09" exitCode=137 Sep 15 09:45:09.788376 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:09.788054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerDied","Data":"ee4a9ef9bf97b28934f6659fe0a5e2ae74e0d6a51c88f1917e3fab1370f96b09"} Sep 15 09:45:10.282430 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.282391 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:45:10.395923 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.395896 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/34b6e976-50cd-4166-a0c2-915be651551f-registry-tls\") pod \"34b6e976-50cd-4166-a0c2-915be651551f\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " Sep 15 09:45:10.396073 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.395951 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b6e976-50cd-4166-a0c2-915be651551f-feast-data\") pod \"34b6e976-50cd-4166-a0c2-915be651551f\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " Sep 15 09:45:10.396073 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.396016 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwzsp\" (UniqueName: \"kubernetes.io/projected/34b6e976-50cd-4166-a0c2-915be651551f-kube-api-access-zwzsp\") pod \"34b6e976-50cd-4166-a0c2-915be651551f\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " Sep 15 09:45:10.396073 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.396043 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls\") pod \"34b6e976-50cd-4166-a0c2-915be651551f\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " Sep 15 09:45:10.396073 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.396068 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls\") pod \"34b6e976-50cd-4166-a0c2-915be651551f\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " Sep 15 09:45:10.396269 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.396110 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls\") pod \"34b6e976-50cd-4166-a0c2-915be651551f\" (UID: \"34b6e976-50cd-4166-a0c2-915be651551f\") " Sep 15 09:45:10.396319 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.396277 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34b6e976-50cd-4166-a0c2-915be651551f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "34b6e976-50cd-4166-a0c2-915be651551f" (UID: "34b6e976-50cd-4166-a0c2-915be651551f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 15 09:45:10.396558 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.396530 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34b6e976-50cd-4166-a0c2-915be651551f-feast-data" (OuterVolumeSpecName: "feast-data") pod "34b6e976-50cd-4166-a0c2-915be651551f" (UID: "34b6e976-50cd-4166-a0c2-915be651551f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:45:10.399365 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.399343 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "34b6e976-50cd-4166-a0c2-915be651551f" (UID: "34b6e976-50cd-4166-a0c2-915be651551f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:45:10.399501 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.399479 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34b6e976-50cd-4166-a0c2-915be651551f-kube-api-access-zwzsp" (OuterVolumeSpecName: "kube-api-access-zwzsp") pod "34b6e976-50cd-4166-a0c2-915be651551f" (UID: "34b6e976-50cd-4166-a0c2-915be651551f"). InnerVolumeSpecName "kube-api-access-zwzsp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:45:10.399575 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.399484 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls" (OuterVolumeSpecName: "online-tls") pod "34b6e976-50cd-4166-a0c2-915be651551f" (UID: "34b6e976-50cd-4166-a0c2-915be651551f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:45:10.399575 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.399498 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "34b6e976-50cd-4166-a0c2-915be651551f" (UID: "34b6e976-50cd-4166-a0c2-915be651551f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:45:10.427706 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.427684 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:45:10.496737 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.496715 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a278b736-004c-44cd-a20b-3cd9bd9b08c0-feast-data\") pod \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " Sep 15 09:45:10.496830 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.496756 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-offline-tls\") pod \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " Sep 15 09:45:10.496830 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.496775 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls\") pod \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " Sep 15 09:45:10.496830 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.496808 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls\") pod \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " Sep 15 09:45:10.496830 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.496828 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-registry-tls\") pod \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " Sep 15 09:45:10.497314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.496845 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7l4p\" (UniqueName: \"kubernetes.io/projected/a278b736-004c-44cd-a20b-3cd9bd9b08c0-kube-api-access-m7l4p\") pod \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\" (UID: \"a278b736-004c-44cd-a20b-3cd9bd9b08c0\") " Sep 15 09:45:10.497314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.496987 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/34b6e976-50cd-4166-a0c2-915be651551f-registry-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.497314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.497005 2562 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/34b6e976-50cd-4166-a0c2-915be651551f-feast-data\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.497314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.497018 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwzsp\" (UniqueName: \"kubernetes.io/projected/34b6e976-50cd-4166-a0c2-915be651551f-kube-api-access-zwzsp\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.497314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.497039 2562 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-online-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.497314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.497052 2562 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-offline-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.497314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.497064 2562 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/34b6e976-50cd-4166-a0c2-915be651551f-ui-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.497314 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.497265 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a278b736-004c-44cd-a20b-3cd9bd9b08c0-feast-data" (OuterVolumeSpecName: "feast-data") pod "a278b736-004c-44cd-a20b-3cd9bd9b08c0" (UID: "a278b736-004c-44cd-a20b-3cd9bd9b08c0"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 15 09:45:10.498790 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.498767 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "a278b736-004c-44cd-a20b-3cd9bd9b08c0" (UID: "a278b736-004c-44cd-a20b-3cd9bd9b08c0"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:45:10.499105 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.499078 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "a278b736-004c-44cd-a20b-3cd9bd9b08c0" (UID: "a278b736-004c-44cd-a20b-3cd9bd9b08c0"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:45:10.499200 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.499117 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls" (OuterVolumeSpecName: "online-tls") pod "a278b736-004c-44cd-a20b-3cd9bd9b08c0" (UID: "a278b736-004c-44cd-a20b-3cd9bd9b08c0"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:45:10.499200 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.499142 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a278b736-004c-44cd-a20b-3cd9bd9b08c0" (UID: "a278b736-004c-44cd-a20b-3cd9bd9b08c0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 15 09:45:10.499200 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.499175 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a278b736-004c-44cd-a20b-3cd9bd9b08c0-kube-api-access-m7l4p" (OuterVolumeSpecName: "kube-api-access-m7l4p") pod "a278b736-004c-44cd-a20b-3cd9bd9b08c0" (UID: "a278b736-004c-44cd-a20b-3cd9bd9b08c0"). InnerVolumeSpecName "kube-api-access-m7l4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 15 09:45:10.598200 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.598167 2562 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-offline-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.598200 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.598200 2562 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-online-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.598335 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.598213 2562 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-ui-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.598335 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.598224 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a278b736-004c-44cd-a20b-3cd9bd9b08c0-registry-tls\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.598335 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.598236 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7l4p\" (UniqueName: \"kubernetes.io/projected/a278b736-004c-44cd-a20b-3cd9bd9b08c0-kube-api-access-m7l4p\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.598335 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.598248 2562 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a278b736-004c-44cd-a20b-3cd9bd9b08c0-feast-data\") on node \"ip-10-0-142-220.ec2.internal\" DevicePath \"\"" Sep 15 09:45:10.794097 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.794053 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" Sep 15 09:45:10.794387 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.794088 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df" event={"ID":"34b6e976-50cd-4166-a0c2-915be651551f","Type":"ContainerDied","Data":"262e168e5cee4f1b20db5a97d10a9c1e794d9a0972b574195114a5b3a857a63a"} Sep 15 09:45:10.794387 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.794134 2562 scope.go:117] "RemoveContainer" containerID="da3b4d9be96bcf6f5182aab99a360cb9e463849c8c2633ec6cd9f8d79f99e5c1" Sep 15 09:45:10.797345 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.797322 2562 generic.go:356] "Generic (PLEG): container finished" podID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerID="0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0" exitCode=137 Sep 15 09:45:10.797345 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.797344 2562 generic.go:356] "Generic (PLEG): container finished" podID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerID="1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d" exitCode=137 Sep 15 09:45:10.797495 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.797367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerDied","Data":"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0"} Sep 15 09:45:10.797495 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.797399 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerDied","Data":"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d"} Sep 15 09:45:10.797495 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.797390 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" Sep 15 09:45:10.797495 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.797435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn" event={"ID":"a278b736-004c-44cd-a20b-3cd9bd9b08c0","Type":"ContainerDied","Data":"b2f095c5283ee8d45a95019e50b772190af10d87891e4495cdd5d3ac7358d54e"} Sep 15 09:45:10.803365 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.803351 2562 scope.go:117] "RemoveContainer" containerID="ee4a9ef9bf97b28934f6659fe0a5e2ae74e0d6a51c88f1917e3fab1370f96b09" Sep 15 09:45:10.811333 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.811314 2562 scope.go:117] "RemoveContainer" containerID="fe178004b1ef5e6660c92271a6ecc164cdf908fe912af5bc5643bf51eb4e7503" Sep 15 09:45:10.816249 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.816229 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df"] Sep 15 09:45:10.819318 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.819301 2562 scope.go:117] "RemoveContainer" containerID="acbb21b73dab92c3724ab9355b565eeaee84f2f4cd68a6a64f7f20889b027b2e" Sep 15 09:45:10.820011 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.819990 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-nt7df"] Sep 15 09:45:10.825803 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.825789 2562 scope.go:117] "RemoveContainer" containerID="a3ee5df7d535ab082ba3c422bf28ef5ea99abcdaf95325287033346f15aacb1c" Sep 15 09:45:10.829704 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.829681 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn"] Sep 15 09:45:10.832774 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.832729 2562 scope.go:117] "RemoveContainer" containerID="6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641" Sep 15 09:45:10.834644 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.834626 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-7mfmn"] Sep 15 09:45:10.839494 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.839475 2562 scope.go:117] "RemoveContainer" containerID="0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0" Sep 15 09:45:10.846114 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.846089 2562 scope.go:117] "RemoveContainer" containerID="e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc" Sep 15 09:45:10.852632 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.852615 2562 scope.go:117] "RemoveContainer" containerID="1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d" Sep 15 09:45:10.859050 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.859034 2562 scope.go:117] "RemoveContainer" containerID="388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403" Sep 15 09:45:10.865266 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.865250 2562 scope.go:117] "RemoveContainer" containerID="e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4" Sep 15 09:45:10.871430 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.871398 2562 scope.go:117] "RemoveContainer" containerID="6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641" Sep 15 09:45:10.871689 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:45:10.871671 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641\": container with ID starting with 6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641 not found: ID does not exist" containerID="6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641" Sep 15 09:45:10.871750 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.871695 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641"} err="failed to get container status \"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641\": rpc error: code = NotFound desc = could not find container \"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641\": container with ID starting with 6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641 not found: ID does not exist" Sep 15 09:45:10.871750 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.871711 2562 scope.go:117] "RemoveContainer" containerID="0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0" Sep 15 09:45:10.871944 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:45:10.871927 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0\": container with ID starting with 0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0 not found: ID does not exist" containerID="0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0" Sep 15 09:45:10.871987 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.871949 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0"} err="failed to get container status \"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0\": rpc error: code = NotFound desc = could not find container \"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0\": container with ID starting with 0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0 not found: ID does not exist" Sep 15 09:45:10.871987 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.871964 2562 scope.go:117] "RemoveContainer" containerID="e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc" Sep 15 09:45:10.872189 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:45:10.872173 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc\": container with ID starting with e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc not found: ID does not exist" containerID="e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc" Sep 15 09:45:10.872229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.872193 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc"} err="failed to get container status \"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc\": rpc error: code = NotFound desc = could not find container \"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc\": container with ID starting with e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc not found: ID does not exist" Sep 15 09:45:10.872229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.872207 2562 scope.go:117] "RemoveContainer" containerID="1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d" Sep 15 09:45:10.872400 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:45:10.872386 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d\": container with ID starting with 1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d not found: ID does not exist" containerID="1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d" Sep 15 09:45:10.872466 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.872430 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d"} err="failed to get container status \"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d\": rpc error: code = NotFound desc = could not find container \"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d\": container with ID starting with 1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d not found: ID does not exist" Sep 15 09:45:10.872466 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.872447 2562 scope.go:117] "RemoveContainer" containerID="388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403" Sep 15 09:45:10.872708 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:45:10.872690 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403\": container with ID starting with 388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403 not found: ID does not exist" containerID="388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403" Sep 15 09:45:10.872748 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.872714 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403"} err="failed to get container status \"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403\": rpc error: code = NotFound desc = could not find container \"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403\": container with ID starting with 388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403 not found: ID does not exist" Sep 15 09:45:10.872748 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.872727 2562 scope.go:117] "RemoveContainer" containerID="e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4" Sep 15 09:45:10.873005 ip-10-0-142-220 kubenswrapper[2562]: E0915 09:45:10.872988 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4\": container with ID starting with e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4 not found: ID does not exist" containerID="e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4" Sep 15 09:45:10.873046 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873008 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4"} err="failed to get container status \"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4\": rpc error: code = NotFound desc = could not find container \"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4\": container with ID starting with e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4 not found: ID does not exist" Sep 15 09:45:10.873046 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873022 2562 scope.go:117] "RemoveContainer" containerID="6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641" Sep 15 09:45:10.873251 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873233 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641"} err="failed to get container status \"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641\": rpc error: code = NotFound desc = could not find container \"6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641\": container with ID starting with 6bf47bb24d41464991fff055dff6f460051a7bad84637970bfcbfcb161c7b641 not found: ID does not exist" Sep 15 09:45:10.873293 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873252 2562 scope.go:117] "RemoveContainer" containerID="0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0" Sep 15 09:45:10.873487 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873472 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0"} err="failed to get container status \"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0\": rpc error: code = NotFound desc = could not find container \"0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0\": container with ID starting with 0307af2e9b9d442638e1940863908e9320e8795db83071ad31b427c010d58dc0 not found: ID does not exist" Sep 15 09:45:10.873487 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873487 2562 scope.go:117] "RemoveContainer" containerID="e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc" Sep 15 09:45:10.873686 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873667 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc"} err="failed to get container status \"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc\": rpc error: code = NotFound desc = could not find container \"e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc\": container with ID starting with e288f09cb78da32655a1b4713c963dea762fb823eb3345e54afe2c083d6599cc not found: ID does not exist" Sep 15 09:45:10.873728 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873686 2562 scope.go:117] "RemoveContainer" containerID="1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d" Sep 15 09:45:10.873877 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873861 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d"} err="failed to get container status \"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d\": rpc error: code = NotFound desc = could not find container \"1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d\": container with ID starting with 1f0788febf5e95cde2746b60bd3285156fe61a09347d67b6575d05519353b29d not found: ID does not exist" Sep 15 09:45:10.873923 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.873876 2562 scope.go:117] "RemoveContainer" containerID="388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403" Sep 15 09:45:10.874080 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.874064 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403"} err="failed to get container status \"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403\": rpc error: code = NotFound desc = could not find container \"388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403\": container with ID starting with 388696278a356ea9150128cf722bc2c1ed6f6a4fc986e707b4c68049adb1f403 not found: ID does not exist" Sep 15 09:45:10.874080 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.874079 2562 scope.go:117] "RemoveContainer" containerID="e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4" Sep 15 09:45:10.874300 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:10.874283 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4"} err="failed to get container status \"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4\": rpc error: code = NotFound desc = could not find container \"e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4\": container with ID starting with e23f1bb5d76210c41b5034d81dbc4109ec99030fdcac8d1e64971eb6268573f4 not found: ID does not exist" Sep 15 09:45:11.904811 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:11.904780 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34b6e976-50cd-4166-a0c2-915be651551f" path="/var/lib/kubelet/pods/34b6e976-50cd-4166-a0c2-915be651551f/volumes" Sep 15 09:45:11.905299 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:11.905285 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" path="/var/lib/kubelet/pods/a278b736-004c-44cd-a20b-3cd9bd9b08c0/volumes" Sep 15 09:45:13.219540 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:13.219501 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:13.267463 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:13.267349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:22.423625 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:22.423546 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:22.551415 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:22.551382 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:25.951275 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:25.951243 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:45:25.955058 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:25.955038 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:45:28.084847 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:28.084811 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:28.142347 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:28.142312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:29.079484 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:29.079448 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:29.177983 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:29.177951 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:46.492955 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:46.492915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:46.646013 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:46.645977 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:46.746584 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:46.746499 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:49.232319 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:49.232280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4mtmw_eac3b9bb-8116-4fb5-ad98-ad2128fdfb77/global-pull-secret-syncer/0.log" Sep 15 09:45:49.363087 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:49.363065 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" Sep 15 09:45:49.481123 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:49.481102 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-220.ec2.internal_67f1d1cf0f48063d0874c8424f57bf27/haproxy/0.log" Sep 15 09:45:51.995711 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:51.995680 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:52.044036 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:52.044009 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7n7vx_559a77da-1159-4381-b211-757ea2d74191/konnectivity-agent/0.log" limit=1024 Sep 15 09:45:53.907465 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:53.907434 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvjvw_cf1d66cb-32a6-4226-a5f3-06caa9f7dab0/node-exporter/0.log" Sep 15 09:45:53.927509 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:53.927484 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvjvw_cf1d66cb-32a6-4226-a5f3-06caa9f7dab0/kube-rbac-proxy/0.log" Sep 15 09:45:53.950383 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:53.950365 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvjvw_cf1d66cb-32a6-4226-a5f3-06caa9f7dab0/init-textfile/0.log" Sep 15 09:45:54.379590 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:54.379555 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86dd6f66df-jqndq_febf2680-ffc1-4e18-a07a-7ed3f2af5c40/thanos-query/0.log" Sep 15 09:45:54.404933 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:54.404903 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86dd6f66df-jqndq_febf2680-ffc1-4e18-a07a-7ed3f2af5c40/kube-rbac-proxy-web/0.log" Sep 15 09:45:54.430861 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:54.430840 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86dd6f66df-jqndq_febf2680-ffc1-4e18-a07a-7ed3f2af5c40/kube-rbac-proxy/0.log" Sep 15 09:45:54.451422 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:54.451385 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86dd6f66df-jqndq_febf2680-ffc1-4e18-a07a-7ed3f2af5c40/prom-label-proxy/0.log" Sep 15 09:45:54.474187 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:54.474164 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86dd6f66df-jqndq_febf2680-ffc1-4e18-a07a-7ed3f2af5c40/kube-rbac-proxy-rules/0.log" Sep 15 09:45:54.493569 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:54.493552 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86dd6f66df-jqndq_febf2680-ffc1-4e18-a07a-7ed3f2af5c40/kube-rbac-proxy-metrics/0.log" Sep 15 09:45:55.786109 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:55.786079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-p9mvb_79e34300-eb34-4e86-8c51-af0b349a38a2/networking-console-plugin/0.log" Sep 15 09:45:57.069556 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.069527 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-8vlvn_cecd620e-a78a-4637-9948-5ec04b4994d9/volume-data-source-validator/0.log" Sep 15 09:45:57.810813 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.810779 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f"] Sep 15 09:45:57.811056 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811043 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="feast-apply" Sep 15 09:45:57.811056 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811056 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="feast-apply" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811066 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="feast-init" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811073 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="feast-init" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811083 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811092 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811108 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811114 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811120 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811127 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811135 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="feast-apply" Sep 15 09:45:57.811140 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811141 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="feast-apply" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811146 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="offline" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811151 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="offline" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811159 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="registry" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811165 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="registry" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811170 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811176 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811182 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="offline" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811187 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="offline" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811195 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="feast-init" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811200 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="feast-init" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811243 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="online" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811249 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="offline" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811254 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="ui" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811260 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="offline" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811265 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b6e976-50cd-4166-a0c2-915be651551f" containerName="ui" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811272 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="online" Sep 15 09:45:57.811517 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.811276 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a278b736-004c-44cd-a20b-3cd9bd9b08c0" containerName="registry" Sep 15 09:45:57.814181 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.814165 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.816758 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.816742 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxgxj\"/\"kube-root-ca.crt\"" Sep 15 09:45:57.817812 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.817798 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mxgxj\"/\"default-dockercfg-pcfhp\"" Sep 15 09:45:57.817870 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.817829 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mxgxj\"/\"openshift-service-ca.crt\"" Sep 15 09:45:57.823839 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.823816 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f"] Sep 15 09:45:57.894460 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.894441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sbrc\" (UniqueName: \"kubernetes.io/projected/92c989fd-59c2-4a27-a9f7-342527d97255-kube-api-access-2sbrc\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.894558 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.894473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-proc\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.894558 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.894492 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-podres\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.894628 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.894554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-sys\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.894628 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.894615 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-lib-modules\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.898504 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.898481 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6xcht_c0960245-d690-47dc-af38-1a79cbc5df43/dns/0.log" Sep 15 09:45:57.917232 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.917216 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6xcht_c0960245-d690-47dc-af38-1a79cbc5df43/kube-rbac-proxy/0.log" Sep 15 09:45:57.994883 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.994861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sbrc\" (UniqueName: \"kubernetes.io/projected/92c989fd-59c2-4a27-a9f7-342527d97255-kube-api-access-2sbrc\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.994974 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.994890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-proc\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.994974 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.994907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-podres\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.994974 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.994956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-sys\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.995095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.994985 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-proc\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.995095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.994994 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-podres\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.995095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.995041 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-sys\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.995095 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.995061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-lib-modules\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:57.995235 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:57.995126 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92c989fd-59c2-4a27-a9f7-342527d97255-lib-modules\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:58.002304 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.002278 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sbrc\" (UniqueName: \"kubernetes.io/projected/92c989fd-59c2-4a27-a9f7-342527d97255-kube-api-access-2sbrc\") pod \"perf-node-gather-daemonset-4pn5f\" (UID: \"92c989fd-59c2-4a27-a9f7-342527d97255\") " pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:58.045285 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.045268 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ggrvg_a6285a98-34d0-4250-aa72-72f27f0920f2/dns-node-resolver/0.log" Sep 15 09:45:58.124259 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.124238 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:58.390229 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.390163 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f"] Sep 15 09:45:58.393443 ip-10-0-142-220 kubenswrapper[2562]: W0915 09:45:58.393393 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92c989fd_59c2_4a27_a9f7_342527d97255.slice/crio-edfc176c5fef5436ff6fc538de07822faf7acb053d0857626e762a56bda63507 WatchSource:0}: Error finding container edfc176c5fef5436ff6fc538de07822faf7acb053d0857626e762a56bda63507: Status 404 returned error can't find the container with id edfc176c5fef5436ff6fc538de07822faf7acb053d0857626e762a56bda63507 Sep 15 09:45:58.527951 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.527926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pss4x_8b29e866-e456-46e2-82e4-697950b477f7/node-ca/0.log" Sep 15 09:45:58.961709 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.961681 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" event={"ID":"92c989fd-59c2-4a27-a9f7-342527d97255","Type":"ContainerStarted","Data":"0c2e755c6587ce1b1785cbc04dac754bfbc76e61d527656bff4adcda23d4ca1c"} Sep 15 09:45:58.961825 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.961729 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" event={"ID":"92c989fd-59c2-4a27-a9f7-342527d97255","Type":"ContainerStarted","Data":"edfc176c5fef5436ff6fc538de07822faf7acb053d0857626e762a56bda63507"} Sep 15 09:45:58.961825 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.961760 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:45:58.976771 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:58.976729 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" podStartSLOduration=1.976715206 podStartE2EDuration="1.976715206s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:58.975810368 +0000 UTC m=+1833.501465672" watchObservedRunningTime="2026-09-15 09:45:58.976715206 +0000 UTC m=+1833.502370507" Sep 15 09:45:59.180964 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:59.180928 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fcc97bcb6-mvzt9_c5378404-461a-4a2b-ac48-5f6552115a14/router/0.log" Sep 15 09:45:59.499436 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:59.499398 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6jcqs_c584b6bd-5a6e-46c7-b3f2-54fdd0fa401c/serve-healthcheck-canary/0.log" Sep 15 09:45:59.911910 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:59.911878 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l87kp_2b848470-f045-4acb-8bbe-afa14468cbbc/kube-rbac-proxy/0.log" Sep 15 09:45:59.930244 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:59.930194 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l87kp_2b848470-f045-4acb-8bbe-afa14468cbbc/exporter/0.log" Sep 15 09:45:59.950977 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:45:59.950936 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l87kp_2b848470-f045-4acb-8bbe-afa14468cbbc/extractor/0.log" Sep 15 09:46:04.902097 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:04.902060 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8w4cc_c60f258a-b437-4b93-96a7-a3fa25c7fc8c/kube-multus/0.log" Sep 15 09:46:04.973787 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:04.973759 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mxgxj/perf-node-gather-daemonset-4pn5f" Sep 15 09:46:05.097400 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.097373 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwszq_98e38b20-e6ff-49f4-b365-c4f96e003c3b/kube-multus-additional-cni-plugins/0.log" Sep 15 09:46:05.116172 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.116140 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwszq_98e38b20-e6ff-49f4-b365-c4f96e003c3b/egress-router-binary-copy/0.log" Sep 15 09:46:05.135057 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.135029 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwszq_98e38b20-e6ff-49f4-b365-c4f96e003c3b/cni-plugins/0.log" Sep 15 09:46:05.153682 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.153606 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwszq_98e38b20-e6ff-49f4-b365-c4f96e003c3b/bond-cni-plugin/0.log" Sep 15 09:46:05.171786 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.171756 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwszq_98e38b20-e6ff-49f4-b365-c4f96e003c3b/routeoverride-cni/0.log" Sep 15 09:46:05.190021 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.189995 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwszq_98e38b20-e6ff-49f4-b365-c4f96e003c3b/whereabouts-cni-bincopy/0.log" Sep 15 09:46:05.208924 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.208897 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pwszq_98e38b20-e6ff-49f4-b365-c4f96e003c3b/whereabouts-cni/0.log" Sep 15 09:46:05.462741 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.462661 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qc74b_aa57e01c-ee26-4f68-a370-7e7e64a3d7f5/network-metrics-daemon/0.log" Sep 15 09:46:05.479318 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:05.479292 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qc74b_aa57e01c-ee26-4f68-a370-7e7e64a3d7f5/kube-rbac-proxy/0.log" Sep 15 09:46:06.411297 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.411265 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-controller/0.log" Sep 15 09:46:06.427266 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.427232 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/1.log" Sep 15 09:46:06.427266 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.427269 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovn-acl-logging/0.log" Sep 15 09:46:06.447235 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.447214 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/kube-rbac-proxy-node/0.log" Sep 15 09:46:06.465657 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.465631 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/kube-rbac-proxy-ovn-metrics/0.log" Sep 15 09:46:06.483420 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.483382 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/northd/0.log" Sep 15 09:46:06.503325 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.503302 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/nbdb/0.log" Sep 15 09:46:06.522037 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.522019 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/sbdb/0.log" Sep 15 09:46:06.576762 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:06.576740 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jshph_9ba662bb-c76a-48e6-b219-ecffac8b8be1/ovnkube-controller/0.log" Sep 15 09:46:07.827508 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:07.827476 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wcfmg_828adf4b-1f31-4105-b988-07ae711071ef/network-check-target-container/0.log" Sep 15 09:46:08.750823 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:08.750798 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lwjz8_8877f1ed-ef9c-4e7d-92de-6cbbe64c9e09/iptables-alerter/0.log" Sep 15 09:46:09.347097 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:09.347065 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tp2wn_1daa4c6a-3edf-440b-bf85-07b75639d061/tuned/0.log" Sep 15 09:46:12.035895 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:12.035860 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-568869fdc5-xcq95_97c7651b-b9fe-455a-8871-4b49a6e75066/service-ca-controller/0.log" Sep 15 09:46:12.416151 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:12.416127 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-n6bdp_3590d371-d8f5-4ccf-a1c9-1ed45d072d00/csi-driver/0.log" Sep 15 09:46:12.433733 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:12.433709 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-n6bdp_3590d371-d8f5-4ccf-a1c9-1ed45d072d00/csi-node-driver-registrar/0.log" Sep 15 09:46:12.451736 ip-10-0-142-220 kubenswrapper[2562]: I0915 09:46:12.451715 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-n6bdp_3590d371-d8f5-4ccf-a1c9-1ed45d072d00/csi-liveness-probe/0.log"